Document Intelligence US tax document models

The Document Intelligence contract model uses powerful Optical Character Recognition (OCR) capabilities to analyze and extract key fields and line items from a select group of tax documents. Tax documents can be of various formats and quality including phone-captured images, scanned documents, and digital PDFs. The API analyzes document text; extracts key information such as customer name, billing address, due date, and amount due; and returns a structured JSON data representation. The model currently supports certain English tax document formats.

Supported document types:

• W-2
• 1098
• 1098-E
• 1098-T
• 1099 and variations (A, B, C, CAP, DIV, G, H, INT, K, LS, LTC, MISC, NEC, OID, PATR, Q, QA, R, S, SA, SB​)
• 1040 and variations (Schedule 1, Schedule 2, Schedule 3, Schedule 8812, Schedule A, Schedule B, Schedule C, Schedule D, Schedule E, Schedule EIC, Schedule F, Schedule H, Schedule J, Schedule R, Schedule SE, and Schedule Senior)

Automated tax document processing

Automated tax document processing is the process of extracting key fields from tax documents. Historically, tax documents were processed manually. This model allows for the easy automation of tax scenarios.

Development options

Input requirements

• For best results, provide one clear photo or high-quality scan per document.

• Supported file formats:

  Model	PDF	Image: JPEG/JPG, PNG, BMP, TIFF, HEIF	Microsoft Office: Word (DOCX), Excel (XLSX), PowerPoint (PPTX), and HTML
  Read	✔	✔	✔
  Layout	✔	✔	✔ (2024-02-29-preview, 2023-10-31-preview)
  General Document	✔	✔
  Prebuilt	✔	✔
  Custom extraction	✔	✔
  Custom classification	✔	✔	✔ (2024-02-29-preview)

• For PDF and TIFF, up to 2000 pages can be processed (with a free tier subscription, only the first two pages are processed).

• The file size for analyzing documents is 500 MB for paid (S0) tier and 4 MB for free (F0) tier.

• Image dimensions must be between 50 x 50 pixels and 10,000 px x 10,000 pixels.

• If your PDFs are password-locked, you must remove the lock before submission.

• The minimum height of the text to be extracted is 12 pixels for a 1024 x 768 pixel image. This dimension corresponds to about 8-point text at 150 dots per inch (DPI).

• For custom model training, the maximum number of pages for training data is 500 for the custom template model and 50,000 for the custom neural model.

  • For custom extraction model training, the total size of training data is 50 MB for template model and 1G-MB for the neural model.

  • For custom classification model training, the total size of training data is 1GB with a maximum of 10,000 pages.

Try tax document data extraction

See how data, including customer information, vendor details, and line items, is extracted from invoices. You need the following resources:

• An Azure subscription—you can create one for free.

• A Document Intelligence instance in the Azure portal. You can use the free pricing tier (F0) to try the service. After your resource deploys, select Go to resource to get your key and endpoint.

Document Intelligence Studio

1. On the Document Intelligence Studio home page, select the supported tax document model.

2. You can analyze a sample tax document or upload your own files.

3. Select the Run analysis button and, if necessary, configure the Analyze options :

   

Supported languages and locales

See our Language Support—prebuilt models page for a complete list of supported languages.

Field extraction W-2

The following are the fields extracted from a W-2 tax form in the JSON output response.

Field extraction 1098

The following are the fields extracted from a 1098 tax form in the JSON output response. The 1098-T and 1098-E forms are also supported.

Field extraction 1099-NEC

The following are the fields extracted from a 1099-nec tax form in the JSON output response. The other variations of 1099 are also supported.

Field extraction 1040 tax form

The following are the fields extracted from a 1040 tax form in the JSON output response. The other variations of 1040 are also supported.

The tax documents key-value pairs and line items extracted are in the documentResults section of the JSON output.

Next steps

• Try processing your own forms and documents with the Document Intelligence Studio.

• Complete a Document Intelligence quickstart and get started creating a document processing app in the development language of your choice.