Define the data before selecting a model.
A technical specification, a field service report and an application form contain different structures and create different consequences when misread. Combining them in one pilot makes it harder to diagnose errors. A useful initial boundary could be service reports received from external maintenance technicians.
Each field needs a meaning, format, required status and validation rule. The service date differs from the issue date; equipment identifiers may start with zeros; an absent value differs from a quantity of zero. These decisions form the extraction schema and remain accessible to the people reviewing the output.
Worked scenario: reading a maintenance report.
This is an illustrative workflow, not a client case study. An operations team receives a PDF covering several machines, handwritten observations and replacement parts. The system proposes one record per intervention and retains the original document. It leaves missing information unresolved rather than filling gaps with a plausible answer.
Scroll the table to compare all columns.
| Field | System proposal | Review trigger |
|---|---|---|
| Machine identifier | Text value and source page | Missing from the asset register or matches several assets |
| Part and quantity | Separate lines with the original unit | Unit absent or a line split across pages |
| Work performed | Short category with the original passage | Ambiguous note or activity outside the agreed catalogue |
| Service date | Normalised date and the text read | Conflicting dates in the heading and signature block |
What a scoped implementation can include.
A representative document set
Collect clear files, difficult scans, layout variants and incomplete examples. A process owner supplies the expected values. Reserve unseen examples for acceptance testing rather than configuring the system against every document.
Extraction and field validation
Compare text recognition, field extraction and deterministic checks. Show source references beside proposed values so reviewers can inspect the relevant passage without searching the full document.
A review queue
Specify which fields stop a record, who resolves each exception and how the reason is recorded. Preserve the difference between the first proposal and a subsequent human correction.
An agreed output
Deliver the required format, such as CSV or a draft record in an authorised tool. Final posting and additional integrations depend on verified access and the scope agreed during discovery.
Measure quality at the level of the important field.
A successfully processed document can still contain an incorrect quantity. Evaluate critical fields, omitted rows, incorrect row associations and correction time. Break results down by document format: an overall average can hide a scan type that consistently fails.
Microsoft distinguishes confidence information for words, fields and tables. A score can help route an item for review, but its usefulness must be tested on the actual workload. A threshold selected without comparison to expected values does not establish that the overall workflow is reliable.
Select this approach when the operating conditions support it.
If the sender can supply a reliable structured export, that may be simpler than reading a PDF. If most images are illegible, improve collection first. Where several languages are involved, include each relevant language in evaluation instead of assuming results will transfer.
- Your business can use the example documents for the project, and a knowledgeable person can verify the fields.
- Document variation makes manual processing costly, while the destination schema is sufficiently stable.
- There is a defined path for password-protected files, duplicates, unreadable scans and unsupported formats.
- The proposal separates sample preparation, extraction, review interface and destination-system integration.
A template to work from.
Document extraction schema
A schema for each document family with field meanings, validation rules, evidence and missing-data behaviour.
Download the Markdown templateAI evaluation dataset
A case register with verified expected results, judgement criteria and a separate set for the final evaluation.
Download the Markdown templateAutomation exception register
An exception queue with status, priority, ownership and closure evidence; repeated issues become inputs to workflow improvements.
Download the Markdown templatePractical questions
Can handwritten documents be included?
That requires a representative trial. Handwriting, image resolution, photographs and overlapping fields affect the result. Some categories may be excluded or always reviewed if correction effort outweighs the benefit.
Can extracted data be sent straight to our ERP?
Only for the approved fields and actions within scope. A reviewed draft or export is often a useful starting point. An ambiguous field should stop the relevant handoff rather than become a guessed value in the destination.
References and method
Technical context for text, field and table confidence and human review; this is not evidence of Stolen Orbit delivery results.