Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenfpw0224_9.png

What is the name of the Grower ?

OCR text of the page · 606 characters; the scanned image itself is not published
Grower: DANial Johnson
Phone:
Office:
Cell: 9/1 - 281 . 0012
Home : 9/2- 449- 3955
Address:
Fax:
2747 DANiel Rd.
AlAMA GA 31510
County: Picace
Directions to Site:
BLACKshere. Red 4203 To Sunset ad To Radio stayould
TURN left Go 3 miles TuRed left on mill BRANchRed
Go TO ist Dirt Rd Turnleft
Propane Service: Feany) CAS
Phone:
912 632 - 7914
Contact: Bo Pete
Home:
Cell
Electrical Service: WAyne OquinN Phone:
91x 449- 4842
Home:
Contact: W Ayne
Cell:
BLACKsheAR
Total Number of Barns to be Converted
2000 and 2001 Seasons:
Notes:
2
4
52379 3076
Source: https://www.industrydocuments.ucsf.edu/docs/nfpw0224
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Daniel Johnson
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.93

DANial Johnson

14 characters5 tokens

Aux 2015

Wrong

2000 and 2001 seasons: Notes: 2 4 52379 3076

44 characters31 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Grower: DANIAL Johnson Phone:

Cell: Phone:

Input:

Cell: Phone:

Output:

Input:

Cell: Phone:

111 characters64 tokens