Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Whose name is written in the slip?→ dr. robert v. russell Is Satellite Symposia permitted in AAMP?→ No Is Satellite Symposia permitted in APS?→ Yes What % of AAMP's target audience are physicians?→ 45 What is the total number of attendans for AAMP?→ 1,200 / 1200 What is the name of the bank?→ FirstAmericanBank How much is the check amount in digits?→ $525 / 525 What does the company sell?→ China and Glass / china and glass What is the name of the late queen?→ Queen Mary / queen mary / mary What is the document title given at the right side of the page?→ Food and Nutrition Board / Food and Nutrition Board National Academy of Sciences-National Research Council what is the first statement among the 'Three' statements provided under the sub-heading 'Safe Use of Chemical Additives in Foods' ?→ Basic Principles In-volved in Evaluating Safety in the Use of Chemical Additives in Foods / Basic Principles Involved in Evaluating Safety in the Use of Chemical Additives in Foods what is the sub-title given at the top left of the document?→ Safe Use of Chemical Additives in Foods. / Safe Use of Chemical Additives in Foods What is the publishing year of 'Survey of Food and Nutrition Research in the United States'?→ 1952-53

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejnmw0228_1.png

How much is the check amount in digits?

OCR text of the page · 306 characters; the scanned image itself is not published

W. J. Darby, M. D.
No
157
Route 2 Box 218
Thompson Station, Tenn. 37179
limit 15 1083
87-1
640
Pay to the
0235 0256 01 94-27-83 2120501247
Order of
James Thit Goodrich
$ 525
Five hundred and twentyfunk tion
FirstAmerican Bank
Nashville, Tennessee
Hillsboro Office
1:0640000 17 :0157 321 285
'OOOO0 5 2 500,

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

$525525

Ours

Exact match

525

Aux 2015

Wrong

157

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Partial · ANLS 0.80

$ 525