Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetjpg0227_9.png

What is the value mentioned for Mountain under the heading American Cheese Production by states, 1952?

OCR text of the page · 2,459 characters; the scanned image itself is not published
CREAMERY BUTTER PRODUCTION
*AMERICAN CHEESE PRODUCTION
IN 1952 BY STATES
BY STATES, 1952
in thousands of pounds (000 omitted)
in thousands of pounds (000 omitted)
Maine ... .. ......
184 S. Carolina....
183
Vermont........
4,894
Kentucky....... 26,089
Vermont ........
1,270
Georgia .........
521
New England 4,917
Tennessee..... 33,003
Massachusetts
273
S. Atlantic... 12,286
A la ba ma ....... 2,535
New England 1,728
New York...... 36,974
Mississippi.... 11,561
Kentucky....... 15,660
Pennsylvania.
910
Arkansas....... 11,318
New York ...... 19,719
Tennessee.....
9,486
Mid. Atlantic 37,884
Oklahoma ......
4,642
New Jersey....
25
Mississippi....
3,345
Texas ..........
3,811
Pennsylvania . 10,451
Arkansas .......
4,331
Ohio .. .......
18,653
S. Central .... 93, 035
Mid. Atlantic. 30,195
Louisiana ......
275
Indiana ......... 25,072
Oklahoma ...... 25,045
Illinois ......... 38,255
Ohio............. 46,645
Texas .........
6,137
Michigan....... 28,720
Montana ........ 2,811
Indiana ......... 29,056
S. Central .... 64,323
Wisconsin .....416,313
Idaho............ 18,053
Illinois ......... 49,892
E. N. Cent....527, 013
Colorado .......
375
Michigan ....... 48,483
Montana ........
5,962
Utah........
5,478
Wisconsin......161,561
Idaho............ 18,329
Minnesota ..... 47,415
Mountain ..... 26,761
E.N. Central .335,637
Wyoming........ 2,061
Iowa ............ 10,716
Colorado ....... 13,405
Missouri ....... 62,028
Minnesota......247,656
N. Mexico......
634
S. Dakota...... 1,565
Washington .... 2,929
Iowa.............173,785
Arizona .. .......
351
Nebraska ......
494
Oregon .......... 21,669
Missouri........ 48,373
Utah. ............
4,465
Kansas .........
7,790
California ...... 3,594
N. Dakota...... 44,658
Nevada .........
471
W.N. Cent. ...130,008
Pacific........ 28,192
S. Dakota ...... 30,254
Mountain...... 45,678
Nebraska ....... 71,269
Georgia ........
256
Kansas ......... 37,327
Washington .... 15,223
S. Atlantic .. 2,008
U. S. ..........849,818
W.N. Central .653,322
Oregon.......... 13,103
Production of all other cheese excluding full skim
Maryland .......
2,819
California ..... 16,675
Virginia ........
Pacific ....... 45,001
American and Cottage Cheese in 1952 totaled 321
7,159
million pounds in addition to the figures above.
W. Virginia ....
340
N. Carolina .... 1,264
U. S. ....... 1,188,170
*Does not include full skim American.
Table L
W aldoT
Table M
(16)
(17)
Source: https://www.industrydocuments.ucsf.edu/docs/tjpg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
26,761
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

45,678

6 characters7 tokens

Aux 2015

Wrong

The question asks for the value mentioned for Mountain under the heading American Cheese Production by states, 1952.

Looking at the provided text, I see:

  • "CREAMERY BUTTER PRODUCTION"
  • "AMERICAN CHEESE PRODUCTION"
  • "IN 1952
228 characters64 tokens

PiT-FT 2015

Wrong

<|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant

155 characters64 tokens

ChronoGPT 2015

Wrong

Chronological table of American cheese production in thousands of pounds by states, 1952.

Year: Year: Year: Year: Year: Year: Year: Year: Year:

180 characters64 tokens