Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetjpg0227_6.png

Which is the leading county in value of dairy products?

OCR text of the page · 2,489 characters; the scanned image itself is not published
LEADING COUNTIES IN VALUE OF
1952 AVERAGE MILK
JATOT
DAIRY PRODUCTS SOLD FROM FARMS, 1949
PRODUCTION PER COW
Value of sales
in pounds
County
1,000 dollars
Maine ..........
5 , 650
W. Virginia .....
3,850
Los Angeles, Calif..
49,426
N. Hampshire
5, 750
N. Carolina.....
4,400
Stanislaus, Calif. ....
....
17,560
Vermont .......
5,980
S. Carolina .....
3,760
Delaware, N. Y. ....
. . ..
17,280
Massachusetts 6,580
Georgia ..........
3,480
Dane, Wis. .............
. ...
16,567
Rhode Island.
7,100
Florida ..........
4,350
St. Lawrence, N. Y. .....
....
16,007
Connecticut ..
6,450
S. Atlantic ....
4,307
New York .....
6,840
Marathon, Wis. ...........
. . .........
15,881
New Jersey...
7,420
Kentucky........
3,900
Lancaster, Pa. ......
..........
15,100
Pennsylvania.
6,380
Tennessee......
3,630
Merced, Calif. .......
...........
14,434
N. Atlantic..
6,574
A la ba ma . ........
3,400
Dodge, Wis. .......
..........
14,378
Mississippi.....
2, 650
Oneida, N. Y. ......
. . .......
14,345
Ohio.........
5, 750
Arkansas ........
3,040
Indiana . .......
5,670
Louisiana .......
2,500
Jefferson, N. Y. .......
. . .. .......
13,094
Illinois ........
5, 720
Oklahoma ...
3, 520
Clark, Wis. ............
. . . .........
12,589
Michigan . .....
6,470
Texas . ...........
3,290
Orange, N. Y. ...........
. . . .........
12,1 06
Wisconsin.....
6,960
S. Central .....
3,304
Fond du Lac, Wis. ............
11,959
E. N. Cent. ..
6,335
Otsego, N. Y. ..........
. .............
11, 569
Montana .........
4,900
Minnesota .....
6,180
Idaho..........
6,220
Chester, Pa. ......................
11,426
5,360
Wyoming. ........
5,170
Chenango, N. Y............
11,247
Iowa. ...........
Missouri.......
4,240
Colorado ........
5,400
McHenry, Ill ......
10,948
No.Dakota ....
4,670
N. Mexico .......
4,200
Barron, Wis. .....
. . . ....
10,809
So. Dakota ....
4,170
Arizona . .........
5,900
Outagamie, Wis. .....
10,715
Nebraska......
4,880
Utah . ... .. ........
6,600
Kansas ........
4,370
Nevada ..........
6,300
Sonoma, Calif. ......
10,692
W. N. Cent. ..
5,089
Washington.....
6,870
San Joaquin, Calif. .
10,671
Oregon. ........
5,880
Tulare, Calif.......
. . . . .
10,352
Delaware ......
5,350
California .......
7,640
Bradford, Pa. ...
. . ...
10,350
Maryland ......
5,620
Western. .......
6,645
Frederick, Md. ......
10,277
Virginia ....... 4,480
U. S. .. ..........
5,328
Table G
H aldot
To convert to quarts divide by 2.15.
(11)
Table F
(10)
Source: https://www.industrydocuments.ucsf.edu/docs/tjpg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
LOS ANGELES, CALIFLos Angeles, Calif.
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.53

Sonoma, Calif.

14 characters6 tokens

Aux 2015

Wrong

Answer: 1952 AVERAGE MILK

25 characters12 tokens

PiT-FT 2015

Wrong

<|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant

155 characters64 tokens

ChronoGPT 2015

Wrong

Chronos GPT Leading Counties in Value of Dairy Products 1952 AVERAGE MILK 1952 AVERAGE MILK 1952 AVERAGE MILK 1952 AVERAGE MILK 1952 AVERAGE MILK 1952 AVERAGE MILK

163 characters64 tokens