Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekzng0227_60.png

What is the Ref number for Mankato City

OCR text of the page · 1,339 characters; the scanned image itself is not published
MICHIGAN, con't.
Reported values more than 2.0 mg/100g.
City
Na (mg/100g)
Ref City Na (mg/100g)
Ref
Ann Arbor
0.48r, 0.71r, 1.2f
Jackson
5.Of
2
Bay City
3 .4r, 5,Of
Lansing
OUT
2 .4fc
East Lansing 17.9f
1
Flint
1.3r,1.3f
HHHNH
Pontiac.
1.5r, 2.5r,3.Or, 2.6f
11
2
2
Royal Oak
10,6r, 6.6f,15.Of
Ypsilanti 40fc
HHHNHNH
MINNESOTA
Reported values less than 2.0 mg/100g.
Albert Lea, Austin, Brainerd, Duluth, Faribault, Fergus Falls, Hibbing, Minneapolis,
Rochester, St. Cloud, St. Louis Park, St. Paul.
Reported values more than 2.0 mg/100g.
City
Na (mg/100g)
Ref City Na (mg/100g)
Ref
Mankato
2.2 f
Virginia
Moorhead
15.5r,74r, 10.Of
..Winona
0.79r, 2.Of
South St:Paul 0.68,2.5
1 .
u .
MISSISSIPPI
Reported values less than 2.0 mg/100g.
Columbus, Hattiesburg, Jackson, Meridian.
Reported values more than 2.0 mg/100g.
City
Na (mg/100g)
Ref City
Na (mg/100g)
Ref
Biloxi
13.8r,39,1r, 21.2r, 22.or,
Laurel
6 .6; 3.0, 2.6, 7.9, 4041
33 , Of
I
1.3,2.7, 2.7, 2.4f
3.5r, 304f
16.5
HN
Mccomb
23
Natchez
Clarksdale
Pascagoula
2404f
Corinth
2.2f, 0.31r, 7.7r
1
Tupelo..
406,4.5f
Greenville
14.5f,15.6
1
Vicksburg
3.2r, 3.1f
Greenwood
8.3f
1, Yazoo City
7.7f
HHHHHHH
Gulfport
13.5,7.2,6.0,5.1, 5.3,
5.5, 6.4, 8,0, 12.4,9.3f
1 :
MISSOURI
Reported values less than 2.0 mg/100g.
Cape Girardeau, Hannibal, Joplin, Moberly, Poplar Bluff, Sedalia, Springfield.
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Virginia

8 characters2 tokens

Aux 2015

Wrong

Answer: Mankato City

20 characters7 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Mankato City MICHIGAN, con't. Reported values more than 2.0 mg/100g. City Na (mg/100g) Ref City Na (mg/100g) Ref

112 characters49 tokens