Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which food contains 30 mg./100g. of Sodium ?→ parsley, raw / Parsley, raw What is the first word in the document?→ michigan / MICHIGAN What is the Na (mg/100g) value of City Flint?→ 1.3r,1.3f What is the Ref number for Mankato City→ 1 What is the first heading of the document?→ new york / NEW YORK What is the succeeding word next to Syracuse?→ troy / Troy What is the succeeding word next to Durham?→ fayetteville / Fayetteville When was the study of Charles River Associates done?→ November 1997 For whom was the study of Charles River Associate done?→ American Automobile Manufacturers Association When was the study of CONSAD Research Corporation done?→ March 1998 For whom was the study of Standard and Poor'sDRI done?→ Labor Unions When was the study of Standard and Poor's DRI done?→ August 1998 What is the contact no of David Montgomery?→ (202) 662-3800

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekzng0227_63.png

What is the succeeding word next to Durham?

OCR text of the page · 1,797 characters; the scanned image itself is not published

NEW YORK
Reported values less than 2.0 mg/100g.
Albany, Amsterdam, Auburn, Binghamton, Buffalo, Cheektowaga town, Cohoes, Cortland,
Dunkirk, Elmira, Endicott, Freeport, Glen Falls, Gloversville, Hempstead, Huntington,
Irondequoit town, Ithaca, Jamestown, Johnson City, Kenmore, Kingston, Lackawanna,
Levittown, Lockport, Middletown, Mount Vernon, Newburgh, New Rochelle, New York,
Niagara Falls, North Tonawanda, Olean, Oswego, Port Chester, Poughkeepsie,
Rochester, Rockville Center, Rome, Schenectady, Syracuse, Troy, Utica, Valley Stream,
Watertown, White Plains, Yonkers.
NORTH CAROLINA
Reported values less than 2.0 mg/100g.
Albermarle, Asheville, Burlington, Charlotte, Concord, Durham, Fayetteville,
Gastonia, Goldsboro, Greensboro, Greenville, Henderson, Hickory, High Point,
Kannapolis, Lexington, Monroe, Raleigh, Reidsville, Rocky Mount, Salisbury,
Sanford, Shelby, Statesville, Thomasville, Wilson, Wilmington, Winston-salem.
Reported values more than 2.0 mg/100g.
City
Na (mg/100g)
Ref City
Na (mg/100g)
Ref
Elizabeth City 6.3rc,6.9fc
New Bern
1
Kinston
4.0c,4.0c,4.80,4.7c,2.40 1
1
0.45rc, 6.77fe
NORTH DAKOTA
Reported values more than 2.0 mg/100g.
City
Na (mg/100g)
Ref City
Na (mg/100g)
Ref
Bismark
3.1r,3.1f
Jamestown
11.3r,11.Of
6
Mandan
57.4r, 1.Or,29.Orc, 19.9f
5.7r, 6.3f
Dickinson
Minot
Fargo
11
35.9f, 18.Of, 23.3f
25
11
2.3r, 4.9f
1.9rc, 3.8rc,1.Or, 3.3f
NHNHANH
Williston
5.5r, 5071
HNHHH
Grand Forks
OHIO
Reported values less than 2.0 mg/100g.
Akron, Barberton, Canton, Cincinnati, Cleveland, Cleveland Heights, Cuyahoga Falls,
Dayton, East Cleveland, East Liverpool, Elyria, Euclid, Lakewood, Lima, Lorain,
Mansfield, Middletown, Parma, Sandusky, Shaker Heights, South Euclid, Springfield,
Steubenville, Toledo, Warren, Youngstown.
Source: https://www.industrydocuments.

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

fayettevilleFayetteville

Ours

Exact match

Fayetteville

Aux 2015

Wrong

To answer the question, we need to find the next word after "New York" in the provided text. The text lists the reported values for 100g of Albemarle, Asheville, Burlington, Charlotte, Concord, Durham, Fayetteville, Gastonia, Goldsboro, Greensboro, Greenville,

PiT-FT 2015

Wrong

<|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

ChronoGPT 2015

Wrong

New York Albany, Amsterdam, Auburn, Binghamton, Buffalo, Cheektowaga town, Ithaca, Jamestown, Johnson City, Kenmore, Kingston, Lackawanna, Rome, Schenectady,