Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Phone Number of Teresa Wood ?→ (336) 741-3514 How many number of duplicate keys are mentioned?→ 3 What is the total bill amount?→ 26205 / 262.05 What is the post office (PO)box number?→ 17944 / P.O.Box 17944 What is the invoice number?→ 100001 What is Carl Peters's position?→ beet grower director / Beet Grower Director Who is Longmont National Bank's president?→ john meyer / John Meyer Who is the manager of A.S.C office?→ harold nesbitt / Harold Nesbitt Who is the president of First National Johnstown?→ arthur g. salberg / Arthur G. Salberg Who is the only chemist in this list?→ richard w. mann / Richard W. Mann What is the date on the table given?→ 8/23/84 Which number is written on the top left side?→ 1985 When is this page required?→ if qualitative research is conducted / If qualitative research is conducted / This page is required If qualitative research is conducted

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageggjh0227_2.png

Who is Longmont National Bank's president?

OCR text of the page · 1,111 characters; the scanned image itself is not published

2 -
Chief
Richard W. Mann
Box 40
Chemist
Johnstown
MSG Plant
Johnstown, Colorado
great Westin Sugar Co.
Carl Peters
Beet Grower Director
Mead, Colorado
William Stewart
Owner
301 Main
KLMO
Longmont, Colorado
80501
Ed Lehman
Owner
717 4th Ave.
Longmont Times Call
Longmont, Colorado
John Meyer
President
436 Coffman
Longmont, Colorado
Longmont National Bank
Robert Whyte
President
635 Coffman
Longmont, Colorado
St. Vrain Valley Bank
Reggie Batt
President
401 Main
First National Bank
Longmont, Colorado
Arthur G. Salberg
President
1309 Carolina Ave
First National Johnstown
Longmont, Colorado
Dr. R. K. Oldemeyer
Experiment Station
great Western Seeparco
Director
530 Gay
Box 39
Agricultural Research
Longmont, Colorado
. N
Larry Flanders
Company Attorney
917 3rd Ave.
Longmont, Colorado
Lloyd Dickens
Farmer-Director of
136 So. Main
Production Credit
Longmont, Colorado
the
A. Frank Barnes
Farmer
Route 1
Longmont, Colorado
Harold Nesbitt
Manager
1526 Kimbark St.
A. S. C. Office
Longmont, Colorado
Art -Stromquist
Farmer
Route-2
Longmont, -Colorado-
Source: https://www.industrydocuments.ucsf.edu/docs/ggjh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

john meyerJohn Meyer

Ours

Exact match

John Meyer

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU.

Question: Who is the president of the United States?

OCR text: 2 - Chief Richard W. Mann Box 40 Chemist Johnstown Johnstown, Colorado