Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageshjh0227_2.png

Which city does all the guests come from ?

OCR text of the page · 1,657 characters; the scanned image itself is not published
NAME OF GUEST
TITLE
BUSINESS / ORGANIZATION
MAILING ADDRESS
D. LaMar Christy, Jr.
Christy Machine Company
P. O. Box 32, Fremont
Richard Crawfis
Executive Director -YMCA of Sandusky County
832 Rawson Ave., Fremont
Eugene F. Detterman
Manager
Bureau of Employment Services
325 Cottage St., Fremont
Neil Berlekamp
Agent
John Hancock Mutual Life Ins. Co.
134 N. Wilson Ave. , Fremont
Charles R. Gilberg
Joseph's Department Store
1135 Hayes Ave., Fremont
Harry P. Gottron, Jr.
Gottron Bros. Company
1610 Birchard Ave. , Fremont
Raymond Grob, Sr.
Grob Camera Shop
11002 Birchard Ave., Fremont
Raymond Grob, Jr.
526 Elizabeth St., Fremont
Kenneth 0. Kessler
The K. Kessler Company
1905 Whitaker Dr. , Fremont
Robert B. Kridler
Kridler Insurance Company
410 South Wayne St. , Fremont
William W. Kridler
Attorney
1917 Glen Springs Dr. , Fremont
J. Arthur Larson
Ohio Power Company
1533 Sunrise Blvd, Fremont
G. Ninde Lawson
Columbia Gas of Ohio
1920 Melody Dr. , Fremont
Robert F. Wolfe
Owner
The Robert F. Wolfe Company
705 Birchard Ave., Fremont
Arthur Smith
Radio Announcer
W. F. R. O. Radio Station
523 South Park Ave. , Fremont
Donald F. Daubel
Fremont News-Messenger Co.
1865 Port Clinton Rd., Fremont
Paul G. Daubel
3031 Port Clinton Rd. , Fremont
Glen Geib
Editor
1525 Birchard Ave., Fremont
Robert H. Lytle
Lytle's Clothing Store
1847 Port Clinton Rd., Fremont
William K. Lytle
328 Whittlesey St., Fremont
Dr. Nelson J. Musson
Osteopath
1320 Hayes Ave. , Fremont
Edward H. Myers
H. J. Heinz Company
24 Pinewood Dr., Fremont
ldfath
Retired Supt. of Fremont City Schools
1518 Birchard Ave., Fremont
Source: https://www.industrydocuments.ucsf.edu/docs/shjh0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
FREMONTFremont
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Fremont

7 characters4 tokens

Aux 2015

Wrong

NAME OF GUEST TITLE BUSINESS / ORGANIZATION MAILING ADDRESS D. LaMar Christy, Jr. Christy Machine Company P. O. Box 32, Fremont Richard Crawfis Executive Director -YMCA of Sandusky County 832 Rawson

198 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Name of Guest TITLE BUSINESS / ORGANIZATION MAILING ADDRESS D. LaMar Christy, Jr. Christy Machine Company T.O. Box 32, Fremont Richard Crawfis Executive Director -YMCA of Sandusky County 832

190 characters64 tokens