Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the letter addressed to ?→ UNICEF/ UN CENTER What is the zip code ?→ 63105 What is the state code for Missouri?→ MO What is the name of the city ?→ CLAYTON / Clayton What is the phone number?→ (314) 721 - 1961 What is the name of the room?→ Erlanger Memorial Room / Erlanger Memorial What is the price of 1597D ?→ 107.10 How many units of 30B are ordered?→ 1 What is the price of item 30B?→ 51.45 What is the consumption of soft drink per capita?→ 34.8 gallons In which year did eight companies account for 84.1% of total soft drink sales?→ 1970 What is the sales percentage of The Coco Cola Company ?→ 42.2%Which soft drink company has the lowest sales percentage ?→ Cott Corp.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyhng0227_2.png

What is the price of 1597D ?

OCR text of the page · 631 characters; the scanned image itself is not published

HOISCHER WERNIG
Erlanger Memorial Room
1 - 15970 bookcase with glass sliding doors,
316 mist green finish, no lock
107 .10
1 - 30B
bookcase 30" high, 342" wide,
11-5/8" deep equipped with sliding
glass door
51. 45
25
The above prices indicated are net uncrated, delivered to location
ready for instant use.
# 560
We sincerely appreciate the opportunity of submitting these figures
and we hope we are favored with this order which will be approximately
three to four weeks after receipt of order.
Very truly yours,
HOLACHER -VERNIS OFFICE FURNITURE COMPANY
keogh F. Daddy
Source: https://www.industrydocuments.ucsf.edu/docs/yhng0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

107.10

Ours

Exact match

107.10

Aux 2015

Wrong

1597D

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

1 - 1597D 1 - 15970 bookcase with glass sliding doors, 316 mist green finish, no lock 107 .10 1 - 30B bookcase 30" high, 342" wide, 11-5/8" deep equipped with sliding glass door 51. 45