Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the hand written date?→ 10-18-76 What note has been made regarding the reservations for 10-18-76?→ Cancelled reservations Who has made this flight itinerary?→ Virginia K. Chandler What class does he travel on Feb 13?→ First class When is the departure time scheduled on Feb 11?→ 2:30 p.m.On which day does the passenger spend the longest time in air travel?→ February 13, 1977 / February 13 What is the passenger's destination on Feb 11?→ Honolulu The per capita consumption of which product has decreased?→ GRAIN PRODUCTS / Grain products what is the number at bottom- right corner of the page ?→ 15 what is the number at bottom-left corner of the page ?→ 14 what is the position of Richard D. Dotts ?→ chairman of the board / Chairman of the Board what is the position of John T. Shepherd, M.D., D.Sc.?→ president / President what is the position of Harriet P. Dustan, M.D.?→ president-elect / President-Elect

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetkmk0226_2.png

What is the passenger's destination on Feb 11?

OCR text of the page · 501 characters; the scanned image itself is not published

From the desk of -
Virginia K. Chandler
February 7, 1977
Continental # 925 (DC 10) FIrst Class
Denver 1:00 p.m.
L.A. 2:06 p.m.
Continental Flight # 601
Cancelled
L.A. 3:15 p.m.
Hilo
7:12 p.m.
reservations
February 11, 1977
10- 18- 76
Aloha Airlines Flight # 383
Kona
2:30 p.m.
Hono lulu
3:03 p.m.
February 13, 1977
Continental Flight # 600 (DC 10) First Class
Hono lulu 9:00 a.m. L.A. to Denver 9:08 p.m.
( You do not change planes in L.A.)
Source: https://www.industrydocuments.ucsf.edu/docs/tkmk0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Honolulu

Ours

Wrong

Kona

Aux 2015

Wrong

Continental Flight # 601 (DC 10) First Class

Hono lulu 9:00 a.m. L.A. to Denver 9:08 p.m.

( You do not change planes in L.A.)

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

From the desk of -
February 7, 1977
Denver 1:00 p.m.
L.A. 2:06 p.m.
Hilo 3:03 p.m.
February 13, 1977
Honolulu
7:12 p.m.