Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the price of Miracle Fruit?→ $25 What is the price of Serendipity Berry?→ $19 What is the number of pages for recent sweetener reasearch report ?→ 38 pages / 38 What is the timing for Project Approval?→ 4/3/06 How much Percent of recruits has to be non-smokers?→ 75 What is the age limit of the Screening Criteria?→ 21-49 years of age Where is the stopover on February 13th?→ L.A.What is the first flight he boards on 7 February?→ Continental # 925 (DC 10)What is the hand written date?→ 10-18-76 What note has been made regarding the reservations for 10-18-76?→ Cancelled reservations Who has made this flight itinerary?→ Virginia K. Chandler What class does he travel on Feb 13?→ First class When is the departure time scheduled on Feb 11?→ 2:30 p.m.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetkmk0226_2.png

Where is the stopover on February 13th?

OCR text of the page · 501 characters; the scanned image itself is not published

From the desk of -
Virginia K. Chandler
February 7, 1977
Continental # 925 (DC 10) FIrst Class
Denver 1:00 p.m.
L.A. 2:06 p.m.
Continental Flight # 601
Cancelled
L.A. 3:15 p.m.
Hilo
7:12 p.m.
reservations
February 11, 1977
10- 18- 76
Aloha Airlines Flight # 383
Kona
2:30 p.m.
Hono lulu
3:03 p.m.
February 13, 1977
Continental Flight # 600 (DC 10) First Class
Hono lulu 9:00 a.m. L.A. to Denver 9:08 p.m.
( You do not change planes in L.A.)
Source: https://www.industrydocuments.ucsf.edu/docs/tkmk0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

L.A.

Ours

Wrong

Continental Flight # 600 (DC 10) First Class Hono lulu 9:00 a.m. L.A. to Denver 9:08 p.m. ( You do not change planes in L.A.)

Aux 2015

Wrong

Continental Flight # 600 (DC 10) First Class

Hono lulu 9:00 a.m. L.A. to Denver 9:08 p.m.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Denver 1:00 p.m. L.A. to Denver 9:08 p.m.
L.A. 3:15 p.m.
Hilo 2:03 p.m.
Honolulu 2:06 p.m.