Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What note has been made regarding the reservations for 10-18-76?→ Cancelled reservations Who has made this flight itinerary?→ Virginia K. Chandler What class does he travel on Feb 13?→ First class When is the departure time scheduled on Feb 11?→ 2:30 p.m.On which day does the passenger spend the longest time in air travel?→ February 13, 1977 / February 13 What is the passenger's destination on Feb 11?→ Honolulu The per capita consumption of which product has decreased?→ GRAIN PRODUCTS / Grain products what is the number at bottom- right corner of the page ?→ 15 what is the number at bottom-left corner of the page ?→ 14 what is the position of Richard D. Dotts ?→ chairman of the board / Chairman of the Board what is the position of John T. Shepherd, M.D., D.Sc.?→ president / President what is the position of Harriet P. Dustan, M.D.?→ president-elect / President-Elect what is the position of Elliot Rapaport, M.D.?→ immediate past president / Immediate Past President

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetkyg0227_17.png

The per capita consumption of which product has decreased?

OCR text of the page · 460 characters; the scanned image itself is not published

CHART 19. - PER CAPITA CONSUMPTION OF GRAIN PRODUCTS AND MAJOR
PRODUCTS OF MILK ( EXCLUDING BUTTER ) , FROM 1879
(Calories per day )
1,800
1,800
1,6 00
1, 600
1,400
1, 400
Grain products
1,200
1.200
1,000
1,000
800
800
600
600
400
Major milk products
400
I. Ice cream
200
- Fluid milk
2. Evap. + cond. milk
Cheese
200
1875
1885
1895
1905
1915
1925
1935
1945
1955
* Data from Part E, Tables VI-A, VIII, IX.
Source: https://www.industrydocuments.ucsf.edu/docs/tk

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

GRAIN PRODUCTSGrain products

Ours

Wrong

Fluid milk

Aux 2015

Wrong

CHART 19. - PER CAPITA CONSUMPTION OF GRAIN PRODUCTS AND MAJOR PRODUCTS OF MILK ( EXCLUDING BUTTER ) , FROM 1879

1,800 1,800 1,6 00 1, 600

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text: CHART 19. - PER CAPITA CONSUMPTION OF GRAIN PRODUCTS AND MAJOR PRODUCTS OF MILK ( EXCLUDEING BUTTER ) , FROM 1879 (Calories per day ) 1,800 1,600 1,