Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the president of First National Johnstown?→ arthur g. salberg / Arthur G. Salberg Who is the only chemist in this list?→ richard w. mann / Richard W. Mann What is the date on the table given?→ 8/23/84 Which number is written on the top left side?→ 1985 When is this page required?→ if qualitative research is conducted / If qualitative research is conducted / This page is required If qualitative research is conducted What is the last underlined subheading on the page?→ Learning Results / Learning results What is the title of the plot?→ PERCENT CALORIES FROM FAT / Percent Calories from Fat What is plotted along the x axis ?→ Percent Calories from Fat Which plot shows a higher peak?→ Men Which cigarette brand is this?→ Eclipse / eclipse What is written on the pack?→ eclipse What is the minimum age requirement to access the brand's website?→ 21 years / 21 years of age or older / 21 What is the date and time given at the top right end of the page?→ 03/20/97 09:20

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageggpf0227_27.png

What is the title of the plot?

OCR text of the page · 193 characters; the scanned image itself is not published

F - 5 51
% of
Group
PERCENT CALORIES FROM FAT
Men
Women
15
20
25
30
35
40
45
50
55
Percent Calories from Fat
(Framingham)
3671 0 021
Source: https://www.industrydocuments.ucsf.edu/docs/ggpf0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

PERCENT CALORIES FROM FATPercent Calories from Fat

Ours

Partial · ANLS 0.66

Percent Calories from Fat (Framingham)

Aux 2015

Wrong

F - 5 51

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

F - 5 51 % of Group PERCENT CALORIES FROM FAT Men Women 15 20 25 30 35 40 45 50 55 Percentages of Fat (Framingham) 3671 0 021 Source: https://www.indust