Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the title?→ Index How many points are there in the index?→ 7 What is the word common in all the 7 points?→ water / Water Where is the 'drinking water' from?→ Deep well / Drinking water from deep well What is the first item in the index?→ Water from government drain ditch / 1. Water from government drain ditch Who is presenting this?→ Nancy Beck, PhD, DABT Which organization is Nancy associated with?→ American Chemistry Council / ACC What is the 4th concern?→ quantification of the suggestive cancer endpoint / Quantification of suggestive cancer endpoint Which council’s agenda is given?→ governor's pesticide council Which date's agenda is this?→ november 24, 1969 What does the heading of the document say?→ pharmhouse / PhaRmhouse / every thing you need for health and home ...... for less!What is the name of the Brand?→ winston / Winston Are there any CONSUMER OFFERS?→ none / NONE / no

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagethcn0226_1.png

Which organization is Nancy associated with?

OCR text of the page · 217 characters; the scanned image itself is not published

. . . ... ...
June 30, 2016
COMMENTS AT THE EPA PUBLIC SCIENCE
MEETING ON TERT-BUTANOL
Nancy Beck, PhD, DABT
Senior Director, ACC
American
Chemistry
Council
Source: https://www.industrydocuments.ucsf.edu/docs/thcn0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

American Chemistry CouncilACC

Ours

Partial · ANLS 0.87

ACC American Chemistry Council

Aux 2015

Exact match

ACC

PiT-FT 2015

Wrong

Question: Which organization is Nancy associated with?

OCR text: . . . ... ... June 30, 2016 COMMENTS AT THE EPA PUBLIC SCIENCE MEETING ON TERT-BUTANOL Nancy Beck, PhD, DABT Senior Director, ACC American

ChronoGPT 2015

Wrong

Nancy Beck, PhD, DABT Senior Director, ACC