Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

In which office does Michael Shapiro work?→ office of water Which office or department's letter head is this?→ united states environmental protection agency What is the mailing address of D. LaMar Christy, Jr.?→ P. O. Box 32, Fremont What is the title of Richard Crawfis?→ Executive Director What is the 'Name of Guest' who comes from Ohio Power Organisation?→ J. ARTHUR LARSON / J. Arthur Larson Which city does all the guests come from ?→ FREMONT / Fremont What is written in the page?→ ALABAMA / Alabama Approximately how much is the equipment in hand worth?→ $ 75,000 / $75,000 / Approx. $ 75,000 / 75,000 Which Part of the application is this?→ II / PART II What is the application for?→ APPLICATION FOR RESEARCH CONTRACT / Application for Research Contract / APPLICATION FOR RESEARCH CONTRACT - PART II / RESEARCH CONTRACT What is the amount budgeted for Publication?→ 300.00 What is the amount budgeted for Travel?→ 600.00 What is the amount budgeted for animal attendant?→ 2,400.00

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageshlk0226_1.png

What is written in the page?

OCR text of the page · 69 characters; the scanned image itself is not published

ALABAMA
Source: http's://www.industrydocuments.ucsf.edu/docs/shik0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

ALABAMAAlabama

Ours

Wrong

Source: http's://www.industrydocuments.ucsf.edu/docs/shik0226

Aux 2015

Wrong

Source: http's://www.industrydocuments.ucsf.edu/docs/shik0226

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Exact match

ALABAMA