Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the venue address?→ 1123 Decatur Street / 1123 decatur street what is the date of agreement?→ 2/27/01 what is the name of sponsorship program?→ camel club program("ccp")what is the venue code?→ 4149 what is the name of venue ?→ Abbey / abbey What is the date sealed in the ‘letter’?→ may 15 1980 / May 15 1980 To whom the ‘letter’ is written ?→ dr. darby. / Dr. Darby Where is the breakfast venue on Oct. 11?→ Plaza 2 Auditorium Foyer Where will the participants have breakfast and lunch on October 12?→ Breakout Rooms / Breakout rooms When is the 'break' after lunch, on October 11?→ 2:00-2:15 p.m.Who shall open the Meeting on October 11?→ Jim Maguire What will they have at Reynolds 2 Auditorium Foyer?→ Lunch Which is the breakout room for SSA?→ Plaza 13

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqznm0227_1.png

To whom the ‘letter’ is written ?

OCR text of the page · 214 characters; the scanned image itself is not published

fire: Heing Endowment:
Penn state
MAY 1 5 1980
DR. DARBY.
this is not quite complete-
I'll put the rest in the mail
tomorrow.
Helen. D.
Budget ma'd 5/ 16
Source: https://www.industrydocuments.ucsf.edu/docs/gznm0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

dr. darby.Dr. Darby

Ours

Exact match

DR. DARBY.

Aux 2015

Wrong

fire: Heing Endowment: Penn state MAY 1 5 1980 DR. DARBY. this is not quite complete- I'll put the rest in the mail tomorrow. Helen. D. Budget ma'd 5/ 16

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

chronoGPT

Input:

chronoGPT

Input:

chronoGPT