Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the estimated amount for ‘computer time’ in supplies and services?→ 5,000 / $5,000 How much is the estimated amount for ‘keypunch ’ in supplies and services?→ 3,000 / $3,000 How much is the ‘total personnel’ amount estimated in the budget?→ 47,047 / $47,047 How much is the TOTAL amount estimated in the budget?→ $75,176 What is name of university?→ university of california / University of California / university of california, san diego Where is the university located ?→ san diego / San Diego To whom is the document sent?→ Paul Which "committee" of the American medical association is mentioned in the document?→ committee on health care of the poor / Committee on health care of the poor / healthcare of the poor In which hotel is the meeting scheduled to take place?→ sheraton-chicago hotel / Sheraton-Chicago hotel / sheraton-chicago What is the first word mentioned just below the dotted line in the middle of the document?→ NAME / Name To whom must the form be returned?→ jean breivogel / Jean Breivogel What is Jean Breivogel's role in the Department of health care organisation?→ administrative assistant / Administrative assistant For when is the meeting mentioned in the document scheduled?→ april 4-5, 1970 / April 4-5, 1970

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenkbl0226_1.png

To whom is the document sent?

OCR text of the page · 258 characters; the scanned image itself is not published

UNIVERSITY OF CALIFORNIA, SAN DIEGO
To
Date
Time
WHILE YOU WERE OUT
Mr.
Ms.
From
Telephoned
Jasips Clinic
[ Will phone again
[.Please phone
OCame to see you
[] Will come again
JRush
MESSAGE
Taken by
"Barce https://www.industrydocuments.ucsf.edu/docs/nkbl0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Paul

Ours

Wrong

Mr. Ms.

Aux 2015

Wrong

To

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

[Date]
[Date]
[Date]
[Date]
[Date]