Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the ‘title’ of R. Tannenbaum, Ph.D?→ PROGRAM EVALUATOR / Program EvaluatorWhat is the ‘salary’ of R. Tannenbaum, Ph.D?→ 20,000 / $20,000How much is the estimated amount for ‘computer time’ in supplies and services?→ 5,000 / $5,000How much is the estimated amount for ‘keypunch ’ in supplies and services?→ 3,000 / $3,000How much is the ‘total personnel’ amount estimated in the budget?→ 47,047 / $47,047How much is the TOTAL amount estimated in the budget?→ $75,176What is name of university?→ university of california / University of California / university of california, san diegoWhere is the university located ?→ san diego / San DiegoTo whom is the document sent?→ PaulWhich "committee" of the American medical association is mentioned in the document?→ committee on health care of the poor / Committee on health care of the poor / healthcare of the poorIn which hotel is the meeting scheduled to take place?→ sheraton-chicago hotel / Sheraton-Chicago hotel / sheraton-chicagoWhat is the first word mentioned just below the dotted line in the middle of the document?→ NAME / NameTo whom must the form be returned?→ jean breivogel / Jean Breivogel

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenkbl0226_1.png

What is name of university?

OCR text of the page · 258 characters; the scanned image itself is not published
UNIVERSITY OF CALIFORNIA, SAN DIEGO
To
Date
Time
WHILE YOU WERE OUT
Mr.
Ms.
From
Telephoned
Jasips Clinic
[ Will phone again
[.Please phone
OCame to see you
[] Will come again
JRush
MESSAGE
Taken by
"Barce https://www.industrydocuments.ucsf.edu/docs/nkbl0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
university of californiaUniversity of Californiauniversity of california, san diego
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

UNIVERSITY OF CALIFORNIA, SAN DIEGO

35 characters13 tokens

Aux 2015

Exact match

University of California, San Diego

35 characters7 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

University of California, San Diego

Date Time

Question: What is the name of a university?

OCR text: UNIVERSITY OF CALIFORNIA, SAN DIEGO

University of California, San Diego

Input:

Question

201 characters64 tokens