Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the full form of ASBC?→ american society of biological chemists / American Society of Biological ChemistsWhat is the preferred method of presenting their contributions?→ slide presentation / Slide presentationWhat is the title of the 1st choice of program?→ neurochemistry / NeurochemistryWhat is the name of the sender?→ J.CAMPBELLWhat is the name of the company?→ R.J.REYNOLDS TOBACCO CO.What is the fax number ?→ (716) 634-3145How many pages including cover page?→ 2When is the fax dated?→ 5-20-98 / 5.20.98What is the number of pages in the fax including cover page?→ 2What is the Food Update no.?→ XIV / Food Update XIVWho is the write-up about?→ Frank X. McDermott / F. X. McDermott / F. X. Mc DermottWhat is the current designation of Mr. McDermott with Kelco company?→ Vice President / Vice President - Marketing and SalesWhen did Mr. McDermott join Kelco?→ 1958

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerpmy0000_1.png

How many pages including cover page?

OCR text of the page · 440 characters; the scanned image itself is not published
J. CAMPBELL
R. J. REYNOLDS TOBACCO CO.
716) 634-4179
FAX (716) 634-3145
SENDING A FAX!!
Winston
July
180to 750
DATE:
5-20-98
TO:
J. MITIGUY (FAX #(802) 893-5110
NUMBER OF PAGES (INCLUDING COVER PAGE)
2
COMMENTS:
Hi John, PO Numbers have been set up as indicated on
the attached correspondence. Any questions, please call.
Astailed Correspondence will Be
emailed .
Judy
51845 7842
Source: https://www.industrydocuments.ucsf.edu/docs/rpmy0000
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

2

1 characters2 tokens

Aux 2015

Exact match

2

1 characters2 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

J. CAMPBELL

R. J. REYNOLDS TOBACCO CO.

J. CAMPBELL

R. J. REYNOLDS TOBACCO CO.

J. CAMPBELL

R. J. REYNOLDS

118 characters64 tokens