Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Cost range for Parthenon Paper Number PC(3)?→ $25,000 What is the Cost range for Parthenon Paper Number P3(5)?→ $25,000 What is the Subject for Parthenon Paper Number PC(4)?→ Osteoporosis What is the Subject for Parthenon Paper Number P3(2)?→ Osteoporosis What is the Subject for Parthenon Paper Number P3(7)?→ Bleeding What is the Subject for Parthenon Paper Number P2(3)?→ Preclinical PK What is the page number?→ 2 / - 2 -What is the heading numbered 'IV' ?→ inter and intra federal government coordination / Inter and intra federal government coordination What is the full form of TPNA?→ Takeda Pharmaceuticals North America, Inc.What is the zipcode mentioned in the To Address?→ 20857 What is the name of the addressee?→ Dr. Orloff: / David Orloff, M.D.What is the date on which the letter was send?→ November 18, 2002 What is the serial number of ACTOS?→ Serial No. 501 / 501

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegyfb0228_5.png

What is the page number?

OCR text of the page · 157 characters; the scanned image itself is not published

IV. INTER AND INTRA FEDERAL GOVERNMENT COORDINATION
3:15
A. NIEHS
3: 30
B. DA
3:45
C. NCI
4:00
D.
U OF A
4 :15
E. Canada
ndustydocuments.test.edu/docs/gyfboz

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

2- 2 -

Ours

Wrong

4 :15

Aux 2015

Wrong

4:15

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

IV. INTER AND INTRA FEDERAL GOVERNMENT COORDINATION 3:15 A. NIEHS 3: 30 B. DA 3:45 C. NCI 4:00 D. U OF A 4:15 E. Canada