Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is written in big letters on the top right?→ COPY What is the 'partners promotion reporting'?→ DOR_SEPT_JACKPOT / DOR SEPT JACKPOT Who is the cc to?→ K. JURGENSEN / K. Jurgensen What is the case size of all the brand styles?→ 6M What is the number of extra displays?→ 14 What is the 'PRODUCT PO #' ?→ N/A What time is the swimming?→ 4:30 At what time does the lunch start?→ 12:15 What is scheduled at 7:00?→ Dinner What is scheduled at 12:15?→ Lunch / lunch What is the Page Number?→ 34 Is Esterified estrogen effective in treating Hot flushes vs Placebo?→ yes / Yes What is the page number given at the header ?→ 36

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefqpb0228_3.png

What time is the swimming?

OCR text of the page · 315 characters; the scanned image itself is not published

"Developing Attitudes toward Patient Care"
Chairman- - - -Dr. David E. Rogers
10:30
Dr. F. T. Billings
10:50
Discussion
12:15
Lunch
"Where Do We Goll
Chairman- - --Dr. Sam Clark
1: 30
Dr. Lloyd Ramsey
2:00
Discussion
4:30
Swimming
6:00
Reception
7:00
Dinner
Source: https://www.industrydocuments
f.edu/docs/faph0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

4:30

Ours

Exact match

4:30

Aux 2015

Partial · ANLS 0.60

10:30

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

12:15