Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the Secretary?→ Mrs. Mary Ripley Who is the executive vice president?→ William W. Moore who were stationed in the store to answer questions from the shoppers?→ dietitians What is the main heading of document ?→ BRAND IDENTITY TASK FORCE TIMING What is the extension number of Lee-Ann Brewer ?→ ext. 7413 / 7413 When is the final 1998 Camel Plan Presentation to RJR Execs?→ August 26-27 What are the dates written near L.A.?→ 4-5-6 What is the Duration (cycles) for Study Number Phase II "2002"?→ 6/7 What is the Duration (cycles) for Study Number Phase II "2001"?→ 3 What is the Duration (cycles) for Study Number Phase II "2003"?→ 6/7 What is the Duration (cycles) for Study Number Phase III "3001"?→ 13/26 What is the Duration (cycles) for Study Number Phase III "3003"?→ 13 What is the Duration (cycles) for Study Number Phase III "300400"?→ 6/7

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexlwc0228_3.png

What are the dates written near L.A.?

OCR text of the page · 134 characters; the scanned image itself is not published

Kennedy
pages mays
.5. 1-2 Aug
LA : 4- 5 - L
NY . -
Source:
1 20, Avenue do la helcate
it de Technologie Whimending
DR. Zoulian Kollal

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

4-5-6

Ours

Wrong

pages mays .5. 1-2 Aug

Aux 2015

Wrong

Kennedy (pages mays, 5.1-2 Aug) - LA (4-5 - L) - NY (1 20, Avenue do la helcate) - Whimending (DR. Zoulian Kollal)

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

1-2 Aug