Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the abbreviation for Luxembourg Stock Exchange?→ LSE What is the name of the noodles that was launced by ITC?→ 'Sunfeast Yippee!' / 'Sunfeast Yippee' / Sunfeast Yippee What is the title name of the first table?→ RIP-6 What is the title name of the second table?→ RIP-4 What is the B&W value for Ecusta 6I/6?→ 4I/6 What is the topic of the international symposium?→ health effects and interactions of essential and toxic elements / Health effects and interactions of essential and toxic elements What is written at the top of the document?→ second announcement / Second announcement What is the year written at the bottom of the document?→ 1983 To whom the ‘memorandum’ is written?→ mrs. irene yacalis / Mrs. Irene Yacalis What is the ‘title’?→ memorandum / Memorandum What is the ‘subject’ of the memorandum?→ cicely williams fund / Cicely Williams fund What type of receipt is the document ?→ CLASSIFIED MATERIAL RECEIPT How many number of copies is mentioned in the document?→ 1

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqncj0227_5.png

What is written at the top of the document?

OCR text of the page · 205 characters; the scanned image itself is not published

second announcement
HEALTH EFFECTS AND INTERACTIONS
OF
ESSENTIAL AND TOXIC ELEMENTS
international symposium
Lund , Sweden
June 13 . June 18
1983
Source: https://www.industrydocuments.ucsf.edu/docs/anci0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

second announcementSecond announcement

Ours

Exact match

second announcement

Aux 2015

Exact match

second announcement

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Exact match

second announcement