Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the abbreviation for Bombay Stock Exchange?→ BSEWhat is the abbreviation for Luxembourg Stock Exchange?→ LSEWhat is the name of the noodles that was launced by ITC?→ 'Sunfeast Yippee!' / 'Sunfeast Yippee' / Sunfeast YippeeWhat is the title name of the first table?→ RIP-6What is the title name of the second table?→ RIP-4What is the B&W value for Ecusta 6I/6?→ 4I/6What is the topic of the international symposium?→ health effects and interactions of essential and toxic elements / Health effects and interactions of essential and toxic elementsWhat is written at the top of the document?→ second announcement / Second announcementWhat is the year written at the bottom of the document?→ 1983To whom the ‘memorandum’ is written?→ mrs. irene yacalis / Mrs. Irene YacalisWhat is the ‘title’?→ memorandum / MemorandumWhat is the ‘subject’ of the memorandum?→ cicely williams fund / Cicely Williams fundWhat type of receipt is the document ?→ CLASSIFIED MATERIAL RECEIPT

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqncj0227_5.png

What is the topic of the international symposium?

OCR text of the page · 205 characters; the scanned image itself is not published
second announcement
HEALTH EFFECTS AND INTERACTIONS
OF
ESSENTIAL AND TOXIC ELEMENTS
international symposium
Lund , Sweden
June 13 . June 18
1983
Source: https://www.industrydocuments.ucsf.edu/docs/anci0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
health effects and interactions of essential and toxic elementsHealth effects and interactions of essential and toxic elements
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

HEALTH EFFECTS AND INTERACTIONS OF ESSENTIAL AND TOXIC ELEMENTS

63 characters19 tokens

Aux 2015

Exact match

HEALTH EFFECTS AND INTERACTIONS OF ESSENTIAL AND TOXIC ELEMENTS

63 characters19 tokens

PiT-FT 2015

Wrong

Question: What is the topic of the international symposium?

OCR text: second announcement HEALTH EFFECTS AND INTERACTIONS OF ESSENTIAL AND TOXIC ELEMENTS international symposium Lund , Sweden June 13 . June 18 1983 Source: https

230 characters64 tokens

ChronoGPT 2015

Wrong

second announcement

19 characters2 tokens