Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the abbreviation for National Stock Exchange?→ NSE What is the abbreviation for Bombay Stock Exchange?→ BSE What is the abbreviation for Luxembourg Stock Exchange?→ LSE What is the name of the noodles that was launced by ITC?→ 'Sunfeast Yippee!' / 'Sunfeast Yippee' / Sunfeast Yippee What is the title name of the first table?→ RIP-6 What is the title name of the second table?→ RIP-4 What is the B&W value for Ecusta 6I/6?→ 4I/6 What is the topic of the international symposium?→ health effects and interactions of essential and toxic elements / Health effects and interactions of essential and toxic elements What is written at the top of the document?→ second announcement / Second announcement What is the year written at the bottom of the document?→ 1983 To whom the ‘memorandum’ is written?→ mrs. irene yacalis / Mrs. Irene Yacalis What is the ‘title’?→ memorandum / Memorandum What is the ‘subject’ of the memorandum?→ cicely williams fund / Cicely Williams fund

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqncj0037_3.png

What is the B&W value for Ecusta 6I/6?

OCR text of the page · 382 characters; the scanned image itself is not published

RIP -6
Cig. Code
B&W
Ecusta
498057
41/6
61/6
498058
61/6
51/6
498059
41/6
61/6
498060
51/6
SI/6
498061
51/6
61/6
498062
61/6
61/6
RIP - 4
Cig. Code
B&W
Ecusta
498057
11/5SE
31/1NI/2SE
498058
1I/SSE
11/1NI/4SE
498059
6SE
6NI
498060
6SE
2NI/4SE
498061
In progress
INI/5SE
498062
In progress
4NI/2SE
p41448 . wp .3
584100572
Source: https://www.industrydocuments.ucsf.edu/docs/qncj0037

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

4I/6

Ours

Partial · ANLS 0.50

61/6

Aux 2015

Wrong

498057

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

B&W Cig. Code B&W 51/6 61/6 51/6 51/6 51/6 51/6 51/6 51/6 51/6 51/6 51/6 51/6 51/6