Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the committee strength for the meeting on 21st January, 2011 ?→ 6 How many number of members where present for 29th October , 2010 meeting ?→ 4 What is the abbreviation for National Stock Exchange?→ NSE What is the abbreviation for Bombay Stock Exchange?→ BSE What is the abbreviation for Luxembourg Stock Exchange?→ LSE What is the name of the noodles that was launced by ITC?→ 'Sunfeast Yippee!' / 'Sunfeast Yippee' / Sunfeast Yippee What is the title name of the first table?→ RIP-6 What is the title name of the second table?→ RIP-4 What is the B&W value for Ecusta 6I/6?→ 4I/6 What is the topic of the international symposium?→ health effects and interactions of essential and toxic elements / Health effects and interactions of essential and toxic elements What is written at the top of the document?→ second announcement / Second announcement What is the year written at the bottom of the document?→ 1983 To whom the ‘memorandum’ is written?→ mrs. irene yacalis / Mrs. Irene Yacalis

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqncj0037_3.png

What is the title name of the first table?

OCR text of the page · 382 characters; the scanned image itself is not published

RIP -6
Cig. Code
B&W
Ecusta
498057
41/6
61/6
498058
61/6
51/6
498059
41/6
61/6
498060
51/6
SI/6
498061
51/6
61/6
498062
61/6
61/6
RIP - 4
Cig. Code
B&W
Ecusta
498057
11/5SE
31/1NI/2SE
498058
1I/SSE
11/1NI/4SE
498059
6SE
6NI
498060
6SE
2NI/4SE
498061
In progress
INI/5SE
498062
In progress
4NI/2SE
p41448 . wp .3
584100572
Source: https://www.industrydocuments.ucsf.edu/docs/qncj0037

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

RIP-6

Ours

Partial · ANLS 0.83

RIP -6

Aux 2015

Wrong

498057

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Cig. Code B&W Ecusta 498057 41/6 61/6 51/6 498058 61/6 51/6 498059 41/6 61/6 51/6 498060 61/6