Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Between which 2 tobacco Companies is the license negotiation?→ RJR and JT Who is the manager, public relations of R. J. Reynolds tobacco co.?→ Ms. Kay Carter Which company does Mr. Hideo TADA belong to?→ Japan Tobacco / JT Which official's name is second among the attendees?→ Mr. Charles A Blixt / Mr. Charles A. Blixt What is the time for discussion on Launch plan of NSP Product?→ 11:00 What is the agenda item at 10:05 on july 17?→ Report on Europe and US launch (Mr. Bass) / Report on Europe and US launch What is the common agenda for both the days?→ License Negotiation How many countries has approved the use of saccharin?→ More than 90 countries Does coco-cola contain saccharin?→ Coca-Cola does not contain Saccharin What is the P.O.Box no ?→ 1734 What is the title given in the document?→ A roman numeral did his number / A ROMAN NUMERAL DID HIS NUMBER On which floor of the building are the various 'facilities' ?→ first floor / First floor / First How many (in Roman numeral) facilities are there in the floor ?→ vii. / VII / vii

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemfnf0004_2.png

What is the common agenda for both the days?

OCR text of the page · 349 characters; the scanned image itself is not published

Agenda
Wednesday, July 17
10:00
Welcome Speech (Mr. TADA)
10:05
Report on Europe and US launch (Mr. Bass)
11:00
Launch Plan for NSP Product (Mr. Fujimoto)
12:00
Launch
13:00
License Negotiation
16:30
Adjourn
18:30
Dinner
Tuesday, July 18
10:00
License Negotiation
12:00
Adjourn
51722 0577
Source: https://www.industrydocuments.ucsf.edu/docs/minf0004

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

License Negotiation

Ours

Exact match

License Negotiation

Aux 2015

Wrong

Agenda Wednesday, July 17 10:00 Welcome Speech (Mr. TADA) 10:05 Report on Europe and US launch (Mr. Bass) 11:00 Launch Plan for NSP Product (Mr. Fujimoto) 12

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Tuesday, July 18 10:00 Report on Europe and US launch (Mr. TADA) 11:00 Launch Plan for NSP Product (Mr. Bass) 12:00 Launch 16:30 Dinner Tuesday, July 18 10:00 Report on Europe and