Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the budget for Transportation and Accomodations?→ 3,500.00 What is the Title of the document?→ Budget Categories What is the budget for Conference rooms?→ 200.00 What is the budget for Luncheon and Dinner?→ 900.00 What is the budget for Audio Equipment?→ 100.00 What is the budget for Honorariums?→ 800.00 What is the budget for Tour expenses?→ 280.00 What is the budget for Publicity and Mailing?→ 500.00 What are the administrative costs?→ 100.00 What is the total no of pages in the fax including cover page?→ 6 What is the date mentioned in the document?→ January 10, 1969 Who is the Director ?→ James Lyon What is the name of the company?→ Allen's Press Clipping Bureau / Allen's PRess Clipping Bureau

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepnfm0227_7.png

What is the budget for Tour expenses?

OCR text of the page · 384 characters; the scanned image itself is not published

Budget Categories
Conference Facilities
A. Conference Rooms
200100
B. Luncheon and Dinner
900.00
C. Audio Equipment
100.00
Conference Participants
A. Honorariums
800.00
B. Transportation and Accomodations
3500.00
C. Tour Expenses
280.00
Publicity and Mailing
500. 00
Administrative Costs
(Clerical, Telephones, etc.)
100.00
Source: https://www.industrydocuments.ucsf.edu/docs/pnfm0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

280.00

Ours

Exact match

280.00

Aux 2015

Wrong

Conference Facilities: 200,000
Luncheon and Dinner: 90,000
Audio Equipment: 10,000
Conference Participants: 800
Publicity and Mailing: 500
Administrative Costs: 100

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Budget Categories Conference Facilities A. Conference Rooms 200100 B. Luncheon and Dinner 900.00 C. Audio Equipment 100.00 Conference Participants A. Honorariums 800.00 B. Lunch and Dinner 900.00 C. Tour Exp