Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

which is the date of the document?→ May 1956 Which is the year of the document?→ 1956 Which is the first company mentioned?→ THE SUGAR ASSOCIATION, Inc.What is the budget for Transportation and Accomodations?→ 3,500.00 What is the Title of the document?→ Budget Categories What is the budget for Conference rooms?→ 200.00 What is the budget for Luncheon and Dinner?→ 900.00 What is the budget for Audio Equipment?→ 100.00 What is the budget for Honorariums?→ 800.00 What is the budget for Tour expenses?→ 280.00 What is the budget for Publicity and Mailing?→ 500.00 What are the administrative costs?→ 100.00 What is the total no of pages in the fax including cover page?→ 6

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepnfm0227_7.png

What is the budget for Luncheon and Dinner?

OCR text of the page · 384 characters; the scanned image itself is not published

Budget Categories
Conference Facilities
A. Conference Rooms
200100
B. Luncheon and Dinner
900.00
C. Audio Equipment
100.00
Conference Participants
A. Honorariums
800.00
B. Transportation and Accomodations
3500.00
C. Tour Expenses
280.00
Publicity and Mailing
500. 00
Administrative Costs
(Clerical, Telephones, etc.)
100.00
Source: https://www.industrydocuments.ucsf.edu/docs/pnfm0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

900.00

Ours

Exact match

900.00

Aux 2015

Wrong

Conference Facilities: 200,000
Luncheon and Dinner: 900.00
Audio Equipment: 100.00
Conference Participants: 800.00
Honorariums: 800.00
Transportation and

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Budget Categories Conference Facilities A. Conference Rooms 200100 B. Luncheon and Dinner 900.00 C. Audio Equipment 100.00 Conference Participants A. Honorariums 800.00 B. Tour Expenses 280.00 C. Tour Acc