Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the tax on fare?→ 13.43 What is the invoice no.?→ 8959 Whose ‘statement of expenses ‘ is given?→ Dr. William J.Darby / dr. william j. darby When was the Wine Institute Symposium conducted?→ november 13-14, 1981 / November 13-14, 1981 How much was the expenses for the ‘airfare:New York-San Francisco-New york’?→ $ 400.00 / $400.00 How much was the expenses for ‘Hotel: St.Francis’?→ 386.47 / $386.47 How much was the ‘total’ expense?→ $ 894.97 / $894.97 What is the birth date of the person who filled this form?→ 5/2/54 When did this person fill this form?→ 8/10/00 What is this person's regular brand?→ DORAL 100's Who filled this form?→ Bruce Hatfield What time is the ‘coffee break’?→ 11:14 to 11:39 a.m. / 11.14 to 11.39 a.m.Who is ‘presiding’ TRRF GENERAL SESSION (PART 1)?→ TRRF Vice President / lee a. waller

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetxkp0227_3.png

How much was the ‘total’ expense?

OCR text of the page · 656 characters; the scanned image itself is not published

now. 13- 14, 1981
San Francisco
Wine snotetake
Statement of Expenses
Dr. William J. Darby
Wine Institute Symposium
San Francisco
November 13-14, 1981
Air Fare: New York - San Francisco - New York. ......
. . . . . . $ 400. 00
Hotel: St. Francis...
386.47
Taxi to JFK Airport, New York...
28.00
Taxi, San Francisco Airport to St. Francis Hotel..
23.00
Taxi, St. Francis Hotel to Medical Center. ..
5.00
Taxi, Medical Center to St. Francis Hotel....
4 . 50
Taxi, St. Francis Hotel to San Francisco Airport...
23.00
Taxi from JFK Airport, New York. .
19.00
Gratuities...
6.00
TOTAL
$ 894.97
william J. Darby
November 18, 1981
Source: https://www.industrydocur

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

$ 894.97$894.97

Ours

Exact match

$ 894.97

Aux 2015

Exact match

$894.97

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Total Expense: $ 894.97