Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezmkp0227_7.png

What is the underlined text?

OCR text of the page · 576 characters; the scanned image itself is not published
8 Rober 13- 31, 1979
Australia
THE NUTRITION FOUNDATION, INC.
489 FIFTH AVENUE
. NEW YORK NY 10017
212 687.4830
Telex: 62258 (NUFOUN)
Case NUTRITION New York
Out-of-pocket Expenses
Australia
October 13-31, 1979
The following expenses should be reimbursed by the Foundation; all
other expenses in Australia will be reimbursed by USBA
Hotel :
Sydney Hilton, October 26-28, 1979.
$167.65
Hotel: Lakeside International, Canberra, October 28-30.
115.23
Taxi: Melbourne to Deakin University, October 26.
40.00
TOTAL
$ 322.88 (Australian $)
William J. Darby
December 19, 1979
Source:
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
OUT-OF-POCKET EXPENSESOut-of-pocket expenses
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

TOTAL $ 322.88 (Australian $)

29 characters15 tokens

Aux 2015

Wrong

The underlined text is:

"8 Rober 13- 31, 1979 Australia THE NUTRITION FOUNDATION, INC. 489 FIFTH AVENUE . NEW YORK NY 10017 212 6

130 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

8 Robert 13-31, 1979 Australia Hotel : Sydney Hilton, October 26-28, 1979 Hotel : Lakeside International, Canberra, October 28-30, 1979 Hotel : Sydney Hilton, October 26-28, 1979 Hotel : Lakeside International, Canberra, October 28-

232 characters64 tokens