Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezmkp0227_7.png

What is the currency?

OCR text of the page · 576 characters; the scanned image itself is not published
8 Rober 13- 31, 1979
Australia
THE NUTRITION FOUNDATION, INC.
489 FIFTH AVENUE
. NEW YORK NY 10017
212 687.4830
Telex: 62258 (NUFOUN)
Case NUTRITION New York
Out-of-pocket Expenses
Australia
October 13-31, 1979
The following expenses should be reimbursed by the Foundation; all
other expenses in Australia will be reimbursed by USBA
Hotel :
Sydney Hilton, October 26-28, 1979.
$167.65
Hotel: Lakeside International, Canberra, October 28-30.
115.23
Taxi: Melbourne to Deakin University, October 26.
40.00
TOTAL
$ 322.88 (Australian $)
William J. Darby
December 19, 1979
Source:
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
AUSTRALIAN $Australian $
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Australian $

12 characters3 tokens

Aux 2015

Wrong

The Foundation reimburses expenses in Australia, including hotel, taxi, and out-of-pocket expenses. The total amount reimbursed is $322.88 (Australian $).

154 characters37 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

The foundation is a non-profit organization that provides financial assistance to individuals and organizations in need.

Case NUTRITION New York

Hotel: Lakeside International, Canberra, October 26-30.

Taxi: Melbourne to Deakin University, October 26-30.

Total:

264 characters64 tokens