Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepggl0226_23.png

What is the heading of the map?

OCR text of the page · 688 characters; the scanned image itself is not published
THE NATIONAL SUGAR REFINING COMPANY
COMPARISON OF BASIC HOURLY WAGE RATES FOR MALE
WORKERS AND COST OF LIVING IN VARIOUS SUGAR REFINING CENTERS
1941-2
Basic
Cost
Hourly
of
Rate
Living
Boston
$1, 472.
New York
7730
$1.553.
Philadelphia 684
$1, 383.
Baltimore
$1.384.
San Francisco
794 $1,514.
Savannah
39d - 42#
$1.369.
1942 New Orleans
1941 New Orleans
320 - 40#
$1. 323.
1942 Galveston
1941 Galveston
47 2#
$1. 339.*4
Cost of Living data from U. S. Bureau of Labor Statistics, as of June 15, 1941:
Basic hourly wage rates from various union contracts.
Actually, Jacksonville, Florida
45 Actually, Houston, Texas
March 26, 1942
Source: https://www.industrydocuments.ucsf.edu/docs/pgg10226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Comparison of basic hourly wage rates for male workers and cost of living in various sugar refining centersComparison of basic hourly wage rates for male workers and cost of living in various sugar Refining centers
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

COMPARISON OF BASIC HOURLY WAGE RATES FOR MALE WORKERS AND COST OF LIVING IN VARIOUS SUGAR REFINING CENTERS

107 characters35 tokens

Aux 2015

Wrong

The heading of the map is:

26 characters8 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Basic hourly wage rates from various union contracts.

53 characters9 tokens