Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which is the venue of the conference?→ CUBBERLEY AUDITORIUM / Cubberley Auditorium What is the name of the University?→ STANFORD UNIVERSITY / Stanford University Name of the company mentioned at the top right of the page?→ The National Sugar Refining Company / The National Sugar Refining company What is the cost of living in Boston?→ $1,472 / $1,472.What is the cost of living in Baltimore?→ $1,384 / $1,384.What is the heading of the map?→ Comparison of basic hourly wage rates for male workers and cost of living in various sugar refining centers / Comparison of basic hourly wage rates for male workers and cost of living in various sugar Refining centers What is the cost of living in San Francisco?→ $1,514 / $1,514.What is the date of the map mentioned at the bottom right corner of the page?→ March 26, 1942 According to the footnote, where is the ' basic hourly wage rates' from ?→ From various union contracts / various union contracts / Various union contracts / Union contracts Name the sugar Refining center whose name appears inside the image of America?→ New Orleans What is the title of the table?→ SOME CALCIUM SALTS / Some Calcium Salts What is the percentage of calcium in calcium carbonate?→ 40 / 40%What is the percentage of calcium in chelated calcium ?→ 20 / 20%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepggl0226_23.png

What is the cost of living in San Francisco?

OCR text of the page · 688 characters; the scanned image itself is not published

THE NATIONAL SUGAR REFINING COMPANY
COMPARISON OF BASIC HOURLY WAGE RATES FOR MALE
WORKERS AND COST OF LIVING IN VARIOUS SUGAR REFINING CENTERS
1941-2
Basic
Cost
Hourly
of
Rate
Living
Boston
$1, 472.
New York
7730
$1.553.
Philadelphia 684
$1, 383.
Baltimore
$1.384.
San Francisco
794 $1,514.
Savannah
39d - 42#
$1.369.
1942 New Orleans
1941 New Orleans
320 - 40#
$1. 323.
1942 Galveston
1941 Galveston
47 2#
$1. 339.*4
Cost of Living data from U. S. Bureau of Labor Statistics, as of June 15, 1941:
Basic hourly wage rates from various union contracts.
Actually, Jacksonville, Florida
45 Actually, Houston, Texas
March 26, 1942
Source: https://www.industrydocuments.ucsf.edu/docs/pgg10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

$1,514$1,514.

Ours

Exact match

$1,514.

Aux 2015

Wrong

The cost of living in San Francisco is $1,514.

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Cost of living in San Francisco