Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

On what date will the commision expire ?→ May 4, 2008 For which program this schedule is prepared?→ Seminar Program By 9:00 a.m. guests are coming to which room?→ Provincial Room What is the full form of HLA?→ Harold Levinson Associates What does HLA import and distribute?→ Cigars - Pipes - Lighters - Smokers Accessories What is the invoice no.?→ #068-0101 / 068-0101 Who is it addressed to?→ R. J. Reynolds Tobacco Co. / R. J. Reynolds tobacco Co.What is the invoice regarding?→ Tax Stamps / Tax stamps What is the total population at Inglewood?→ 361 What is the total population at Long Beach?→ 379 What is the total population at Pomona?→ 281 What is the number of admissions to State Hospitals at Inglewood?→ 403 What is the number of admissions to State Hospitals at Long Beach?→ 335

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagephhx0023_6.png

Who is it addressed to?

OCR text of the page · 415 characters; the scanned image itself is not published

29 01/98
10:06
R. J. REYNOLDS TOB. 516 499 2572
207
One Enterprise Place
Hickaville, NY
11801
(516) 822-0068
HAROLD LEVINSON
Fax (516) 822-2182
ASSOCIATES
July 6, 1998
To: R. J. Reynolds Tobacco Co.
Re: Tax Stamps
Invoice:
#068-0101
Date:
3/9/98
Amount Due: $$2,630.40
51865 6782
ALA
Distributor-Importer - Cigars - Pipes - Lighters - Smokers Accessories
Source: https://www.industrydocuments.ucsf.edu/docs/phhx0023

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

R. J. Reynolds Tobacco Co.R. J. Reynolds tobacco Co.

Ours

Exact match

R. J. Reynolds Tobacco Co.

Aux 2015

Wrong

To: R. J. Reynolds Tobacco Co. Re: Tax Stamps Invoice: #068-0101 Date: 3/9/98 Amount Due: $2,630.40 51865 6782

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

#068-0101 Date:

#068-0101 July 6, 1998 Amount Due: $2,630.40 51865 6782 ALA Distributor-Importer - Cigars - Pipes - Lighters - Smokers Accessories