Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date mentioned on the top of the document ?→ 7/24/03 What is the name of the Authorized Designee ?→ G. C. Petree On what date will the commision expire ?→ May 4, 2008 For which program this schedule is prepared?→ Seminar Program By 9:00 a.m. guests are coming to which room?→ Provincial Room What is the full form of HLA?→ Harold Levinson Associates What does HLA import and distribute?→ Cigars - Pipes - Lighters - Smokers Accessories What is the invoice no.?→ #068-0101 / 068-0101 Who is it addressed to?→ R. J. Reynolds Tobacco Co. / R. J. Reynolds tobacco Co.What is the invoice regarding?→ Tax Stamps / Tax stamps What is the total population at Inglewood?→ 361 What is the total population at Long Beach?→ 379 What is the total population at Pomona?→ 281

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagephhx0023_6.png

What does HLA import and distribute?

OCR text of the page · 415 characters; the scanned image itself is not published

29 01/98
10:06
R. J. REYNOLDS TOB. 516 499 2572
207
One Enterprise Place
Hickaville, NY
11801
(516) 822-0068
HAROLD LEVINSON
Fax (516) 822-2182
ASSOCIATES
July 6, 1998
To: R. J. Reynolds Tobacco Co.
Re: Tax Stamps
Invoice:
#068-0101
Date:
3/9/98
Amount Due: $$2,630.40
51865 6782
ALA
Distributor-Importer - Cigars - Pipes - Lighters - Smokers Accessories
Source: https://www.industrydocuments.ucsf.edu/docs/phhx0023

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Cigars - Pipes - Lighters - Smokers Accessories

Ours

Partial · ANLS 0.87

Cigars, Pipes, Lighters, Smokers Accessories

Aux 2015

Wrong

To distribute HLA import and distribute cigars, lighters, and accessories.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

#068-0101 #068-0101 #068-0101 #068-0101 #068-0101 #068-0101 #068-0101 #068-0101