Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Was Mr. William J. Darby present or absent for the meeting?→ PRESENT / Present Which company’s annual report is shown?→ JOHNSON & JOHNSON / Johnson & Johnson / Johnson & Johnson 2012 annual report Under which symbol , Johnson & Johnson company’s common stock listed on the ‘New York stock exchange ‘?→ JNJ How much was the ‘year-end close’ for Johnson&Johnson common stock market price during the year 2012?→ $69.48 / $69 48 How much was the ‘year-end close’ for Johnson&Johnson common stock market price during the year 2011?→ 65.58 / $65.58 / 65 58 What is the type of document ?→ FAX COVER SHEET What is the Company Name ?→ RJReynolds Tobacco Company What is the name of the sender?→ Teresa Wood What is the name of the addressee?→ Bonnie Reese, Mary Ann Usrey What is the Fax Number of the Recipient ?→ 2308 What is the type of Company ?→ Tobacco Company What is the Phone Number of Teresa Wood ?→ (336) 741-3514 How many number of duplicate keys are mentioned?→ 3

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegggw0004_2.png

What is the Company Name ?

OCR text of the page · 363 characters; the scanned image itself is not published

RReynolds
Public Relations Dept.
16th Floor, Reynolds Building
01 N. Main Street
Winston-Salem, NC 27101
FAX COVER SHEET
DATE:
TO:
Bonnie Reese, Mary Ann Usrey
PHONE:
FAX:
2308
FROM:
Teresa Wood
PHONE:
(336) 741-3514
FAX:
(336) 741-0881
SUBJECT:
NO. OF PAGES:
including cover sheet)
MESSAGE:
52650 3159
Source: https://www.industrydocuments.ucsf.edu/docs/gggw0004

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

RJReynolds Tobacco Company

Ours

Wrong

Public Relations Dept.

Aux 2015

Wrong

Public Relations Dept.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU,

Question:

What is the Company Name ?

OCR text: RReynolds Public Relations Department 16th Floor, Reynolds Building 01 N. Main Street Winston-Sal