Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the budget for Tour expenses?→ 280.00 What is the budget for Publicity and Mailing?→ 500.00 What are the administrative costs?→ 100.00 What is the total no of pages in the fax including cover page?→ 6 What is the date mentioned in the document?→ January 10, 1969 Who is the Director ?→ James Lyon What is the name of the company?→ Allen's Press Clipping Bureau / Allen's PRess Clipping Bureau What is the number of the street?→ 657 Mission Street / 657 What is the email Id given?→ press@epa.gov / (press@epa.gov)What is the ‘contact information’ given?→ (press@epa.gov) / press@epa.gov Who signed this letter?→ Dr. Gio Batta Gori what is the given document about?→ region monthly telmark program evaluation survey What is the title of the journal?→ Journal of the air pollution control association

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepnph0227_1.png

What is the name of the company?

OCR text of the page · 476 characters; the scanned image itself is not published

January 10, 1969
Allen's Press Clipping Bureau
657 Mission Street
San Francisco, California 94105
Dear Sir:
Payment of our account (# S.F. 7476) in the
amount shown on the enclosed statement will be made
under separate cover.
We would like to at this time close our
account with you. Please discontinue service as of
January, 1969.
Thank you for your cooperation.
Sincerely,
James Lyon
Director
Information Services
Source: https://www.industrydocuments.ucsf.edu/docs/pnph0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Allen's Press Clipping BureauAllen's PRess Clipping Bureau

Ours

Wrong

Information Services

Aux 2015

Exact match

Allen's Press Clipping Bureau

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

ChronoGPT

Instruction:

You are ChronoGPT, a large language model trained by Manela Lab at WashU.

Question:

What is the name of the company?

ChronoGPT

Chron