Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

In total how many pieces have been faxed?→ 1 Who has sent the fax?→ Fran Rhode / Fran Who is the letter to?→ Tim Who is the letter from?→ Craig What is enclosed with this letter ?→ The latest information we have on materials systems.On which company letterhead is this written?→ National Corporation for Housing Partnerships / National corporation for housing partnerships Who is the chairman?→ Carter L. Burgess Who is the supplier?→ LRW What is the name of the tobacco company?→ R. J. REYNOLDS TOBACCO COMPANY What is the accounting code for internal order?→ 907145-846500 What is the last date of receiving the application?→ May 17 Who has approved the application?→ Leonard T. Kurland / Leonard T. Kurland, M.D.What is the date of arrival?→ 6/19/76

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehnjh0227_3.png

Who is the chairman?

OCR text of the page · 565 characters; the scanned image itself is not published

Dec. 15, 1970
National Corporation for Housing Partnerships
1 133 Fifteenth Street, Northwest, Washington, D. C. 20005 Tel: (202) 466-8200
Near Tune.
Carter L. Burgess
Chairman
I am enclosing the latest information
George W. DeFranceaux
President
we have on Materials Systems . I shall let
you know when I get any additional information .
I trust you will be flashing down
The slopes over the holidays . I am sorry I
Shall not be able to join you , but I shall be
out there later this mister .
Best.
hang
Source: https://www.industrydocuments.ucsf.edu/docs/hnjh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Carter L. Burgess

Ours

Exact match

Carter L. Burgess

Aux 2015

Wrong

George W. DeFranceaux

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

I am a language model trained by Manela Lab at WashU.

Question:

Who is the chairman of the National Corporation for Housing Partnerships?

OCR text: Dec. 15, 1970 National Corporation for Housing Partnerships 1 133 Fifteenth Street, Northwest, Washington, D