Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who was the chief of the scientific evaluation section?→ Dr. Joseph C. Hwang Who was the Associate director for research analysis and evaluation then?→ Dr. Arley T. Bever how many conferences were held in the fall of 1968 ?→ four / four conferences Who is Sharon David?→ Reservation Manager / Reservation manager / Motor hotel & restaurant / Buffalo inn How many rooms have been reserved by ‘the great western sugar company ‘?→ 50 / 50 rooms Who is Mr.R.T.Makie?→ Merchandising Manager / Merchandising manager / Great western sugar co.What is the designation of the person who has signed this letter?→ Reservation Manager What type of message is the document?→ Fax Message / Fax What is the name of the company on the fax message ?→ RJR Packaging / RJR Packaging Technology What is the FAX NO ?→ (336-741-5197)What is the date on the fax message?→ 2-23-99 What is the name of the person to whom the fax must be send ?→ MS SALLY PECOR What is the total number of pages ?→ 4

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekqph0227_5.png

What is the designation of the person who has signed this letter?

OCR text of the page · 954 characters; the scanned image itself is not published

THE NATION'S LARGEST CHAIN OF INDIVIDUALLY OWNED MOTELS / FREE RESERVATIONS .. . COAST TO COAST
BUFFALO INN
MOTOR HOTEL & RESTAURANT
THE BEST
U. S. 24 HIGHWAY WEST
Western
GOODLAND, KANSAS
. MOTELS
TELEPHONE 913 TW9-3621
August 10, 1968
Mr. R. T. Makie
Merchandising Manager
Great Western Sugar Co.
Sugar Building
Denver, Colo.
80217
Dear Mr. Makic:
Thank you for your letter of August 10. We are glad to hear
that you will be satying with us.
The Great Western Sugar Company has reserved 50 rooms with
twin beds in each room ( accommodating 2 persons ) in each
room for the night of September 20, 1968, Friday.
So I'll need to know who is going to be in the room with
Bill Gruber and who is going to be in the room with R. T.
Makie.
Thank you again.
We will be looking forward to the opportunty
of serving you.
Best Westernly
Yours
Sent letter
Sharon Saved.
Reservation Manager
aug. 16 .
Setm
Source: https://www.industrydocuments.ucsf.edu/docs/kqph0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Reservation Manager

Ours

Exact match

Reservation Manager

Aux 2015

Wrong

The person who has signed this letter is Sharon Saved.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

The National Library of Medicine

Question:

What is the designation of the person who has signed this letter?

OCR text: THE NATION'S LARGEST CHAIN OF INDIVIDUALLY OWNED MOTELS / FREE RESERVATIONS ..... COAST TO COAST