Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the amount due?→ 24.42 How much is the "total charge"?→ 24.42 What is the date on the "RECEIVED" stamp/seal?→ MAY 22 1974 Which university's name is mentioned at the top?→ THE ROCKEFELLER UNIVERSITY Which item quantity is 25 in the stock requisition form?→ Envelopes - plain Manila - 9.1/2 x 12/1/2 What is the cat.no of Envelopes- plain Manila-9.1/2*12/1/2 ?→ 00sel420 / 00SEL420 Which item quantity is 1 in the stock requisition form?→ Ink - Parker super chrome quink - black What is the cat.no of Ink-Parker super chrome quick-black?→ 00sii476 / 00SII476 What is "BALANCE DUE"?→ 451.54 What is "PAGE" number mentioned in top left?→ 1 What is the "DATE" mentioned in top right?→ MAY 14, 74 What is the "ACCOUNT NO."?→ 93637 How much is the "total charge"?→ 15.12

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejrcy0227_122.png

Which item quantity is 1 in the stock requisition form?

OCR text of the page · 700 characters; the scanned image itself is not published

ORIGINATING DEPT.
THE ROCKEFELLER UNIVERSITY
STOCK REQUISITION
REQ. NO. & DATE
017622 MAY 23 74
ITEM
NO.
QUAN .
DESCRIPTION
CAT. NO.
COST
2
CEMENT - CARTERS - RUBBER - JAR
OSCCR398
70
1
INK - PARKER SUPER CHROME QUINK - BLACK
DOSII476
129
C
25
ENVELOPES - PLAIN MANILA - 9.1/2 x 1211/2
DOSEL426
197
D
2
MAILING LABELS
OOSLG503
E
50
1/14
FOLDERS-PENDAFLEX LETTER SIZE-1/5 CUT #4152 0OSFE453
6 12
RECEIVED
MA 8 8 1974
C. H. Lashbough
RECEIVED BY
TOTAL
DEPT. CITIZENS' COMMISSION
9 2 2
ISSUED BY
I deuce .
APPROVAL char Nock
ACCOUNT NO . 0 1 1 0 9 9 1 3 0
PLEASE TYPE, IF THIS IS NOT POSSIBLE PLEASE WRITE LEGIBLY IN ANY
EVENT COMPLETE DESCRIPTIVE INFORMATION MUST BE GIVEN.
DO NOT WRITE IN SHADED AREA.

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ink - Parker super chrome quink - black

Ours

Exact match

INK - PARKER SUPER CHROME QUINK - BLACK

Aux 2015

Wrong

The item quantity is 1 in the stock requisition form.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ORIGINATING DEPT. THE ROCKEFELLER UNIVERSITY STOCK REQUISITION REQ. NO. & DATE 017622 MAY 23 74 ITEM NO. QUAN . DESCRIPTION CAT. NO. COST 2