Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezrlp0227_6.png

What is the total number of days worked outside N.Y.?

OCR text of the page · 708 characters; the scanned image itself is not published
Days
Saturday
Worked
Sunday
DATE, 1975
Outside N. Y.
Vacation
Holiday
Location
Nature of Duties
March 1, 2
March 6
Washington , D. C.
Nutrition Foundation Office
March 7
Jacksonville, Fla.
Program in Nutrition & Clinical
Medicine
March 8, 9
2
March 10
Albuquerque, N.M.
Navajo Health Authority, Board
March 11
N
Omaha, Nebraska
Swanson Center for Nutrition
March 13 & 14
N
Washington, D. C.
CODEX Food Chemicals, NAS & NF
March 15 & 16
2
March 17 & 18
N
East Lansing , Mich.
Mich. Stat. U. "Risk/Benefit"
March 19 & 20
N
Washington , D. C.
Nat . Nutr . Consort . HMAC; NF
March 24 & 25
N
Washington, D. C.
NAS Sweeteners Forum; NF
March 26
Bethesda, Md.
NCI "Workshop" NIH
March 28
TOTAL
13
6
4/docs/zrin0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
13
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

TOTAL 13

8 characters5 tokens

Aux 2015

Exact match

13

2 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Exact match

13

2 characters1 tokens