Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehgbl0037_4.png

what does the chart explain about?

OCR text of the page · 334 characters; the scanned image itself is not published
1R4F REFERENCE RESULTS
AVERAGE 1R4F RESPONSES PER S9 LOT
STRAIN TA100
2,000
REVERTANTS/MG TAR
1,500
1,000
500
AVERAGE RESULTS FOR $9 LOT 0329: 1159
AVERAGE RESULTS FOR $9 LOT 0349: 1137
O
6
11
16
21
26
31
36
NUMBER OF DAYS 1R4F TESTED
51003 0970
- S9 LOT 0329 + S9 LOT 0349
Source: https://www.industrydocuments.ucsf.edu/docs/hgbl0037
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
AVERAGE 1R4F RESPONSES PER S9 LOT STRAIN TA100
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.72

AVERAGE 1R4F RESPONSES PER S9 LOT

33 characters14 tokens

Aux 2015

Wrong

The chart explains that the average response per lot for the 1R4F test is 1,159, and the average results for the $9 lot 0329 are 1,159, while the $9 lot 0349 have an average of 1,

179 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

1R4F REFERENCE RESULTS AVERAGE 1R4F RESPONSES PER S9 LOT STRAIN TA100 2,000 REVERTANTS/MG TAR 1,500 1,000 500 AVERAGE RESULTS FOR $9 LOT 03

139 characters64 tokens