Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefgbd0079_7.png

What should be done prior to B-3?

OCR text of the page · 278 characters; the scanned image itself is not published
SENT BY:RJ REYNOLDS TOB. CO. ; 8- 8-94 : 15:26 :PT&D MECH & INST DEV-
9197410918;# 7
.. . . .
.. . . .
CSF Run Sheet
Date:
7.28-94
PD. 5760 C
CSF- 72/
Run Nos.
1934 - 1943
Net Pounds Infeed: 584
Net Pounds Out:_2/87
83.4%
SEPARAT BINDER HYDRATION IN PULP PRIOR TO B-3
51441 8654
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
separate binder hydration in pulpSeparate Binder Hydration in pulp
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.97

SEPARAT BINDER HYDRATION IN PULP

32 characters13 tokens

Aux 2015

Wrong

CSF Run Sheet Date: 7.28-94 PD. 5760 C CSF- 72/ Run Nos. 1934 - 1943 Net Pounds Infeed: 584 Net Pounds Out:_

108 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

SENT BY:RJ REYNOLDS TOB. CO. ; 8-8-94 : 15:26 :PT&D MECH & INST DEV- 9197410918;# 7 ... . . . ... . . . CSF Run Sheet Date: 7

125 characters64 tokens