Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehxxj0037_3.png

What is the first person name marked in CC:

OCR text of the page · 1,034 characters; the scanned image itself is not published
3
. ASSISTANCE OUTSIDE DEVELOPMENT
A. Received the the complete data for the second interlaboratory study of monitor I-13.
The initial analysis has been completed and a preliminary memo issued giving
targets and control chart values of the composite results and for individual labs. The
other statistical analyses have also been completed and a report is being drafted.
(Jones)
B.
Started analysis of data for the I-13 monitor calibration on CO, NO, HCN and
RCHO gas phase analysis. (Jones)
III. OTHER
A. Serving on the R&D BOB Committee and Trivia Questionnaire subcommittee.
(Johnston)
B. Provided miscellaneous statistical, economic, demographic, socio-economic, and
product use information and consultations. (Jones, Martin, Ryan, Johnston)
D.
Visited VCU to interview candidates for a Summer Intern position working on the
consumer expenditure data. (Jones)
MEJ:f
cc: Page Callaham
Dick Jones
Yann LeGauffey
Peggy Martin
Frank Ryan
John Tindall
Central File
2022156015
Source: https://www.industrydocuments.ucsf.edu/docs/hxxj0037
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Page Callaham
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Page Callaham

13 characters5 tokens

Aux 2015

Wrong

John Tindall

12 characters5 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

OCR text: 3 . ASSISTANCE OUTSIDE DEVELOPMENT A. Received the complete data for the second interlaboratory study of monitor I-13. The initial analysis has been completed and a preliminary memo issued giving targets and control chart values of the composite results

263 characters64 tokens