Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekpnf0227_2.png

What is the designation of Thomas E Furia?

OCR text of the page · 270 characters; the scanned image itself is not published
CRC
Critical Reviews
TM
in
FOOD TECHNOLOGY
edited by:
Thomas E. Furia
Technical Development Manager
Geigy Industrial Chemicals
Division of Geigy Chemical Corp.
Ardsley, New York
1970 by The Chemical Rubber Co.
Source: https://www.industrydocuments.ucsf.edu/docs/kpnf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
technical development managerTechnical development manager
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Technical Development Manager

29 characters4 tokens

Aux 2015

Wrong

TCR

3 characters3 tokens

PiT-FT 2015

Wrong

Question: What is the designation of Thomas E Furia?

OCR text: CRC Critical Reviews TM in FOOD TECHNOLOGY edited by: Thomas E. Furia Technical Development Manager Geigy Industrial Chemicals Division of Geigy

209 characters64 tokens

ChronoGPT 2015

Wrong

ChronoGPT

Instruction:

You are ChronoGPT, a large language model trained by Manela Lab at WashU.

Question: What is the designation of ChronoGPT?

OCR text: CRC Critical Reviews TM in FO

191 characters64 tokens