Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_102.png

What is the starting period referred in the form?

OCR text of the page · 546 characters; the scanned image itself is not published
BIOMET, INC. ROYALTY PAYMENT FORM
Roger Emerson Jr, MD
3 Castle Creek Court
Dallas, TX, 75225-1821
Poraity products
Vanguard knee components
Period starting
91/01/2006
Endings
19/30/2006
ase-to-Date
$82,401,844.71
274 398.14
88,007.03
91.969.85
$0.00
$94.421.26
non gand pedroes corrections
Greg Har than
Biomat, The
PO Box 597
WASsaw, IN 16591 0587
Quarterly royalty checks are mail
the and of the calon
1 194 45 days
DEMO-04159-00102
CONFIDENTIAL: PROTECTIVE ORDER
Source: https://www.industrydocuments.ucsf.edu/docs/qjgn0226BMT-MM-DFS-00001843
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
01/01/2006
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.90

91/01/2006

10 characters11 tokens

Aux 2015

Wrong

BIOMET, INC. ROYALTY PAYMENT FORM

Roger Emerson Jr, MD 3 Castle Creek Court Dallas, TX, 75225-1821 Poraity products Vanguard knee components Period starting 91/01/2006

169 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCTOBER, 2006

OCTOBER, 2006

OCTOBER, 2006

OCTOBER, 2006

OCTOBER, 2006

Input:

OCTOBER, 2006

101 characters64 tokens