Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the total?→ 1,830,55 / 1,830.55 what is the royalty product name ?→ Vanguard - E Poly / Vanguard- E Poly what is the year-to-date sales?→ $1,109,423 what is the contract# ?→ 402 What is the form given?→ Biomet, Inc. Royalty Payment Form / Biomet, inc. royalty payment form / Royalty Payment Form What is the royalty product shown in the form?→ Vanguard - E Poly / Vanguard E poly How much is the year-to-date sales given in the form?→ $1,675,750.75 How much is the royalty payment given in the form?→ $2,764.99 What is the code written at the bottom right end?→ BMT-MM-DFS-00001942 / DEMO-04159-00201 What is the title given on the top of the form?→ Biomet, Inc. Royalty Payment Form / BIOMET, INC. ROYALTY PAYMENT FORM What is the name of royalty product?→ Mallory/Head system sales in the US / Mallory/Head System Sales in the US How much is the year-to-date sales?→ $8,943,438.64 How much is the year-to-date royalty?→ $89,434.39

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_201.png

How much is the year-to-date sales given in the form?

OCR text of the page · 617 characters; the scanned image itself is not published

BIOMET, INC. ROYALTY PAYMENT FORM
Roger Emerson Jr MD
3 Castle Greek Court
Dallas, TX 75225-1821
Royalty pro
Vanguard - E Poly
Period
01/01/2009
Ending
03/31/2009
Yea
-Date Sales.
$1,675,750.75
Year to Date R
$2,764.99
ist Quarter check
$0.00
SHEOr check.
$0 00
ard Quart
$0.00
Royalty Payments
$2,764.99
Please send address corrections on Fora w-9
Dana Feldman
Biomet, Inc
PO BOX 587
IN 46581-0587
Warsaw, IN
Quarterly royalty checks are mailed 45 days
after the end of the calendar qu
gar quarter
DEMO-04159-00201
CONFIDENTIAL: PROTECTIVE ORDER tps://www.industrydocuments.ucsf.edu/docs/qjgn0226 BMT-MM-DFS-00001942

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

$1,675,750.75

Ours

Exact match

$1,675,750.75

Aux 2015

Wrong

$2,764.99

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Year to Date R $1,675,750.75 Year to Date Sales $2,764.99 Year to Date R $0 00

Year to Date Sales $1,675,750.75 Year to Date R $2,7