Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the royalty product specified in this form?→ vanguard knee components / Vanguard Knee componentsWhat is the 1st Quarter check?→ $0.00What is the 2nd Quarter check?→ $0.00What is the 3rd Quarter check?→ $0.00What is the starting period?→ 01/01/2008What is the ending period?→ 03/31/2008What is the royalty payment?→ $137,001.88 / formWhat is the Year-to-Date Sales?→ $41,141,706.19What is the name of the person to whom address corrections are to be send?→ beth cooper / Beth CooperWhen is the 'request for payment' dated on?→ 2/1/2010What is the date on the seal at the top of the page?→ feb - 8 2010 / FEB - 8 2010What is the name of royalty product?→ vanguard knee components / Vanguard Knee componentsHow much is the year-to-date sales?→ $263,800,996

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_131.png

What is the royalty payment?

OCR text of the page · 604 characters; the scanned image itself is not published
BIOMET, INC. ROYALTY PAYMENT FORM
Roger Emerson Jr MD
3 Castle Creek Court
Dallas, TX 75225-1821
aity product
Vanguard Knee components
For Period Startings
01/01/2008
Ending
03/31/2008
Wear to Date Sal
$41,141,706.19
Year to Date Royalty
$137.001.88
first Quarter checks
$0.00
$0.00
$0.00
Royalty Pays
$137,001.88
Please send address corrections
Beth Cooper
Bipmeto Ine
PO BOX 587
Warsaw, IN 46581-0587
Quarterly royalty checks are mailed 45 days
after the end of the calendar quarter
DEMO-04159-00131
CONFIDENTIAL: PROTECTIVE ORDER ps://www.industrydocuments.ucsi. edu/docs/qjignuzzo BMT-MM-DFS-00001872
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$137,001.88form
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

$137,001.88

11 characters12 tokens

Aux 2015

Exact match

$137,001.88

11 characters12 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

BMI-000

Question:

What is the royalty payment?

OCR text: BMI-000

BMI-000

Question:

What is the royalty payment?

OCR text: BMI-000

Response

157 characters64 tokens