Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the royalty product shown in the form?→ Vanguard - E Poly / Vanguard E polyHow much is the year-to-date sales given in the form?→ $1,675,750.75How much is the royalty payment given in the form?→ $2,764.99What is the code written at the bottom right end?→ BMT-MM-DFS-00001942 / DEMO-04159-00201What is the title given on the top of the form?→ Biomet, Inc. Royalty Payment Form / BIOMET, INC. ROYALTY PAYMENT FORMWhat is the name of royalty product?→ Mallory/Head system sales in the US / Mallory/Head System Sales in the USHow much is the year-to-date sales?→ $8,943,438.64How much is the year-to-date royalty?→ $89,434.39How much is the royalty payment?→ $43,787.79Which is the payment request date at the top of the page?→ 10/29/2010What is the PO Box of Biomet Orthopedics, Inc?→ 587 / PO Box 587What is the Account No. given?→ 05 2630 / 05 2630How much is the Total Amount?→ 7,502.53

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_64.png

How much is the year-to-date sales?

OCR text of the page · 404 characters; the scanned image itself is not published
BIOMET, INC. ROYALTY PAYMENT FORM
Roger Emerson Jr MD
3 Castle Creek Court
S TX 75225-182
Malloryitlead System Sales In the US
01/01/2003
06/30/2003
843,438.64
Date
$89.434.39
$45,646.60
$0.00
$0.00
Payment
$43,787.79
isass send address corrections to
Grag Hartman
Bicnet, Inc.
302 587
DEMO-04159-00064
CONFIDENTIAL: PROTECTIVE ORDERttps://www.industrydocuments.ucsf.edu/docs/qjgn0226 BMT-MM-DFS-00001805
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$8,943,438.64
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

$89.434.39

10 characters11 tokens

Aux 2015

Wrong

$89.434.39

10 characters11 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Year-to-date sales

Question:

What is the year-to-date sales of the year?

Year-to-date sales

Question:

What is the year-to-date sales of the year?

165 characters64 tokens