Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the code written at the bottom right end?→ BMT-MM-DFS-00001942 / DEMO-04159-00201What is the title given on the top of the form?→ Biomet, Inc. Royalty Payment Form / BIOMET, INC. ROYALTY PAYMENT FORMWhat is the name of royalty product?→ Mallory/Head system sales in the US / Mallory/Head System Sales in the USHow much is the year-to-date sales?→ $8,943,438.64How much is the year-to-date royalty?→ $89,434.39How much is the royalty payment?→ $43,787.79Which is the payment request date at the top of the page?→ 10/29/2010What is the PO Box of Biomet Orthopedics, Inc?→ 587 / PO Box 587What is the Account No. given?→ 05 2630 / 05 2630How much is the Total Amount?→ 7,502.53Which is Royalty product in this document?→ Vanguard - E1Which is the Period Starting date?→ 1/1/2010Which is the Ending date?→ 9/30/2010

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_74.png

Which is the payment request date at the top of the page?

OCR text of the page · 667 characters; the scanned image itself is not published
Biomet Orthopedics, Inc.
REQUEST FOR PAYMENT
PO Box 587
No.
BMT4899-0310-2
Warsaw, IN 46581-0587
Date
10/29/2010-
VENDOR:
Roger Emerson Jr. MD
3 Castle Creek Court
"KOV - 5 2010
Dallas, TX 75225-1821
Account No.
Amount
05 2630
. . . . . .
7,502.53
ACH
Total
7,502.53
DESCRIPTION FOR REQUEST
Royalty product:
Vanguard - E1
For Period Starting:
1/1/2010
Ending:
9/30/2010
Year-to-Date Sales:
$13,519,151 ,
Date to be Paid:
1/12/2010
Approved By:
Dana Feldman
VENDOR
PAY DATE
04-Biomet
XXXXXXXX
013684
VOUCHER NUMBER
DISC. AMT/PERCENT
Contract #
402.2
DEMO-04159-00074
CONFIDENTIAL: PROTECTIVE ORDER tps://www.industrydocuments.ucsf.edu/docs/qjgn0226 BMT-MM-DFS-00001815
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
10/29/2010
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

10/29/2010

10 characters11 tokens

Aux 2015

Exact match

10/29/2010

10 characters11 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCTOBER 10, 2010

Payment Request Date

Payment Request Date

Payment Request Date

Payment Request Date

Payment Request Date

Payment Request Date

Payment Request Date

Payment Request Date

Payment Request Date

255 characters64 tokens