Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_74.png

How much is 'Year-to-Date Sales'?

OCR text of the page · 667 characters; the scanned image itself is not published
Biomet Orthopedics, Inc.
REQUEST FOR PAYMENT
PO Box 587
No.
BMT4899-0310-2
Warsaw, IN 46581-0587
Date
10/29/2010-
VENDOR:
Roger Emerson Jr. MD
3 Castle Creek Court
"KOV - 5 2010
Dallas, TX 75225-1821
Account No.
Amount
05 2630
. . . . . .
7,502.53
ACH
Total
7,502.53
DESCRIPTION FOR REQUEST
Royalty product:
Vanguard - E1
For Period Starting:
1/1/2010
Ending:
9/30/2010
Year-to-Date Sales:
$13,519,151 ,
Date to be Paid:
1/12/2010
Approved By:
Dana Feldman
VENDOR
PAY DATE
04-Biomet
XXXXXXXX
013684
VOUCHER NUMBER
DISC. AMT/PERCENT
Contract #
402.2
DEMO-04159-00074
CONFIDENTIAL: PROTECTIVE ORDER tps://www.industrydocuments.ucsf.edu/docs/qjgn0226 BMT-MM-DFS-00001815
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$13,519,15113,519,151
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

$13,519,151

11 characters12 tokens

Aux 2015

Exact match

$13,519,151

11 characters12 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCTOBER-DECEMBER, 2010

OCTOBER-DECEMBER, 2010

OCTOBER-DECEMBER, 2010

OCTOBER-DECEMBER, 2010

OCTOBER-DECEMBER, 2010

OCTOBER-DECEMBER, 2010

142 characters64 tokens