Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_188.png

When is the date to be paid?

OCR text of the page · 696 characters; the scanned image itself is not published
Biomet Orthopedics, Inc.
RED - 8 2010
REQUEST FOR PAYMENT
PO Box 587
No.
BmTY/899- 01/09
Warsaw, IN 46581-0587
Date
2/4/2010
VENDOR:
Roger Emerson Jr. MD
3 Castle Creek Court
Dallas, TX 75225-1821
Account No.
Amount
05
2630
. . . . . . . . . .
. . .
414,391.19
Total
414,391.19
DESCRIPTION FOR REQUEST
Royalty product
Vanguard Knee components
For Period Starting:
1/1/2009
Ending:
12/31/2009
Year-to-Date Sales:
$263,800,996
Date to be Paid:
HOW2/12/2010
Approved By:
Dana Feldman
2/5/ 10
VENDOR
PAY DATE
04-Biomet
XXXXXXXX
013684
VOUCHER NUMBER
DISC. AMT/PERCENT
Contract #
402
DEMO-04159-00188
CONFIDENTIAL: PROTECTIVE ORDER ps://www.industrydocuments.ucsf.edu/docs/qjgn0226 BMT-MM-DFS-00001929
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2/12/2010
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.90

02/12/2010

10 characters11 tokens

Aux 2015

Partial · ANLS 0.78

2/4/2010

8 characters9 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text:

Biomet Orthopedics, Inc. RED - 8 2010 REQUEST FOR PAYMENT PO Box 587 No. BmTY/899-01/09 Warsaw, IN 46581-0587 Date 2/4/2010 VEND

142 characters64 tokens