Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgn0226_188.png

What is the date on the seal at the top of the page?

OCR text of the page · 696 characters; the scanned image itself is not published
Biomet Orthopedics, Inc.
RED - 8 2010
REQUEST FOR PAYMENT
PO Box 587
No.
BmTY/899- 01/09
Warsaw, IN 46581-0587
Date
2/4/2010
VENDOR:
Roger Emerson Jr. MD
3 Castle Creek Court
Dallas, TX 75225-1821
Account No.
Amount
05
2630
. . . . . . . . . .
. . .
414,391.19
Total
414,391.19
DESCRIPTION FOR REQUEST
Royalty product
Vanguard Knee components
For Period Starting:
1/1/2009
Ending:
12/31/2009
Year-to-Date Sales:
$263,800,996
Date to be Paid:
HOW2/12/2010
Approved By:
Dana Feldman
2/5/ 10
VENDOR
PAY DATE
04-Biomet
XXXXXXXX
013684
VOUCHER NUMBER
DISC. AMT/PERCENT
Contract #
402
DEMO-04159-00188
CONFIDENTIAL: PROTECTIVE ORDER ps://www.industrydocuments.ucsf.edu/docs/qjgn0226 BMT-MM-DFS-00001929
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
feb - 8 2010FEB - 8 2010
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.50

8 2010

6 characters7 tokens

Aux 2015

Wrong

2/4/2010

8 characters9 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text:

Biomet Orthopedics, Inc. Red - 8 2010

Instruction:

Question:

What is the date on the seal at the top of the page?

OCR text:

Biomet Orthopedics, Inc.

178 characters64 tokens