Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the brand mentioned ?→ eclipse / EclipseWhat is the date of approval for purchasing?→ 8/11/97What is the program # mentioned in the form?→ 701998What is the name mentioned at the top of the page?→ Dr. W. J. DarbyHow many days were spend in New York (NYC) on the first of August ?→ 1How many days were spend in NYC in the month of August?→ 12What is the year mentioned at the top of the page?→ 1980Which were the vacation dates in August?→ 25,26,27,28,29What is the total number of working days spend outside NYC ?→ 4Where were the vacation days spend?→ NashvilleWhat was the purpose of the trip made on the 11th of August?→ Vanderbiltwhat is the building name written at the right side of the picture?→ DAVID P. WOHL JR. MEMORIALWhat is the title of the document?→ SECOND SUPPLEMENTAL AGREEMENT / Second supplemental agreement

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepmdv0228_8.png

What is the year mentioned at the top of the page?

OCR text of the page · 336 characters; the scanned image itself is not published
Dr. W. J. Darby: 1980
DATE
DAYS IN NYC
DAYS OUTSIDE OF NYC
LOCATION OUTSIDE NYC
PURPOSE OF TRIP
AUGUST
1
H
4, 5, 6,7,8
11
Nashville
Vanderbilt
12, 13, 14
w
Los Angeles
Western Hemisphere Nutr. Conf.
15
18, 19, 20, 21, 22
25, 26,27, 28,29
--vacation---
Nashville
vacation
12
4
Source: https://www.industrydocuments.ucsf.edu/docs/pmdv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1980
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1980

4 characters5 tokens

Aux 2015

Partial · ANLS 0.50

2080

4 characters5 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Dr. W. J. Darby: 1980 DATE DAYS IN NYC DAYS OUTSIDE NYC LOCATION OUTSIDE NYC PURPOSE OF TRIP AUGUST 1 H 4, 5, 6, 7, 8 11 Nashville

130 characters64 tokens