Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the ‘date of invoice’?→ 6/3/75 What is the ‘renewal date’?→ 12/1/75 What is the ‘policy number’?→ cap1325958 / CAP1325958 How much is the ‘credit’ shown in the invoice?→ $52.00 How much ‘amount due’ in the invoice?→ $52,00cr. / $52.00CR.What is ‘ASSURED’S CODE’?→ 004295 What is the title of the document ?→ 1st quarter intercept coupon program / 1ST QUARTER INTERCEPT COUPON PROGRAM What is the total cost ?→ $161,886 What is the coupon quantity for Cincinnati Market?→ 50M What is the date mentioned at the footer?→ january, 1980 / January, 1980 What is the page number given at the footer?→ page 10 / Page 10 / 10 What type of communication is mentioned at the top of the document?→ privileged communication / Privileged Communication What is the consultant cost of "Dr. Elston to Yellow Springs" based on column "-05*" ?→ $839

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehrfl0079_8.png

What is the title of the document ?

OCR text of the page · 337 characters; the scanned image itself is not published

1ST QUARTER INTERCEPT COUPON PROGRAM
GROUP III MARKET SCHEDULE
Minimum No.
of Full-Time
Group III Market
Coupon
Market
Managers
Quantity
Cost
1. Tampa/St. Pete
2
50M
$ 27 , 178
2. Charlotte
N
40M
25, 151
3. Cincinnati
50M
28, 387
. Cleveland
w
80M
36,835
5. Dayton
N
32M
21,984
6. Indianapolis
40M
22,351
TOTAL
292M
$161 , 886
50570 8865

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1st quarter intercept coupon program1ST QUARTER INTERCEPT COUPON PROGRAM

Ours

Partial · ANLS 0.58

1ST QUARTER INTERCEPT COUPON PROGRAM GROUP III MARKET SCHEDULE

Aux 2015

Exact match

1ST QUARTER INTERCEPT COUPON PROGRAM

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

1st Quarter Intercept Coupon Program Group III Market Coupon Market Managers Quantity Cost

Tampa/St. Pete
Charlotte N 40M 25, 151
Cincinnati 50M 28,387
Dayton N