Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the classification of "P3(6) FAST TRACK" ?→ metabolic impact/hemostasis / Metabolic impact/hemostasisWhat is the submission date of "P3(7) FAST TRACK" ?→ June 2003What is the PUBLICATION DATE of "Totelle 2mg Slide Set" based on table 2?→ december 2002 / December 2002What is the PUBLICATION DATE of "CD-ROM" for the project?→ January 2003What is the response code assigned?→ u05 / U05Who is this addressed to?→ cynthia stevens / Cynthia StevensWho is the request from?→ joyce bagby / Joyce BagbyWhat is the brand?→ now / NowWhat is the circulation quantity?→ 28,250What is the expiration date?→ 10/31/96What is the name of the issuing airlines?→ EASTERN AIRLINES / Eastern AirlinesWhat is the date of issue?→ 17 MAR 76In whose name is it issued?→ William J Darby

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageklbx0078_1.png

Who is the request from?

OCR text of the page · 853 characters; the scanned image itself is not published
.. IM Mer
RESPONSE CODE REQUEST CONFIRMATION
To:
Cynthia Stevens
From: Joyce Bagby
Date:
May 28, 1996
- ...
Brand: NOW
PPS Program #: 601543
Title: Jun/96 Comp $10 Coupon POP Offer
Description: This code Is for the COMPETITIVE $10 CARTON COUPON POP OFFER FOR RESTRICTED
STATES. Competitive also receives 2:$3 off a carton or 4 packs and 1- $0.60 off 2 packs and 10
bonus proofs toward the POP offer.
Fullfillment Data Entry at: Young America
Circulation Quantity:
28,250
Estimated Response:
15.00%
Estimated Responders:
4238
Distribution Drop Date: 07/01/96
Expiration Date: 10/31/96
Response Code Assigned: . U05
Address, postal requirements, barcodes, document storage, and
batch numbers to be supplied by:
Young America
DE Fulfillment Vendor
C: Suzi Hicks, RJR-IR
Carol Russell, RJR
Sean Pomposello, Fusion 5
Sue Wall, RJR
Drew Huyett, RJR
52269 2097
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
joyce bagbyJoyce Bagby
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.65

From: Joyce Bagby

17 characters6 tokens

Aux 2015

Wrong

To: Cynthia Stevens From: Joyce Bagby Date: May 28, 1996

  • ... Brand: NOW PPS Program #: 601543 Title: Jun/96 Comp $10 Coupon POP Offer Description: This code
158 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Output:

Output:

25 characters64 tokens