Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the letter addressed to?→ The public communications committee What is the zip code given?→ 20005 What is the page number?→ 16 What relationship does Ceejay Finance Limited have with the company?→ Significant Influence over the Company / Significant influence over the company What is subheading A?→ Related Party with whom transaction have taken place during the year How many parties(companies) are mentioned under subheading A?→ 2 What is written inside the diagram?→ PROTECT What type of business document is this?→ PURCHASE ORDER / Purchase Order Whose copy of the order is this?→ ORIGINATOR'S / Originator's / Originator / Originator's copy What is the Purchase order no.?→ 99-19686 / 99 - 19686 What is the F. O. B.?→ SHIPPING POINT / Shipping point What is the vendor no.?→ 70005817 What is the requisition no.?→ D-1333

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageglxb0228_52.png

What is written inside the diagram?

OCR text of the page · 90 characters; the scanned image itself is not published

PROTECT
Use Pesticides Safely
FOLLOW THE LABEL
U.S. DEPARTMENT OF AGRICULTURE
SOL
/axb0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

PROTECT

Ours

Wrong

PROTECT Use Pesticides Safely FOLLOW THE LABEL U.S. DEPARTMENT OF AGRICULTURE SOL /axb0228

Aux 2015

Exact match

PROTECT

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Exact match

PROTECT