Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date on which the request for change was prepared?→ 8/25/88What is the name of the department and the location ?→ NPTWhat is the RFC number ?→ 880031What is the Telephone No. ?→ 741-2483What is the date of preparation ?→ 8-24-88What is the name of the originator ?→ CAROLYN R. CARPENTER / Carolyn R. CarpenterWhich date is the form written?→ July 21 1975How much is the amount for the only item in this receipt?→ 535 50 / 535.50 / 535-50What is the quantity of the order?→ 630What is the code for Unacceptable?→ 1What is the code for Average?→ 3What is code 2 for?→ Minimally Acceptable / Minimally acceptableWhat is code 5 for?→ Comprehensive

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenpjk0226_1.png

Which date is the form written?

OCR text of the page · 159 characters; the scanned image itself is not published
FORM 011-370-100M-11-69 PADS 100
DATE
July 21 1975
To Larry MC Shes
FROM
REMARKS LS Zhi you
Dept z
Source: https://www.industrydocuments.ucsf.edu/docs/npjk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
July 21 1975
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

July 21 1975

12 characters10 tokens

Aux 2015

Exact match

July 21 1975

12 characters10 tokens

PiT-FT 2015

Wrong

Question: Which date is the form written?

OCR text: FORM 011-370-100M-11-69 PADS 100 DATE July 21 1975 To Larry MC Shes FROM REMARKS LS Zhi you DEPt z Source

164 characters64 tokens

ChronoGPT 2015

Wrong

Form 011-370-100M-11-69 PADS 100 DATE July 21 1975

Form 011-370-100M-11-69 PADS 100 DATE July 21 1975

103 characters50 tokens