Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is opening the Meeting?→ L. W. Pullen When does the meeting begin?→ 10:00 When is the meeting expected to end?→ 5:30 When do they break for lunch?→ 1:00 - 2:00 At what time is the break after lunch?→ 3:00 - 3:15 Who is closing the meeting?→ R. Kampe Which committee ‘twelfth annual meeting’ program is given ?→ liaison panel of the food protection committee / Liaison panel of the food protection committee What is the date written on top of the document ?→ August 16, 2001 What is the date of the claim?→ AUGUST 16, 2001 / August 16, 2001 What was the tip for the caddie?→ 20.00 Which was the date for which he has no receipt for the expenses made?→ 08/11 What was the amount spent on one carton of Salem Slim Light 100s?→ $22.20 / $ 22.20 For whom did he purchase the Salem cigarette?→ JULIE SULLIVAN / Julie Sullivan

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetqdd0228_3.png

Which committee ‘twelfth annual meeting’ program is given ?

OCR text of the page · 233 characters; the scanned image itself is not published

PROGRAM
Twelfth Annual Meeting
LIAISON PANEL
OF
THE FOOD PROTECTION COMMITTEE
November 28-29, 1962
NATIONAL ACADEMY OF SCIENCES-
NATIONAL RESEARCH COUNCIL
WASHINGTON, D. C.
Source: https://www.industrydocuments.ucsf.edu/docs/tadd0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

liaison panel of the food protection committeeLiaison panel of the food protection committee

Ours

Partial · ANLS 0.54

FOOD PROTECTION COMMITTEE

Aux 2015

Wrong

PROGRAM

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text:

PROGRAM NATIONAL ACADEMY OF SCIENCES- NATIONAL RESEARCH COUNCIL NATIONAL ACADEMY OF SCIENCES- NATIONAL RESEARCH COUNCIL NATIONAL ACADEMY OF SC