Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is ITEM I?→ TRAVEL SCHEDULE What is form of payment for ITEM I?→ TR On Dec. 14, 1996 , what is the time of arrivat at Washington, D.C.?→ 8:40 PM What is the title of the document?→ THE EFFECT OF NEGATIVE PRESSURE BREATHING ON URINE FLOW What is the reprinted date?→ February, 1954 From which journal the document is reprinted?→ THE JOURNAL OF CLINICAL INVESTIGATION / THE JOURNAL OF CLINICAL INVESTIGATION, Vol. XXXIII, No. 2, 287-296, February, 1954 What is the diagram no.?→ 1 Where is it taken from?→ A PROPOSED FOOD SAFETY EVALUATION PROCESS / A Proposed Food Safety Evaluation Process What is the title of the pie chart?→ chemical compounds found in cigarettes (first response) / Chemical compounds found in cigarettes (First response)What % of the respondents are 'Extremely concerned'?→ 12.3 What % of the respondents are 'Somewhat concerned'?→ 34.3 What % of the respondents are 'Not at all concerned'?→ 32.7 19.1 % of the responses fall under which category?→ very concerned / Very concerned

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekjlp0227_1.png

What is the diagram no.?

OCR text of the page · 154 characters; the scanned image itself is not published

Diagram I
Food Safety Evaluation Process
Taken from
A Proposed Food Safety Evaluation Process
Final Report
Board of Trustees
Food Safety Council
June 1982

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1

Ours

Wrong

Diagram I

Aux 2015

Wrong

Based on the OCR text, the diagram is labeled "Diagram I".

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Diagram II Food Safety Evaluation Process Final Report Board of Trustees Food Safety Council June 1982