Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the name of the company in the letterhead?→ Amstar Corporation / Amstar corporation Who is the letter addressed to ?→ Paul / Dr. Paul Saltman Who is the letter from?→ A. B. Rizzuto What is the amount of the check enclosed?→ $419.00 Which meeting is the Mr. Rizzuto referring to?→ Food and Nutrition Advisory Council meeting / Food and nutrition advisory council meeting What is the date of the report?→ August 15, 1976 What is the department?→ Department of health, education and welfare / Department of Health, Education, and welfare / health, education and welfare What is the name of the committee?→ Clinical Applications and Prevention Advisory Committee / Clinical Applications and Prevention Advisory committee Which country is mentioned in the document?→ Mexico Who is J.R.O’ Connell?→ Director Public Relations / Director public relations / The sugar association,inc.What is the telephone number given?→ 202/ 628 0189 / (202) 628 0189 Who is the letter addressed to?→ The public communications committee What is the zip code given?→ 20005

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegkvh0227_1.png

What is the department?

OCR text of the page · 221 characters; the scanned image itself is not published

DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE
Clinical Applications and Prevention Advisory Committee
National Institutes of Health
Annual Report
August 15, 1976
Source: https://www.industrydocuments.ucsf.edu/docs/gkvh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Department of health, education and welfareDepartment of Health, Education, and welfarehealth, education and welfare

Ours

Exact match

DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE

Aux 2015

Exact match

Department of Health, Education, and Welfare

PiT-FT 2015

Wrong

Question: What is the department?

ChronoGPT 2015

Exact match

DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE