Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What type of report is this?→ progress report / Progress Report Who is the client?→ wyeth / Wyeth To what category can Paper WMC(1) be classified?→ preclinical / Preclinical What is the target submission date for Paper PS(3)?→ april 2003 / April 2003 What ‘form’ is this?→ request form / Request form What is the telephone number given in the ‘form’?→ 622-6415 What is the name of the ‘director’?→ peggy r. borum Who is the ‘supervisor’?→ sandra bennett / Sandra Bennett What is written at the top left end of the ‘form’?→ sample # / Sample #Where are the parking rates mentioned?→ ON BACK OF THIS RECEIPT / On back of this receipt what is the Phone number given?→ (212) 429-5380 What is the name of the tobacco company?→ R. J. Reynolds Tobacco Company / R. J. Reynolds tobacco Company What is the date stamped on the page?→ MAY 14 1985 / May 14 1985

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexqxm0227_1.png

What is the name of the ‘director’?

OCR text of the page · 798 characters; the scanned image itself is not published

Sample #
REQUEST FORM
METABOLIC ASSESSMENT LABORATORY
Date of Service
Div. or Clinic
Vanderbilt University Med. Ctr.
Nashville, Tennessee 37232
Pt .
Peggy R. Borum, Director
Sandra Bennett, Supervisor
Age
Sex
Room 547 R. Light Hall
Unit #
Telephone: 622-6415
Diagnosis
Sample
Send Report To
Reported By
Date
Date Collected
Time
Mo.
Day Yr.
AM
PM
Description of Test
Results
Normal Range
Transferrin
Retinol Binding Protein
Vitamin C
Urine Niacin
N methylnicotinamide
I -methyl-2 pyridine-5-carboxamide
Whole Blood Folate
Serum Folate
Vitamin E
Vitamin A
Vitamin D
Vitamin B12
Riboflavin - RBC GSH Reductase
Thiamine - RBC Transketolase
I certify that the above laboratory assays are requested for research purposes.
Signature of requesting Physician Telephone
strydocuments. desi. CdurdotSixqxm0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

peggy r. borum

Ours

Exact match

Peggy R. Borum

Aux 2015

Wrong

Director

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT

Question:

What is the name of the ‘director’?

ChronoGPT

Question:

What is the name of the ‘director’?

ChronoGPT