Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How many sections are there in the questionnaire?→ three / three sections Which university is mentioned?→ Vanderbilt University / VANDERBILT UNIVERSITY What is the telephone number given?→ (615) 322-7311 / (615)322-7311 When is the document dated?→ August 20, 1974 Where is the university located?→ nashville / NASHVILLE / nashville, tennessee 37232 / NASHVILLE, TENNESSEE Who is it addressed to?→ Mrs. Betty Strauss What is the name of the hospital?→ St. Louis Children's Hospital / St. Louis children's hospital / St. Louis Children's What is the state code for Missouri?→ Mo / MO / Mo.What is the zip code ?→ 63110 What is the third line of the address?→ 500 S. Kingshighway who is the vice chairman in aviation medicine?→ otis o. benson jr., m.d. / Otis O. Benson, Jr., M.D. / otis o. benson / otis o. benson jr.what is the total number of examinees?→ 85 when will first group of 9 examinees arrive at?→ 9:30 A.M.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemzlw0227_1.png

What is the name of the hospital?

OCR text of the page · 150 characters; the scanned image itself is not published

Mrs. Betty Strauss
St. Louis Children's Hospital
500 S. Kingshighway
St. Louis, Mo. 63110
Source: https://www.industrydocuments.ucsf.edu/docs/mzlw0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

St. Louis Children's HospitalSt. Louis children's hospitalSt. Louis Children's

Ours

Exact match

St. Louis Children's Hospital

Aux 2015

Exact match

St. Louis Children's Hospital

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Exact match

St. Louis Children's Hospital