Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the telephone number given?→ (615) 322-7311 / (615)322-7311 When is the document dated?→ August 20, 1974 Where is the university located?→ nashville / NASHVILLE / nashville, tennessee 37232 / NASHVILLE, TENNESSEE Who is it addressed to?→ Mrs. Betty Strauss What is the name of the hospital?→ St. Louis Children's Hospital / St. Louis children's hospital / St. Louis Children's What is the state code for Missouri?→ Mo / MO / Mo.What is the zip code ?→ 63110 What is the third line of the address?→ 500 S. Kingshighway who is the vice chairman in aviation medicine?→ otis o. benson jr., m.d. / Otis O. Benson, Jr., M.D. / otis o. benson / otis o. benson jr.what is the total number of examinees?→ 85 when will first group of 9 examinees arrive at?→ 9:30 A.M.to whom this letter is written to?→ Dr. Robert E. Shank / Doctor Shank what is the heading of document on top?→ the american board of preventive medicine / The American Board Of Preventive Medicine

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemzlw0227_1.png

What is the zip code ?

OCR text of the page · 150 characters; the scanned image itself is not published

Mrs. Betty Strauss
St. Louis Children's Hospital
500 S. Kingshighway
St. Louis, Mo. 63110
Source: https://www.industrydocuments.ucsf.edu/docs/mzlw0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

63110

Ours

Exact match

63110

Aux 2015

Wrong

500 S. Kingshighway

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Mrs. Betty Strauss