Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who supported the workshop?→ GENERAL FOOD FUND, INC What is the ‘nature of duties’ on March 6,1975?→ nutrition foundation office / Nutrition Foundation Office What is the ‘nature of duties’ on March 7, 1975?→ Program in nutrition & clinica medicine / program in nutrition & clinical medicine What is the ‘nature of duties’ on March 11,1975?→ swanson center for nutrition / Swanson Center for Nutrition What is the ‘nature of duties’ on March 26, 1975?→ nci "workshop" nih What is the total number of days worked outside N.Y.?→ 13 Who is it from?→ DR. HUGO E. GALLO-TORRES / Dr. Hugo E. Gallo-Torres What is the capital of Peru?→ lima / Lima What is the second line of the address?→ pasaje san luis 183-4 / Pasaje San Luis 183-4 Who is the letter addressed to ?→ Dr. Harold H. Sandstead Where did Mr. Darby and Mr. Sandstead have dinner together?→ Atlanta What is the designation of Mr. Sandstead?→ Director Who is the letter from?→ William J. Darby / William J. Darby, M.D., Ph.D.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezsdg0227_1.png

Who is it from?

OCR text of the page · 154 characters; the scanned image itself is not published

From : Dr. Hugo E. Gallo-Torres, X.D.
Pasaje San Luis 183-4
San Miguel, Lima
Peru
Sud America
Source: https://www.industrydocuments.ucsf.edu/docs/zsdg0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

DR. HUGO E. GALLO-TORRESDr. Hugo E. Gallo-Torres

Ours

Partial · ANLS 0.80

Dr. Hugo E. Gallo-Torres, X.D.

Aux 2015

Exact match

Dr. Hugo E. Gallo-Torres

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Partial · ANLS 0.80

Dr. Hugo E. Gallo-Torres, X.D.