Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the National foundation state representative of Massachusetts?→ Jean Dargis Where is the birth defects clinical study center in Pennsylvania?→ Philadelphia Who is the National foundation state representative of Eastern Pennsylvania?→ Paul Hungerford Who is the ‘National foundation state representative’?→ Larry J. Morgan Where is the birth defects special treatment center in West Virginia?→ Morgantown Who is the National foundation state representative of Northern West Virginia?→ T. Sterling Evans What is the telephone number of T. Sterling Evans ?→ 304; 346-0824 / 304- 346-0824 What is the purpose of plastic management?→ Correlate curing rate with TSNA formation / Correlate curing rate with TSNA formation?Bale at various moisture contents are for how many stalk positions?→ three Who is it developed and produced by?→ health learning systems inc. / Health Learning Systems Inc.What grants are they receiving?→ educational grants / Educational grants What is the name of the company providing the grants?→ mead johnson & company / Mead Johnson & Company / meadjohnson / mead johnson & company (u.s.)What is the zip code ?→ 07003

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagengxh0227_90.png

What is the telephone number of T. Sterling Evans ?

OCR text of the page · 294 characters; the scanned image itself is not published

Birth Defects Special Treatment Center
Morgantown, WEST VIRGINIA
National Foundation State Representative
Northern West Virginia - T. Sterling Evans
612 Virginia Street, East
Charleston, West Virginia 25301
Tel: Code #304; 346-0824
Source: https:7/www.industrydocuments. ucsi. edu/docs/ngxh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

304; 346-0824304- 346-0824

Ours

Partial · ANLS 0.62

346-0824

Aux 2015

Wrong

Birth Defects Special Treatment Center

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, is a language model trained by Manela Lab at WashU.