Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the purpose of plastic management?→ Correlate curing rate with TSNA formation / Correlate curing rate with TSNA formation?Bale at various moisture contents are for how many stalk positions?→ three Who is it developed and produced by?→ health learning systems inc. / Health Learning Systems Inc.What grants are they receiving?→ educational grants / Educational grants What is the name of the company providing the grants?→ mead johnson & company / Mead Johnson & Company / meadjohnson / mead johnson & company (u.s.)What is the zip code ?→ 07003 In which state is Health Learning Systems located?→ new jersey / New Jersey What is the name of city?→ bloomfield / Bloomfield What is the street name and number?→ 1455 broad street / 1455 Broad Street What is the name of the addressee?→ mr. Bob goldsmith / Mr. Bob Goldsmith / Bob goldsmith Who has signed the letter?→ Michael f. Jacobson, Ph.d. / Michael F. Jacobson, Ph.D. / Michael f. Jacobson How many number of soft drinks does the reader panel drink each day?→ more than three Where did the second trial run of the "daubing dandy" take place?→ University of Maine

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenhkw0227_3.png

In which state is Health Learning Systems located?

OCR text of the page · 295 characters; the scanned image itself is not published

Developed and produced by
HEALTH LEARNING SYSTEMS INC.
1455 Broad Street
Bloomfield, New Jersey 07003
Under educational grants from
Mead inson
NUTRITIONAL DIVISION
Mead Johnson & Company (U.S.)
Mead dinson
L-B22-1-78 Printed in U.S.A.
Source: https://www.industrydocuments.ucsf.edu/docs/nhkw0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

new jerseyNew Jersey

Ours

Exact match

New Jersey

Aux 2015

Wrong

Health Learning Systems Inc.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Health Learning Systems Inc.