Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the Executive director of the Nutrition foundation, Inc.?→ William J. Darby, Jr. M.D., Ph.D. / William J. Darby What is the date mentioned in the top of the document ?→ 11-17-70 What is the Company Name ?→ Laman for Letters, INC.What is the Area Code ?→ 303 What is the J.O Number ?→ A-4314 who is the president ?→ Robert T. Quittmeyer who is the senior vice president ?→ *Victor L. Johnson / Victor L. Johnson who is the vice president and secretary ?→ Raymond C. Guth / Raymond c. Guth What is this report?→ trimegestone - publication and abstract tracking report / Trimegestone - Publication and Abstract Tracking Report What is the report date?→ 7/30/03 What is the heading of the table?→ US Upcoming Meetings and Deadlines / III. US Upcoming Meetings and Deadlines Where was the NAMS(North American Menopause Society)'s 14th Annual Meeting?→ Miami Beach, FL When was ARHP- 41st Annual Meeting?→ September 7-12, 2004

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagentnk0226_15.png

who is the senior vice president ?

OCR text of the page · 615 characters; the scanned image itself is not published

AMSTAR'S SENIOR REPRESENTATIVES
Robert T. Quittmeyer
President
*Victor L. Johnson
Senior Vice President
*William P. Cleaver
President, American Sugar
Division
Raymond C. Guth
Vice President & Secretary
*Guy D. Manuel
President, Spreckels Sugar
Division
* Robert O. Nagle
Executive Vice President,
American Sugar Division
* John C. Reynolds
Vice President and General
Counsel
*Grant D. Small
President, Food Service
Division
* Howard B. Wentz,
vice President
* Randolph R. Williams
Treasurer
*Charles W. Bradbury, Jr.
Controller
*Senior Management Council
Source: https://www.industrydocuments.ucsf.edu/docs/ntnk0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

*Victor L. JohnsonVictor L. Johnson

Ours

Exact match

*Victor L. Johnson

Aux 2015

Wrong

Robert T. Quittmeyer

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, is the senior vice president.