Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelzkh0228_1.png

In which university, Ryan James Potts did his Post Doctoral Research?

OCR text of the page · 1,661 characters; the scanned image itself is not published
Ryan James Potts, Ph.D., DABT
950 Reynolds Boulevard, Winston-salem, NC 27105
. .". .
Telephone: (336) 741-1930
Email: pottsr@rjrt.com
. . .
Professional Experience
2017-present
Vice President, Product Integrity
2016-2017
Senior Director
RAI Services Company, Winston-salem, NC, USA
2012-2015
Senior Director
2010-2012
Director
2006-2010
Master Scientist
2004-2006
Senior Staff R&D Toxicologist
2001-2004
Senior R&D Toxicologist
R.J. Reynolds Tobacco Company, Winston-salem, NC, USA
Currently Vice President of Product Integrity within Scientific &
Regulatory Affairs. The position reports to the Senior Vice President of
Scientific & Regulatory Affairs.
Key responsibilities include:
Manage Product Stewardship, Nonclinical Studies, Clinical Studies,
Regulatory Compliance and Quality Assurance groups.
Oversee the design of non-clinical and clinical studies conducted
to support regulatory submissions.
Oversee the development of FDA regulatory submission
documents for tobacco products.
Engage with the FDA and other stakeholders on pertinent
scientific topics,
Lead cross-functional technical projects.
1999-2001
Post-Doctoral Research Toxicologist
University of Vermont, Burlington, VT, USA
Accountable for the design and execution of investigative toxicological
studies to evaluate the pulmonary effects of cadmium and mechanisms
of toxicity.
1996-1999
Ph.D. Graduate Student
University of Bath, Bath, UK
Thesis title: "Toxicology of the male reproductive tract; associations with
smoking and antioxidants"
PLAINTIFF'S
EXHIBIT HO. Pots
Page 1 of 6
8 FOR IDENTIFICATION
DATE.
53757 8510
W200050987
Source: https://W.industrydocuments.ucsf.edu/docs/lzkh0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
University of VermontUniversity of Vermont, Burlington, VT, USA
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

University of Vermont

21 characters4 tokens

Aux 2015

Wrong

Based on the OCR text, the question asks for the university where Ryan James Potts did his post-doctoral research. The text contains several references to the university, including:

  • "University of Vermont, Burlington, VT, USA"
  • "University of Bath, Bath, UK"
  • "University
276 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

ChronoGPT, Ph.D., DABT 950 Reynolds Boulevard, Winston-salem, NC 27105

Key responsibilities:

Manage Product Stewardship, Non-clinical Studies, Clinical Studies, Regulatory Compliance and Quality Assurance groups. Oversee the design of

239 characters64 tokens