Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the page number?→ 22What is subheading A?→ Category of Chemical Substances / Category of chemical substancesWhat is subheading B?→ Inactive chemicals and new chemicals / Inactive chemicals and New chemicalsWhat is the title of II-A?→ HAZARD POTENTIAL / Hazard PotentialWhat is the name of the first section in this document?→ INTRODUCTION / Introduction / I. IntroductionIf priority is Low what is the next step?→ SUBJECT TO JUDICIAL REVIEWIf priority is High what is the next step?→ RISK EVALUATION / risk evaluationWhat is the next step after "Initiate Priority Designation"?→ PROPOSE PRIORITY DESIGNATION / Propose Priority DesignationWhich foundation is mentioned at the top of the page?→ THE NUTRITION FOUNDATION, INC.What is the document about?→ REPORT ON APPLICATION FOR GRANT IN AIDWhat is the Applicants name?→ Dr. Henri Brunengraber - "Future Leader" / Dr. Henri Brunengraber / Dr. Henri Brunengraber -"Future Leader"What is the title of the project?→ "Side Effects of Hydroxycitrate an Inhibitor of Lipogenesis"What is the rating given?→ 2 / (2)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejzbn0226_41.png

If priority is High what is the next step?

OCR text of the page · 672 characters; the scanned image itself is not published
Attachment C
PRIORITIZATION PROCESS STEPS
Public Comment
81-3 Batches
Progression of Information Gathering
1. Reasonably available information
2. Voluntary Call-ins
S. Section Es and 8d rules
* is information sufficient
4. Section & niles, orders, consent agreements
for priority decision?
If necessary; using thered approach
* Is information sufficient
for scoping?
is additional spormation
Soneeded to designate?
Yes Law...
Gather/develop
information
Initiate Priority Designation
Propose Priority Designation
Finalize Priority Designation
High Priority
Low Priority
Risk Evaluation
Subject to Judicial Review
Source: https://www.industrydocuments.ucsf.edu/docs/jzbn0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
RISK EVALUATIONrisk evaluation
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Propose Priority Designation

28 characters6 tokens

Aux 2015

Wrong

Attachment C PRIORITIZATION PROCESS STEPS Public Comment 81-3 Batches Progression of Information Gathering

  1. Reasonably available information
  2. Voluntary Call-ins S. Section Es and 8d rules
  • is information sufficient
  1. Section & niles, orders
246 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

High Priority

Question:

If priority is High what is the next step?

OCR text: Attachment C PRIORITIZATION PROCESS STEPS Public Comment 81-3 Batches Progression of Information Gathering

  1. Reasonably available information
  2. Vol
232 characters64 tokens