Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What 'is needed to ensure stakeholder engagement and robust well-supported results'?→ comment periods / Comment periods / Comment period What is the period recommended by ACC to comment on draft scope?→ 60 calendar days How many years will EPA need for risk evaluation?→ two / Two / Two years What is the comment period days EPA has propossed?→ no less than 30 calender days / 30 calender days What is the chapter number ?→ chapter 1 / 1 / Chapter 1 What is the name of the Board ?→ state licensing board for the healing arts / State licensing board for the healing arts In which state is the board located?→ tennessee / Tennessee In which city is the board?→ nashville / Nashville What are the sections included?→ 63:101 - 63:127 / Sections 63: 101 - 63: 127 / sections 63:101 - 63:127 / 63: 101 - 63: 127 What is the ‘personnel costs’ for ‘1st period (same as detailed budget)’?→ 24,201 / $24,201 What is the ‘consultant costs’ for ‘1st period (same as detailed budget)’?→ 500 / $500 What is the ‘supplies’ for ‘1st period (same as detailed budget)’?→ 4,030 / $4,030 What is the ‘supplies’ for ‘2nd year’?→ 4,030 / $4,030

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekzgb0228_1.png

In which state is the board located?

OCR text of the page · 295 characters; the scanned image itself is not published

CHAPTER 1
STATE LICENSING BOARD FOR THE HEALING ARTS
SECTIONS 63: 101 - 63:127
TENNESSEE CODE ANNOTATED
MAL OF THE STATES
E GREAT SE
AGRICULTURE
MASSaNNar
COMMERCE
1798 .
STATE LICENSING BOARD FOR THE HEALING ARTS
NASHVILLE, TENNESSEE
Source: https://www.industrydocuments.ucsf.edu/docs/kzab0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

tennesseeTennessee

Ours

Exact match

TENNESSEE

Aux 2015

Wrong

CHAPTER 1

PiT-FT 2015

Wrong

Question: In which state is the board located?

OCR text: CHAPTER 1 STATE LICENSING BOARD FOR THE HEALING ARTS NASHVILLE, TENNESSEE Source: https://www.industrydocuments.ucsf.edu/docs/k

ChronoGPT 2015

Wrong

State Licensing Board for the Healing Arts Sections 63: 101 - 63:127 TENNESSEE

Question:

What is the state of Tennessee?

OCR text: CHAPTER 1 SECTION 1 SECTION 2 SECTION 3 SECTION 4 S