Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepybn0226_2.png

Who signed executive order for EPA?

OCR text of the page · 1,272 characters; the scanned image itself is not published
4
Administrator Pruitt joined the group for brief remarks. His remarks focused on the following
themes:
Stressed that this is a new day, a new future, for a common sense approach to environmental
protection.
President Trump signed Executive Order for EPA to reconsider and rewrite the WOTUS
regulation and Administrator Pruitt wasted no time signing a FR Notice to begin implementation
of that process.
> Regulations must be regular and provide the impacted communities with certainty about how to
comply so that businesses can plan for necessary changes and resources.
> Regulations need to be written based on language specifically addressed within the environmental
statutes and not have the statutes interrupted to meet broader goals they were not specifically
designed to meet.
The new Administration understands the tremendous economic impact agriculture plays in our
economy and is looking forward to working closely with the agricultural community.
The meeting then proceeded by allowing for each of the participants to go around the room and
make an observation or raise a concern. Topics were not resolved rather it was designed as a
listening session for EPA to hear the concerns of the participants.
Source: https://www.industrydocuments.ucsf.edu/docs/pybn0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
President Trump
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

President Trump

15 characters3 tokens

Aux 2015

Wrong

Administrator Pruitt signed Executive Order for EPA to reconsider and rewrite the WOTUS regulation and Administrator Pruitt wasted no time signing a FR Notice to begin implementation of that process.

199 characters34 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

4 Administrator Pruitt joined the group for brief remarks. His remarks focused on the following themes: Stressed that this is a new day, a new future, for a common sense approach to environmental protection. President Trump signed Executive Order for EPA to reconsider and rewrite the WOTUS regulation and

305 characters64 tokens