Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepybn0226_2.png

With which community is the new administration looking forward to work with?

OCR text of the page · 1,272 characters; the scanned image itself is not published
4
Administrator Pruitt joined the group for brief remarks. His remarks focused on the following
themes:
Stressed that this is a new day, a new future, for a common sense approach to environmental
protection.
President Trump signed Executive Order for EPA to reconsider and rewrite the WOTUS
regulation and Administrator Pruitt wasted no time signing a FR Notice to begin implementation
of that process.
> Regulations must be regular and provide the impacted communities with certainty about how to
comply so that businesses can plan for necessary changes and resources.
> Regulations need to be written based on language specifically addressed within the environmental
statutes and not have the statutes interrupted to meet broader goals they were not specifically
designed to meet.
The new Administration understands the tremendous economic impact agriculture plays in our
economy and is looking forward to working closely with the agricultural community.
The meeting then proceeded by allowing for each of the participants to go around the room and
make an observation or raise a concern. Topics were not resolved rather it was designed as a
listening session for EPA to hear the concerns of the participants.
Source: https://www.industrydocuments.ucsf.edu/docs/pybn0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Agricultural communityThe agricultural communityWith The agricultural community
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

agricultural community

22 characters4 tokens

Aux 2015

Wrong

Administrator Pruitt joined the group for brief remarks. His remarks focused on the following themes: Stressed that this is a new day, a new future, for a common sense approach to environmental protection. President Trump signed Executive Order for EPA to reconsider and rewrite the WOTUS regulation and Administrator Pruitt wasted no time signing a FR

352 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Administrator Pruitt joined the group for brief remarks. His remarks focused on the following themes: Stressed that this is a new day, a new future, for a common sense approach to environmental protection. President Trump signed Executive Order for EPA to reconsider and rewrite the WOTUS regulation and Administrator Pruitt

324 characters64 tokens