Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageztnk0226_6.png

What is written in brackets?

OCR text of the page · 1,184 characters; the scanned image itself is not published
which if unlicensed would otherwise constitute contributory
infringement of the Patent Rights, and to practice the
Licensed Processes in the country of countries in which the
Patent Rights are effective to the full end of the term or
terms for which the Patent Rights are issued.
B. During the term of this License, SALTMAN
hereby grants to AMSTAR and AMSTAR hereby accepts from
SALTMAN the right to grant to others ("Sublicensees") now
exclusive licenses under the Patent Rights and the right to
use Technical Information, to make, to have made for them,
to use and to sell the Licensed Products covered by the
Patent Rights, to sell the Licensed Products under conditions
or circumstances amounting to an inducement to produce the
inventions covered by the Patent Rights or which, if uw
licensed, would otherwise constitute contributory infringe.
ment of the Patent Rights and to practice the Licensed
Processes in the country or countries in which the patent
Rights are effective to the full end of the fare or forms
for which the Patent Rights are issued.
3. . License Fee
A .
AMSTAR shall pay to SALTMAN simultaneously
Source: https://www.industrydocuments.ucsf.edu/docs/ztnk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
"Sublicensees"("Sublicensees")
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

("Sublicensees")

16 characters7 tokens

Aux 2015

Wrong

The answer is:

License Fee

31 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

chronoGPT, a large language model trained by Manela Lab at WashU,

Question:

What is written in brackets?

OCR text:

chronoGPT, a large language model trained by Manela Lab at WashU,

188 characters64 tokens