Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejyfk0226_1.png

How many ‘General Directions’ are given for the SCIENCE CONTEST?

OCR text of the page · 2,362 characters; the scanned image itself is not published
THE UNIVERSITY INTERSCHOLASTIC LEAGUE
SCIENCE CONTEST
Number 15
GENERAL DIRECTIONS:
1. DO NOT OPEN EXAM UNTIL TOLD TO DO SO.
2. Ninety minutes should be ample time to complete this contest, but since
the exam is not a race, contestants may take up to two hours.
3. Papers may not be turned in until sixty minutes have elapsed.
4. All answers must be written on the answer sheet provided.
5. Some sections of the contest may have more than one correct answer. These
are specifically noted in the appropriate section instructions. There is a
penalty for incorrect answers to these questions. All other sections have
one correct (best ) answer. There is no penalty for incorrect answers to
these questions.
6. If a question is omitted, no points are given or subtracted.
SCORING
1. All questions for which there is only one correct answer requested will receive 5
points if answered correctly, and no points if unanswered or if answered incorrectly.
2. On questions where one or more correct answers are possible ( the last 10 questions).
the following rules will apply:
a) If only one answer is correct and only one correct answer is given, then 5 points
will be awarded.
"b) If there are two correct answers and both of these are given, 5 points will be
awarded. If only one of these is given, then only 2 points will be awarded.
() If there are three correct answers and all three correct answers are given, then
5 points will be awarded. If only two of the correct answers are given, then S
points will be awarded, and if only one correct answer is given, then only 1 point
will be awarded.
(d) If there are four correct answers and all four correct answers are given, then
5 points will be awarded. For three correct answers, 3 points will be awarded;
for two correct answers. 2 points will be awarded; and for one correct answer.
I point will be awarded,
e) If there are five or more correct answers, 5 points will be awarded if all the cor-
rect answers are given; otherwise, I point will be awarded for each correct
answer, up to a maximum of 4 points.
(f) On all questions where there may be one or more correct answers, if any incor-
rect answers are given, 2 points are subtracted from the total score for each
incorrect answer.
(g) If a question is omitted, no points are given or subtracted.
Source: https://www.industrydocuments.ucsf.edu/docs/jyfk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
6
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

6

1 characters2 tokens

Aux 2015

Wrong

The University Interscholastic League Science Contest. Number 15. General Directions: 1. DO NOT OPEN EXAM UNTIL TOLD TO DO SO. 2. Ninety minutes should be ample time to complete this contest, but since the exam is not a race, contestants may take up to two

256 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
  1. The University of Washington is a public university in Seattle, Washington.
  2. The University of Washington is a public university in Seattle, Washington.
  3. The University of Washington is a public university in Seattle, Washington.
  4. The University of Washington is a public university in Seattle, Washington.
315 characters64 tokens