Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageslyv0228_4.png

Which city is this letter sent from?

OCR text of the page · 1,227 characters; the scanned image itself is not published
COPY
Paris, March, Thursday 26th, 1969
Monsieur J. FISCHER
Beet Sugar Development Foundation.
Dear Jim,
Here are the answers to the questions you asked me in your last letter
and by phone last Monday.
AIRPLANES
- NEW YORK
Arrival
Saturday ord May
12.00
AF 015
DENVER
Arrival
Monday 5th may
11.00
UA 161
Departure
Thursday 8th May
12.28
FL 599
- AMARILLO
Arrival
Thursday 8th May
15.20
FL 599
Departure
Saturday 10th May
08 . 15
CO 142
- PHOENIX
Arrival
Saturday 10th May
10. 13
CO 751
Departure
Tuesday 13th May
12.20
RW 683
- EL CENTRO
Arrival
Tuesday 13th May
12. 40
RW 683
Departure
Thursday 15th May
by car
- SAN FRANCISCO Arrival
Thursday 15th May
18.00
UA 530
Departure
Monday 19th May
10.35
UA 778
- BOISE CITY
Arrival
Monday 19th May
13.45
UA 778
Departure
Wednesday 21st May
09 . 45
UA 222
- WASHINGTON
Arrival
Wednesday 21st May
19. 18
AA 598
Departure
Friday 23rd May
18.45
AF 018
CARS
Four cars have been reserved at AVIS in all the arrival airports.
All the rental expenses, including gas, oil, for a maximum of 4 500 miles
have been paid in Paris.
It the cars are not used, or if all the miles are not covered, we shall
be paid back in Paris.
. ..!. ..
Source: https://www.industrydocuments.ucsf.edu/docs/slyv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
paris
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Paris

5 characters2 tokens

Aux 2015

Wrong

COPY Paris, March, Thursday 26th, 1969 Monsieur J. FISCHER Beet Sugar Development Foundation. Dear Jim, Here are the answers to the questions you asked me in your last letter and by phone last Monday. AIRPLANES

211 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Paris, March, Thursday 26th, 1969 Arrival Saturday 5th May 12.28 Departure Thursday 5th May 12.40

Question:

Which city is this letter sent from?

OCR text: COPY Paris, March, Thursday

188 characters64 tokens