Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageslyv0228_4.png

What is the arrival time of the washington flight?

OCR text of the page · 1,227 characters; the scanned image itself is not published
COPY
Paris, March, Thursday 26th, 1969
Monsieur J. FISCHER
Beet Sugar Development Foundation.
Dear Jim,
Here are the answers to the questions you asked me in your last letter
and by phone last Monday.
AIRPLANES
- NEW YORK
Arrival
Saturday ord May
12.00
AF 015
DENVER
Arrival
Monday 5th may
11.00
UA 161
Departure
Thursday 8th May
12.28
FL 599
- AMARILLO
Arrival
Thursday 8th May
15.20
FL 599
Departure
Saturday 10th May
08 . 15
CO 142
- PHOENIX
Arrival
Saturday 10th May
10. 13
CO 751
Departure
Tuesday 13th May
12.20
RW 683
- EL CENTRO
Arrival
Tuesday 13th May
12. 40
RW 683
Departure
Thursday 15th May
by car
- SAN FRANCISCO Arrival
Thursday 15th May
18.00
UA 530
Departure
Monday 19th May
10.35
UA 778
- BOISE CITY
Arrival
Monday 19th May
13.45
UA 778
Departure
Wednesday 21st May
09 . 45
UA 222
- WASHINGTON
Arrival
Wednesday 21st May
19. 18
AA 598
Departure
Friday 23rd May
18.45
AF 018
CARS
Four cars have been reserved at AVIS in all the arrival airports.
All the rental expenses, including gas, oil, for a maximum of 4 500 miles
have been paid in Paris.
It the cars are not used, or if all the miles are not covered, we shall
be paid back in Paris.
. ..!. ..
Source: https://www.industrydocuments.ucsf.edu/docs/slyv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
19.18
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Wednesday 21st May 19. 18

25 characters14 tokens

Aux 2015

Wrong

The arrival time of the Washington flight is Wednesday, May 21st, 19:18.

76 characters25 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
  • New York, Thursday 26th, 1969
  • Paris, Saturday 5th, 1969
  • Denver, Tuesday 13th, 1969
  • El Centro, Thursday 8th, 1969
  • Washington, Thursday 8th, 1969
  • Boise City, Thursday 15th, 1969
  • Washington,
201 characters64 tokens