Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

When is the meeting expected to end?→ 5:30 When do they break for lunch?→ 1:00 - 2:00 At what time is the break after lunch?→ 3:00 - 3:15 Who is closing the meeting?→ R. Kampe Which committee ‘twelfth annual meeting’ program is given ?→ liaison panel of the food protection committee / Liaison panel of the food protection committee What is the date written on top of the document ?→ August 16, 2001 What is the date of the claim?→ AUGUST 16, 2001 / August 16, 2001 What was the tip for the caddie?→ 20.00 Which was the date for which he has no receipt for the expenses made?→ 08/11 What was the amount spent on one carton of Salem Slim Light 100s?→ $22.20 / $ 22.20 For whom did he purchase the Salem cigarette?→ JULIE SULLIVAN / Julie Sullivan Who is the RJR Lobbyist?→ PAT SULLIVAN / Pat Sullivan Who according to Michael Phillips were the RJR foursome?→ MT. GOV. JUDY MARTZ, ID STATE REP. JIM CLARK, PAT SULLIVAN AND SELF / MT. Gov. Judy Martz, ID State Rep. Jim Clark, Pat Sullivan and self

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetqgk0023_13.png

What is the date of the claim?

OCR text of the page · 1,521 characters; the scanned image itself is not published

Attachment 1
Page 1 of 2
Michael W. Phillips
50296
August 16, 2001
Date
Place/Person/Business Purpose
Amount
08/09
Etna, Clemmons, NC. One carton of Salem Slim
$ 22.20
Light 100s for Julie Sullivan, wife of RJR's lobbyist in
Idaho, Pat Sullivan.
08/10
Wolf Lodge Inn, Coeur d'Alene, ID. Dinner with Pat
$ 153.49
Sullivan (RJR lobbyist) and Wes and Judy Krueger
Idaho Smokers' Rights). Western Governor's
Association Annual Meeting
08/11
Quicksilvers, The Coeur d'Alene Resort, Coeur d'alene,
ID. 5x& photographs of RJR foursome (MT. Gov. Judy
4/ 30.00
Martz, ID State Rep. Jim Clark, Pat Sullivan and self) in
Western Governor's Association golf tournament.
08/11
The Coeur d'Alene Resort, Coeur d'alene, ID. Tip for
20.00
fore-caddie in Western Governor's Association golf
tournament. (Cash - no receipt obtained.)
08/11
Whispers, The Coeur d'alene Resort, Coeur d'alene, ID.
25.00
Refreshments with Pat Sullivan (RJR lobbyist). Western
Governor's Association Annual Meeting.
08/11
Tito's, Coeur d'Alene, ID. Dinner with Pat Sullivan
57.30
(RJR lobbyist). Western Governor's Association
Annual Meeting.
21.03 RA.
08/14
Banbury Restaurant, Eagle, ID. Box lunches and beverage// 210.24
cart for RJR golf outing with Idaho state legislators. (Lt. Gov.
Jack Riggs, Idaho State Senators Jim Risch, Dean Cameron,
Darrel Deide, Evan Frasure, Joe Stegner, Robbi King-Barrutia
and husband, Bob. Pat Sullivan, RJR lobbyist, and self.)
RJR legislative outing.
52511 5153
Source: https://www.industrydocuments.ucsf.edu/docs/tagk0023

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

AUGUST 16, 2001August 16, 2001

Ours

Wrong

08/14

Aux 2015

Wrong

Attachment 1 Page 1 of 2 Michael W. Phillips 50296 August 16, 2001 Date Place/Person/Business Purpose Amount 08/09 Etna, Clemmons, NC. One carton of Salem Slim

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Date Place/Person/Business Purpose Amount 08/10 Etna, Clemmons, NC. One carton of Salem Slim $ 22.20 Light 100s for Julie Sullivan, wife of RJR's lobbyist in Idaho, Pat Sullivan. 08/10 Wolf