Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetqgk0023_13.png

Who according to Michael Phillips were the RJR foursome?

OCR text of the page · 1,521 characters; the scanned image itself is not published
Attachment 1
Page 1 of 2
Michael W. Phillips
50296
August 16, 2001
Date
Place/Person/Business Purpose
Amount
08/09
Etna, Clemmons, NC. One carton of Salem Slim
$ 22.20
Light 100s for Julie Sullivan, wife of RJR's lobbyist in
Idaho, Pat Sullivan.
08/10
Wolf Lodge Inn, Coeur d'Alene, ID. Dinner with Pat
$ 153.49
Sullivan (RJR lobbyist) and Wes and Judy Krueger
Idaho Smokers' Rights). Western Governor's
Association Annual Meeting
08/11
Quicksilvers, The Coeur d'Alene Resort, Coeur d'alene,
ID. 5x& photographs of RJR foursome (MT. Gov. Judy
4/ 30.00
Martz, ID State Rep. Jim Clark, Pat Sullivan and self) in
Western Governor's Association golf tournament.
08/11
The Coeur d'Alene Resort, Coeur d'alene, ID. Tip for
20.00
fore-caddie in Western Governor's Association golf
tournament. (Cash - no receipt obtained.)
08/11
Whispers, The Coeur d'alene Resort, Coeur d'alene, ID.
25.00
Refreshments with Pat Sullivan (RJR lobbyist). Western
Governor's Association Annual Meeting.
08/11
Tito's, Coeur d'Alene, ID. Dinner with Pat Sullivan
57.30
(RJR lobbyist). Western Governor's Association
Annual Meeting.
21.03 RA.
08/14
Banbury Restaurant, Eagle, ID. Box lunches and beverage// 210.24
cart for RJR golf outing with Idaho state legislators. (Lt. Gov.
Jack Riggs, Idaho State Senators Jim Risch, Dean Cameron,
Darrel Deide, Evan Frasure, Joe Stegner, Robbi King-Barrutia
and husband, Bob. Pat Sullivan, RJR lobbyist, and self.)
RJR legislative outing.
52511 5153
Source: https://www.industrydocuments.ucsf.edu/docs/tagk0023
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
MT. GOV. JUDY MARTZ, ID STATE REP. JIM CLARK, PAT SULLIVAN AND SELFMT. Gov. Judy Martz, ID State Rep. Jim Clark, Pat Sullivan and self
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

MT. Gov. Judy Martz, ID State Rep. Jim Clark, Pat Sullivan and self

67 characters20 tokens

Aux 2015

Wrong

Attachment 1 Page 1 of 2 Michael W. Phillips 50296 August 16, 2001 Date Place/Person/Business Purpose Amount 08/09 Etna, Clemmons, NC. One carton of Salem Slim

159 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

OCTOBER 16, 2001

Attachment 1

Page 1 of 2 Michael W. Phillips 50296 August 16, 2001 Date Place/Person/Business Purpose Amount 08/10 Etna, Clemmons, NC. One carton of Salem Slim

181 characters64 tokens