Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemfnf0004_1.png

Between which 2 tobacco Companies is the license negotiation?

OCR text of the page · 1,014 characters; the scanned image itself is not published
RJR and JT License Negotiation
July 17 and 18, 1996
Attendees
R.J. Reynolds
Mr.Lucien L. Bass, III
Senior Director
International Business Development
R.J.R.Tobacco International Inc.
Mr. Charles A. Blixt
Senior Vice President and General Counsel
R.J. Reynolds Tobacco Co.
Mr. Francois C. Stettler
General Counsel
R.J. Reynolds Tobacco International,
Asia Pacific
Ms. Kay Carter
Manager, Public Relations
R.J. Reynolds Tobacco Co.
Ms. Sachiko Takagi
Public Affairs Manager
Corporate Affairs Department
R.J. Reynolds/M.C. Tobacco Company, Lid.
Japan Tobacco
Mr. Hideo TADA
Managing Director, A board member
Tobacco Planning Division
Mr. Eiji Itoh
Associate Group Director
Product Group
Mr. Toshihiro Okawa
Division Manager, New Product
Product Group
Mr. Tatsuya Fujimoto
Group Manager, New Product
Product Group
Mr. Ryuichi Shimomura Vice President, International Legal Division
Mr. Yoshiaki Otsuka
General Manager, International Legal Division
51722 0576
Source: https://www.industrydocuments.ucsf.edu/docs/minf0004
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
RJR and JT
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

RJRTobacco International Inc. and R.J. Reynolds Tobacco Co.

59 characters16 tokens

Aux 2015

Wrong

R.J. Reynolds and JT License Negotiation

40 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

RJR and JT License Negotiation July 17 and 18, 1996 Attendees R.J. Reynolds Tobacco Co. Mr. R.J. Reynolds, Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr. Mr

161 characters64 tokens