Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemfnf0004_1.png

Which company does Mr. Hideo TADA belong to?

OCR text of the page · 1,014 characters; the scanned image itself is not published
RJR and JT License Negotiation
July 17 and 18, 1996
Attendees
R.J. Reynolds
Mr.Lucien L. Bass, III
Senior Director
International Business Development
R.J.R.Tobacco International Inc.
Mr. Charles A. Blixt
Senior Vice President and General Counsel
R.J. Reynolds Tobacco Co.
Mr. Francois C. Stettler
General Counsel
R.J. Reynolds Tobacco International,
Asia Pacific
Ms. Kay Carter
Manager, Public Relations
R.J. Reynolds Tobacco Co.
Ms. Sachiko Takagi
Public Affairs Manager
Corporate Affairs Department
R.J. Reynolds/M.C. Tobacco Company, Lid.
Japan Tobacco
Mr. Hideo TADA
Managing Director, A board member
Tobacco Planning Division
Mr. Eiji Itoh
Associate Group Director
Product Group
Mr. Toshihiro Okawa
Division Manager, New Product
Product Group
Mr. Tatsuya Fujimoto
Group Manager, New Product
Product Group
Mr. Ryuichi Shimomura Vice President, International Legal Division
Mr. Yoshiaki Otsuka
General Manager, International Legal Division
51722 0576
Source: https://www.industrydocuments.ucsf.edu/docs/minf0004
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Japan TobaccoJT
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Japan Tobacco

13 characters3 tokens

Aux 2015

Wrong

RJR and JT License Negotiation

30 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Mr. Hido TADA belongs to Mr. Hido

Question: Which company does Mr. Hido TADA belong to?

OCR text: RJR and JT License Negotiation July 17 and 18, 1996 Attendees R.J. Reynolds Tobacco Co.

187 characters64 tokens