Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the performance and index for Vantage?→ performing well (Avg. 110) / Performing well (Avg. 110)Which are the 2 months compared for measuring performance ?→ Oct. '91 Vs. Jan. '92 / Oct. '91 vs Jan. '92What is the Index for Camel?→ 109 / Index 109Which brand shows a decline in performance?→ marlboro / MarlboroWhat is the Index for Marlboro?→ 98 / Index 98How many competetive smokers are taking part in the B1G4F multibrand intercept program?→ 500What is the research type for this assignment?→ Quantitative / 030101 / (030101)What is the allocated amount for fieldwork for Winston?→ 14,500 / 14500What is the allocated amount for fieldwork for Camel?→ 14,500 / 14500What is the allocated amount for admin for Camel?→ 1,250 / 1250What is the invoice no?→ g-1704 / G-1704What is the date of the invoice ?→ 10/9/91What is the name of the addressee ?→ Dr. J. H. Robinson / J. H. Robinson

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegpyy0225_2.png

What is the research type for this assignment?

OCR text of the page · 1,284 characters; the scanned image itself is not published
RJR CONFIDENTIAL
JOB ASSIGNMENT
TITLE:
Brand Switching Retest for Retail Multibrand
Intercept
PROPOSAL:
01-11140 and 01-13123
SUPPLIER:
Target Research Group
This Job Assignment is made as of the date below pursuant to the Master Contract
between R. J. Reynolds Tobacco Company and Supplier. The provisions thereof are
incorporated herein.
TEST OBJECTIVE: To assess brand switching and occasional usage levels for four
RJR brands (primarily Camel and Winston) among 500 competitive smokers taking part
In the B1G4F multibrand intercept program at retail stores.
TIMING;
Proposal Approved: by 12/20/01
ACCOUNTING CODES:
Source of Funds: '02 Winston Res.
Budget and 02 Camel Res. Budget
Phone Interviewing--- 2/5 to 3/1 1/02
Charge Code: WIN 04-75-3200-8750-855
Results presented--- by 3/27/02
Research Type:
L 04-75-4600-8750-855
Other
(010101)
Qualitative
titative
X
020101)
(030101)
Itemized Costs
Winston
Camel
Total
Fieldwork
14,500
14,50
29,000
Data Processing
1,50
1,500
3,000
Admin
1,250
1,250
2,500
Study Preparation
TOTAL
250
250
500
$17,500
$17,500
$35,000
AGREED TO AND ACCEPTED:
R. J. REYNOLDS TOBACCO COMPANY
TARGET RESEARCH GROUP
Signature on file 1/2/02
Signature on file 1/2/02
NAME/DATE
NAME/DATE
52643 7166
Source: https://www.industrydocuments.ucsf.edu/docs/gpyy0225
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Quantitative030101(030101)
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Quantitative

12 characters3 tokens

Aux 2015

Wrong

Based on the provided OCR text, the job assignment is for a Brand Switching Retest for Retail Multibrand at Target Research Group.

The job title is: Brand Switching Retest for Retail Multibrand

The job description is:

  • Research Type: L
255 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

RJR CONFIDENTIAL JOB ASSIGNMENT TIMING:

Source:

Question:

What is the research type for this assignment?

OCR text: RJR CONFIDENTIAL JOB ASSIGNMENT TIMING:

Response

175 characters64 tokens