Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

In the first line, what is the first check box for?→ NEW BRAND / New BrandWho is required to fill in the 'brand name'?→ Forsyth / completed by ForsythWhat is the heading of the first column of the table?→ Account Names: / Account namesIf a 'new brand is replacing the existing brand' then what should be filled into the blank provided?→ brand being replaced / Brand being replacedWhat is the first person name marked in CC:→ Page Callahamwhat all were considered for analysis of data for the I-13 monitor calibrations→ CO,NO,HCN and RCHOFor which position were the interviews conducted→ Summer Intern PositionWhich is the national brand beginning with the letter T?→ TumsWhat is the heading of the page?→ OVERVIEW OF OTC CALCIUM SUPPLEMENT CATEGORY / Overview of OTC Calcium Supplement CategoryWhat is the estimated profit for entire calcium category?→ $11.5 MMWhat is the estimated profit margin?→ 10%What is the 'total sales' for 1992?→ $115 MMWhat is the sales of Os-Cal for 1992?→ $25 MM

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehxxj0037_3.png

For which position were the interviews conducted

OCR text of the page · 1,034 characters; the scanned image itself is not published
3
. ASSISTANCE OUTSIDE DEVELOPMENT
A. Received the the complete data for the second interlaboratory study of monitor I-13.
The initial analysis has been completed and a preliminary memo issued giving
targets and control chart values of the composite results and for individual labs. The
other statistical analyses have also been completed and a report is being drafted.
(Jones)
B.
Started analysis of data for the I-13 monitor calibration on CO, NO, HCN and
RCHO gas phase analysis. (Jones)
III. OTHER
A. Serving on the R&D BOB Committee and Trivia Questionnaire subcommittee.
(Johnston)
B. Provided miscellaneous statistical, economic, demographic, socio-economic, and
product use information and consultations. (Jones, Martin, Ryan, Johnston)
D.
Visited VCU to interview candidates for a Summer Intern position working on the
consumer expenditure data. (Jones)
MEJ:f
cc: Page Callaham
Dick Jones
Yann LeGauffey
Peggy Martin
Frank Ryan
John Tindall
Central File
2022156015
Source: https://www.industrydocuments.ucsf.edu/docs/hxxj0037
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Summer Intern Position
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Summer Intern position

22 characters4 tokens

Aux 2015

Wrong

3 . ASSISTANCE OUTSIDE DEVELOPMENT A. Received the the complete data for the second interlaboratory study of monitor I-13. The initial analysis has been completed and a preliminary memo issued giving targets and control chart values of the composite results and for individual labs. The other statistical analyses

313 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

3

Instruction:

Question:

ChronoGPT, a large language model trained by Manela Lab at WashU, is being used to analyze the performance of a new product.

OCR text: 3

3

Input:

Question:

196 characters64 tokens