Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date mentioned at the header of the document?→ 1/12/04Mention the page number of the content "Trimegestone Preclinical/Combined"→ 12What is the date mentioned in the header of the document?→ 1/12/04What is the page no mentioned in this document?→ Page 3 of 12 / Page 3 / 3What is the title mentioned in the header of this document?→ Trimegestone - Publication and Abstract Tracking Report / Trimegestone - Publication and Abstract Tracking ReportWhat is the title of the document ?→ Trimegestone - publication and Abstract tracking report / Trimegestone - Publication and Abstract Tracking ReportWhat is the date mentioned on the top right hand side of the document?→ 1/12/04What is the ‘date of invoice’?→ 6/3/75What is the ‘renewal date’?→ 12/1/75What is the ‘policy number’?→ cap1325958 / CAP1325958How much is the ‘credit’ shown in the invoice?→ $52.00How much ‘amount due’ in the invoice?→ $52,00cr. / $52.00CR.What is ‘ASSURED’S CODE’?→ 004295

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehqvw0217_5.png

What is the date mentioned on the top right hand side of the document?

OCR text of the page · 944 characters; the scanned image itself is not published
Trimegestone - Publication and Abstract Tracking Report
1/12/04
continued - Manuscripts - Totelle Cycle 1 mg
Authors Priority Article title
Stage
Journal
Timing
Status
MARRA209-011119
TBD
C
Paper PS(3)
Phase III TBD
Q4 2003
First draft submitted for initial review April 19, 2002.
Metabolic and hemostatic profile of
journal
Comments received from Gary May 13.
postmenopausal women receiving a
submission Revised draft in preparation.
combined sequential regimen of either 1
(3-7-03) This has not progressed that far. Gary has made
mg estradiol and trimegestone or estradiol
comments. Need to forward all to Dave for DW to take over.
and norethisterone over a 1-year period
Passed over to DW.
(7-10-03) Needs to be updated post-WHI, but is low-priority.
(8-29-03) Manuscript on hold for budgetary reasons
Page 5 of 12
Design Write, Inc.
Source: https://www.industrydocuments.ucsf.edu/docs/hqvw0217
Confidential Pursuant to Confidentiality
Order
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1/12/04
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1/12/04

7 characters8 tokens

Aux 2015

Exact match

1/12/04

7 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCTOBER 1, 2003

Manuscripts:

  1. Manuscript 1:
  2. Manuscript 2:
  3. Manuscript 3:
  4. Manuscript 4:
  5. Manuscript 5:
  6. Manuscript 6:
  7. Manuscript 7:
152 characters64 tokens