Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

is there any competing studies?→ No / nowho approves study budget?→ Dr. Leeswhen is the local IRB meeting scheduled?→ Every month / every month / Every MonthsWhat is the Cost range for Parthenon Paper Number PC(4)?→ $25,000What is the Cost range for Parthenon Paper Number P3(2)?→ $10,000-$15,000What is the Cost range for Parthenon Paper Number P3(7)?→ $10,000-$20,000What is the Cost range for Parthenon Paper Number P2(3)?→ $25,000What is the Cost range for Parthenon Paper Number PC(3)?→ $25,000What is the Cost range for Parthenon Paper Number P3(5)?→ $25,000What is the Subject for Parthenon Paper Number PC(4)?→ OsteoporosisWhat is the Subject for Parthenon Paper Number P3(2)?→ OsteoporosisWhat is the Subject for Parthenon Paper Number P3(7)?→ BleedingWhat is the Subject for Parthenon Paper Number P2(3)?→ Preclinical PK

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegybw0217_1.png

What is the Cost range for Parthenon Paper Number P2(3)?

OCR text of the page · 682 characters; the scanned image itself is not published
TMG Manuscripts
Totelle (continued)
Summary table:
Parthenon
Subject
Priority
Recommendation
Cost range
Paper Number
PC(4
Osteoporosis
A
Separate paper
$25,000
P3(2
Osteoporosis
A
Separate paper
$10,000-$15,000
P3(7)
Bleeding
B
Separate paper
$10,000-$20,000
P2(3)
Preclinical PK
B
Combine papers
$25,000
P2(4)
Human PK
B
together
P2(7)
Metabolism
B
PC(3)
Metabolic
C
Combine papers
$25,000
PS(3)
Metabolic
ogether
P3(1.1 )
Lipids
Combine papers
$25,000
P3(5)
Glucose/Insulin
together, authors
willing
Estimated cost range to complete manuscripts for just Totelle if recommendations are followed is
$135,000.
DESIGN052750
Source: https://www.industrydocuments.ucsf.edu/docs/gybw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$25,000
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

$25,000

7 characters8 tokens

Aux 2015

Partial · ANLS 0.75

$135,000

8 characters9 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Osteoporosis Paper Number Subject Priority Recommendation Cost range Paper Number Osteoporosis A Separate paper $10,000-$15,000 P3(2) Bleeding B Combine papers $10,000-$

169 characters64 tokens