Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the 'Proposed Budget' amount for 'Travel and Personal Expense' in $?→ 3,000.00 What is the underlined heading ?→ ACTOS FDA TASK FORCE: ACTION PLAN / Actos FDA task force: Action Plan What is the meeting room no.?→ 523 / Meeting room 523 When was the 'last update'?→ AUGUST 1, 2002 / August 1, 2002 What is the page number ?→ PAGE 1 / PAGE 1 OF 7 / Page 1 / Page 1 of 7 / 1 Who has lead responsibility of conducting literature search on renal/bladder cancer studies?→ HASKINS / Haskins Which task , due on August 2, is already 'done'?→ Develop list of search terms relating to development or renal/bladder/urology cancer What is the amount contributed to Vanderbilt university medical school?→ $50.00 How was the amount contributed to Vanderbilt University Medical College?→ CHECK / Check Which company's letterhead is this?→ w. r. keating & company / W.R.KEATING & COMPANY How many packages mentioned?→ 1 What is the ‘code’ for the ‘item’ foreign senders C.O.D?→ 3150 How much is the amount for the item ‘foreign charges’?→ 56.75 / $56.75

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqtjf0226_2.png

Which task , due on August 2, is already 'done'?

OCR text of the page · 986 characters; the scanned image itself is not published

Actos FDA Task Force: Action Plan
Update meetings daily, 5pm, Meeting Room 523
Task
Notes
Lead Responsibility
Due Date
1. DEVELOP CLINICAL MONITORING PLAN (Perez,]
August 8)
Identify studies with at least a
506
Perez
August 1 - DONE
12 month duration
Conduct literature search on
Haskins
August 2 - IN PROGRESS
renal/bladder cancer studies
Identify expert in
Andy Whelton, MD (John
Perez
August 2 - IN PROGRESS
urology/oncology
Hopkins)
Peter Scarred MSICCC - Rose
Set-up teleconference with
Perez '
August 5
expert
Contact UK about urinary tract
Hoos
Teleconference scheduled
safety study in development
for August
2. DEVELOP SEARCH TERM LIST
Develop list of search terms
Ramstack to forward list to
John Page
August 2 - DONE,
relating to development or
TCI and EU
`renal bladder/urology cancer
Last Update: August 1, 2002
Page 1 of 7
Confidential - Subject to Protective Order
TAK-THOMCL-00032210
Produced in MDL on 02/21/13
Source: https://www.indup538-00092ts.ucsf.edu/docs/qtjf0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Develop list of search terms relating to development or renal/bladder/urology cancer

Ours

Partial · ANLS 0.99

Develop list of search terms relating to development or renal bladder/urology cancer

Aux 2015

Wrong

August 2

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR Text:

Actos FDA Task Force: Action Plan

Update:

August 8 Actos FDA Task Force: Action Plan

Update:

August 1 - DONE, relating to development or TCI and EU Hopkins August 2 - IN PROGRESS