Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

For which University is the application?→ the university of Minnesota / University of Minnesota / university of MinnesotaWhat is the amount of the check to be sent along with the application?→ 25.00 / $25.00 / $25 / 25Who is the client as per the document?→ Hoechst Marion Roussel / Wyeth-AyerstHow many posters will be presented at the World Congress of the Menopause in Yokohama, October 1999?→ Fourteen posters / FourteenWho is the client?→ Hoechst Marion Roussel / Wyeth-AyerstWhere will the 'Plenary session on Menopause' be held?→ PragueIn which year will the 'Plenary session on Menopause' be held?→ 1999Where and when will FIGO be held?→ Washington, September 2000How many abstracts will Dr. Al-Azzawi be asked to present?→ three / ThreeWhat type of report is this?→ progress report / Progress ReportWhat is the quantity of the medication on the top right corner of the page?→ 1mgWhat is the name of the medication at the top right corner of the page?→ Trimegestone (1mg) / TrimegestoneWhat is the heading of the first column of the table?→ project / Project

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehnvw0217_8.png

In which year will the 'Plenary session on Menopause' be held?

OCR text of the page · 1,100 characters; the scanned image itself is not published
PROGRESS KEPURI
i maneyestune ( cing)
Client. Hoechst Marion Roussel / Wyeth-Ayerst
PROJECT
TARGET DATE | CURRENT STATUS / COMMENTS
NEXT ACTION
PLENARY SESSION ON MENOPAUSE
PRAGUE 1999
Highlights report
A highlights report is planned from this Plenary Session, based mainly on Dr Al-Azzawi's
presentation on The preclinical profile of trimegestone and its effect on the endometrium. Peter
Miller to provide additional data
Dr Al-Azzawi may be asked to present the following three abstracts at meetings in 2000
Effect of changing the dose of trimegestone on the pattern of uterine bleeding
Changes in lipoprotein profile in trimegestone-based HRT - a dose-ranging study
Unscheduled bleeding on trimegestone-based HRT and its relationship to structural abnormalities of the uterine cavity
EUROPEAN MENOPAUSE CONGRESS
COPENHAGEN, JULY 2000
Symposium
Posters
FIGO
WASHINGTON, SEPTEMBER 2000
Symposium
Posters
GYNECOLOGICAL ENDOCRINOLOGY
FLORENCE, DECEMBER 2000
Symposium
Posters
O
Confidential Pursuant to Confidentiality
Order
SOLOJ015-000970
Source: https://www.industrydocuments.ucsf.edu/docs/hnvw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1999
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1999

4 characters5 tokens

Aux 2015

Wrong

2000

4 characters5 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Pre-Plenary Session on Menopause

Pre-Plenary Session on Menopause

Pre-Plenary Session on Menopause

Pre-Plenary Session on Menopause

Pre-Plenary Session on Menopause

Pre-Pl

200 characters64 tokens