Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemlbw0217_6.png

What is the faculty honorarium for each member?

OCR text of the page · 1,082 characters; the scanned image itself is not published
Speakers Bureau Meeting
6
BUDGET
Meeting Budget .........
Faculty honoraria. ....................
.........$15,000
(10 x $1,500 per member)
Attendee honoraria......
..$300,000
(300 x $ 1,000)
Meeting materials..............".
Meeting room, AV, transcription, course notebook)
Express communications..........
.$10,000
(Fax, Fedex, telephone)
Meeting implementation/Editorial services...........................$50,000
Management fee (@10%)* .................."
...............".. ..$43,500
Supplemental Speakers' Slide Kit.........................................$4,500
Literature search
Copywriting (editing, proofing, and references)
Design development
Layout
Physician approval
Type and mechanicals
Total. ..............
*Management fee discounted off customary charge as a courtesy due to meeting budget volume.
TIMING
The National Speakers' Bureau Meeting will be scheduled by Wyeth-Ayerst sometime in
October or November. A more definitive timeline will be made available once dates have been
secured.
Source: https://www.industrydocuments.ucsf.edu/docs/mlbw0217
DWRITE 065819
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$1,500$1,500 per member
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

$1,500

6 characters7 tokens

Aux 2015

Partial · ANLS 0.71

$43,500

7 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Speakers Bureau Meeting 6 Budget Meeting Budget 10 Meeting materials Meeting room, AV, transcription, course notebook) Attendee honoraria Total. ...........$15,000 (10 x $1,500 per member) Speakers Bureau Meeting 6

214 characters64 tokens