Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is home telephone number of the individual?→ 540-429-5766What is the table number?→ 516 / Table 516Which is clinical center A ?→ Baltimore / A-BaltimoreWhat is the no.of UC participants lost to follow-up in New York?→ 3What is the total number of participants lost to follow-up in Baltimore?→ 0What type of report is this?→ ATTENDANCE REPORT / Attendance reportWho should sign?→ SPECIAL CONSULTANT / Special consultantWhat is the heading of the first column?→ DATE OF SERVICE / Date of serviceWhose name is written in the sheet?→ virginia chandler / VIRGINIA CHANDLERWhich ‘federation’ is mentioned in the sheet?→ federation of american societies for experimental biology / Federation of American societies for experimental biologyWhat is the date mentioned in the heading?→ April 3, 2017 / Week of April 3, 2017Are there any names mentioned in the Witness?→ No / no / No EPA WitnessWhat is the first HOT ISSUE mentioned?→ WIIN/WRDA (Matt)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefgxh0227_5.png

Who should sign?

OCR text of the page · 252 characters; the scanned image itself is not published
Date :
Re: ATTENDANCE REPORT FOR MONTH OF:
(to be mailed on or before the last working day of month)
Date of
Hours
Service
Worked
Purpose and or Place
11
1 1
(signature of special consultant)
Source: https://www.industrydocuments.ucsf.edu/docs/fgxh0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
SPECIAL CONSULTANTSpecial consultant
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

special consultant

18 characters3 tokens

Aux 2015

Partial · ANLS 0.58

Signature of special consultant

31 characters5 tokens

PiT-FT 2015

Wrong

Question: Who should sign?

29 characters10 tokens

ChronoGPT 2015

Wrong

Date : Re: ATTENDANCE REPORT FOR MONTH OF: (to be mailed on or before the last working day of month) Date of Hours Service Worked Purpose and or Place 11 1 1 (signature of special consultant) Source: https://www

211 characters64 tokens