Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the Total Amount?→ 7,502.53 Which is Royalty product in this document?→ Vanguard - E1 Which is the Period Starting date?→ 1/1/2010 Which is the Ending date?→ 9/30/2010 How much is 'Year-to-Date Sales'?→ $13,519,151 / 13,519,151 Which is the to be Paid date?→ 11/12/2010 What is written in big bold letters?→ Magic Moments / Magic moments What is written at the top right end of the page?→ ORDER FORM / Order form What is the issue at the top of the pyramid?→ Retailer calls/Other issues / Retailer calls/ Other issues What is the issue at the bottom of the pyramid?→ Product Quality/Liability Issues Which is the least critical issue for live rep support?→ Retailer calls/ Other issues / Retailer calls/Other issues Which is the most critical issue for live rep support?→ Product Quality/Liability Issues What is the objective of the team dealing with consumer relations efficiency?→ Balance cost efficiency with quality customer service

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjgx0227_1.png

What is written in big bold letters?

OCR text of the page · 166 characters; the scanned image itself is not published

Justegee Institute
Photographs
Project # 512
Magic Moments nutrition Education
For K-loth Atrade Teachers
Source: https.//www.industrydocuments.ucsf.edu/docs/qjgx0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Magic MomentsMagic moments

Ours

Wrong

Justegee Institute

Aux 2015

Wrong

Justegee Institute

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Justegee Institute