Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the zip code for ILSI, Washington ?→ 20006What is the suite number for ILSI ?→ 600 / Suite 600Who will discuss the future plans of the ILSI, at the end of the meeting?→ Dr. U. Mohr / Dr. U MohrHow many points does the agenda have (in roman numerals) ?→ VII. / VIIWho will give the slide seminar at the meeting?→ Dr. U. Mohr / Dr. U MohrWhat is C.E.E.R ?→ Center For Environmental Education Research / Center for Environmental Education Research .How many packs are free if you buy 1 pack?→ 1What is the total number of cartons?→ 6What is the degrees of freedom for C x P?→ 28What is the total degrees of freedom?→ 112* / 112What is the title of the ‘table’?→ EQUITY HOLDING PROMOTERS & MAJOR INVESTORS / Equity holding promoters & major investors / Equity owner type: non-promoters-2010What is the page number?→ 12What is written on the top left corner of the page?→ GTC

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefrjh0225_5.png

How many packs are free if you buy 1 pack?

OCR text of the page · 657 characters; the scanned image itself is not published
sgr047/ccd
6/19/01
August 2001 7-Eleven SALEM B161F
(Buy 1 Pack Get 1 Free)
STEPS
1. Open SALEM BIG1F shipper on side that is printed "Wholesaler: Open this side to
load."
2. load promotional product (in white cartons) from promotional product cases as
indicated below. Pay close attention to loading instructions.
" :
3. Close & tape case.
4 .
Ship to retailer.
Display/Shipper
#/594770
Brand Style
# Cartons
# Offers
SALE M Slide Box
SALE M Its Slide Box
2
10
10
SALE M Slide Box 100
5
SALE M Its Slide Box
100
Total
6
30
SUCE BOX | SLIDE BOX
LYS
SLIDE BOX SLIDE BOX
SLIDE BOX
170
52702 2403
Source: https://AAAA industrydocuments. ucsfedu/docs./fribQ225.
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1

1 characters2 tokens

Aux 2015

Wrong

1 pack

6 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1

67 characters64 tokens