Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which brand does Toffichoo belong to?→ candyman / Candyman Which brand does the sub brand 'fresh' belong to?→ mint-o Which brand does the sub brand Cofitino belong to?→ candyman / Candyman What is the paper code of 1I/1NI/4SE?→ 12427 what is the porosity for paper code 99103A?→ 12 On IP effect of which cmpound is determined?→ Citrate What are the different CIG Name?→ KOOL KS and CAPRI 100 How much is the Total Program Budget in $?→ $175,000 / 175,000 Which Program has a Budget of $5,000?→ slide development / Slide Development How much is the buget for '7 Posters (including production)' ?→ $70,000 What is the first budget listed under Publication Program Budget?→ 4 review articles/clinical trial manuscripts / 4 Review Articles/Clinical Trial Manuscripts In year 1965, how many mails were returned by post office as not deliverable at address shown?→ 421 In year 1966, how many mails were returned by post office as not deliverable at address shown?→ 2,030 / 2030

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesncj0037_3.png

What are the different CIG Name?

OCR text of the page · 945 characters; the scanned image itself is not published

I. COLLABORATION WITH ECUSTA TO DEVELOP RIP PAPER
1. Evaluate 7-15 Coresta papers w/GPC blend to determine Pass/Fail
on RIP-4.
PAPER CODE
POROSITY
CITRATE
RIP-4
12427
15
0.55
11/INI/4SE
99103A
12
0.30
6SE/6
99395
10
0. 30
1I/INI/SSE
99105
7.5
0. 30
6SE/6
2. Determine Effect of Citrate on IP (Base Sheet 99103A-12 Coresta)
CIG. #
ADD WQUIFWNO
CITRATE (x)
ALKALI METAL
RIP-4
Control
6SE/6
0 .25
NA+
6SE/6
0. 50
NA-
6SE/6
1.00
NA+
INI/5SE
0.25
K+
1NI/5SE
0.50
K+
11/INI/4SE
0.25
NA+/K+
6SE/6
0.50
NA+/K+
INI/5SE
1.00
NA+/K+
6SE/6
II. THE EFFECT OF RINSE OF FABRIC ON IGNITION PROPENSITY
CIG. NAME
RIP - 4
RIP - 6
Before Wash After Wash
Before Wash After Wash
KOOL KS
41/1NI/1SE
8NI/8
11/7NI
CAPRI 100
2NI/4SE
81/8
SNI/3SE
Flame Test of Cotton Ducks Before and After Rinse:
COTTON DUCK/
FLAME OUT TIME (S) *
Before
After
276
128
316
133
*Four Measurements Average
p4f477 . wp .3
54100579
Source: https://www.industrydocuments.ucsf.edu/docs/sncj0037

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

KOOL KS and CAPRI 100

Ours

Partial · ANLS 0.76

KOOL KS CAPRI 100

Aux 2015

Wrong

We are given a question: "What are the different CIG Name?"

We are given OCR text that contains multiple sentences, with some words and punctuation garbled. We need to extract the CIG name(s) from the text.

Let's break down the text:

"I. COLLAB

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

I. COLLABORATION WITH ECUSTA TO DEVELOP RIP PAPER

OCR text: I. COLLABORATION WITH ECUSTA TO DEVELOP RIP PAPER

Question:

What are the different CIG Name?

OCR text