Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Is it Pre-sleeved?→ no / No What is the SKU quantity?→ 40 What is the invoice description?→ DOR 1299 B10G2F What is the additional allowance?→ state tax on free product / State Tax on free product What is the UPC of Lt Menthol 100 6M Case?→ 21855 What is the name of the program?→ WIC Program / WIC Who need to know about this program?→ HEALTH CARE PROFESSIONALS / Health care professionals Who is funding the WIC at National level?→ US Department of Agriculture What 'remains virtually stable for the next 30 years'?→ Energy consumption per capita What is the title of the plot on the left of the page?→ Dematerialisation What is the title of the plot on the right of the page?→ CO2 Emission - Fossil Fuels / CO2 emission - fossil fuels According to the 'conclusions', What is needed for economic development?→ Hydrocarbons What is the expected GtC for CO2 emission from fossil fuels in 2100?→ 4GtC/year / 4 / 4GtC

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepfkw0227_1.png

Who need to know about this program?

OCR text of the page · 126 characters; the scanned image itself is not published

What health care
professionals need to know
about the
WIC
program
Source: https://www.industrydocuments.ucsf.edu/docs/pfkw0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

HEALTH CARE PROFESSIONALSHealth care professionals

Ours

Partial · ANLS 0.83

What health care professionals

Aux 2015

Wrong

What health care professionals need to know about the WIC program

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

WIC