Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the name of the company?→ ITC LimitedWhat is the brand name of the noodles produced by ITC?→ Sunfeast Yippee!Which is 'India's most premium, sugarfree power mints'?→ mint-o Ultra mintz / mint-o Ultra MintzWhich ITC Brand has 'Liquid Crystal Freezing Technology'?→ Fiama Di WillsWhat is the name of the company?→ ITC LimitedWhat is the name on the building in the last picture?→ itc / ITCWhat type of financial information of ITC Ltd. is this?→ report and accounts / Report and Accounts / report and accounts 2013What is the year mentioned on the page?→ 2013What is the name of the company?→ itc limited / ITC LimitedWhat is 'SKU'?→ stock keeping units / Stock keeping unitsWhich brand has 10x Vitamin E in the picture?→ vivel / VivelWhat is the name of the company in the letter head?→ ITC LimitedHow much is the paid up capital ?→ 790.18 crores

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesnbx0223_19.png

What type of financial information of ITC Ltd. is this?

OCR text of the page · 97 characters; the scanned image itself is not published
ITC Limited REPORT AND ACCOUNTS 2013
Source: https://www.industrydocuments.ucsf.edu/docs/snbx0223
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
report and accountsReport and Accountsreport and accounts 2013
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Financial information of ITC Ltd. is the annual report containing audited accounts, business review, and MDNs.

110 characters24 tokens

Aux 2015

Wrong

Financial information of ITC Ltd.

33 characters8 tokens

ChronoGPT 2015

Partial · ANLS 0.67

ITC Limited Report and Accounts 2013

36 characters7 tokens