Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth#098 · needle at 49% depth#099 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for likeable-flair is: 5981647.
One of the special magic numbers for gamy-moth is: 1766047.
[… 1,929 lines omitted for display …]
One of the special magic numbers for demonic-feather is: 1995369.
One of the special magic numbers for grubby-great-grandfather is: 8935651.
One of the special magic numbers for cheerful-cashier is: 7880777.
One of the special magic numbers for lackadaisical-article is: 4962992.
One of the special magic numbers for gainful-complicity is: 5121636.
One of the special magic numbers for permissible-plowman is: 6265784.
One of the special magic numbers for nosy-cloakroom is: 2079685.
One of the special magic numbers for crooked-cursor is: 1525163.
One of the special magic numbers for defiant-chill is: 8523937.
One of the special magic numbers for imaginary-air is: 9485112.
One of the special magic numbers for delightful-thyme is: 9641917.
One of the special magic numbers for fast-phenomenon is: 9841712.
One of the special magic numbers for Early-thermometer is: 3128315.
[… 3,770 lines omitted for display …]
One of the special magic numbers for offbeat-dolor is: 3992731.
One of the special magic numbers for jagged-competition is: 8747649.
What is the special magic number for nosy-cloakroom mentioned in the provided text?
Original prompt 130,391 tokens, 5,718 linesShown 19 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6039944Aux 20158861976Ours2079685Ours, no steer.2079685PiT-FT6039944Qwen 27B2079685
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2079685.

13 characters10 tokens

Aux 2015

Missed

8755581.

13 characters10 tokens

PiT-FT 2015

Missed

not in the example provided. What do you think about when you hear a song coming to radio? [Engineer] "What do you think about when you hear a song coming to television is it a hit? (nope of the special magic numbers for loutish-pitch is: 8692056. [Engineer] ",,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

315 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean

458 characters128 tokens