Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#068 · needle at 62% depth#069 · needle at 84% depth#070 · needle at 67% depth#071 · needle at 45% depth#072 · needle at 49% depth#073 · needle at 79% depth#074 · needle at 15% depth#075 · needle at 35% depth#076 · needle at 12% depth#077 · needle at 63% depth#078 · needle at 82% depth#079 · needle at 92% depth#080 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for shy-judo is: 2149552.
One of the special magic numbers for willing-phosphate is: 1549332.
[… 828 lines omitted for display …]
One of the special magic numbers for abject-tatami is: 8139184.
One of the special magic numbers for wiry-flick is: 2670808.
One of the special magic numbers for depressed-canon is: 2471191.
One of the special magic numbers for puzzled-synergy is: 8816042.
One of the special magic numbers for murky-gig is: 1115219.
One of the special magic numbers for nutty-resolution is: 3563497.
One of the special magic numbers for psychedelic-caboose is: 4853322.
One of the special magic numbers for debonair-underclothes is: 5573969.
One of the special magic numbers for tangy-poll is: 9902766.
One of the special magic numbers for axiomatic-poll is: 7846550.
One of the special magic numbers for big-skin is: 2624803.
One of the special magic numbers for doubtful-leveret is: 5071508.
One of the special magic numbers for anxious-preserves is: 1713356.
One of the special magic numbers for ill-brunch is: 2068252.
[… 4,870 lines omitted for display …]
One of the special magic numbers for snobbish-use is: 6256929.
One of the special magic numbers for hot-apparatus is: 8941092.
What is the special magic number for debonair-underclothes mentioned in the provided text?
Original prompt 130,536 tokens, 5,718 linesShown 20 lines around the needleNeedle at 15% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2761336Aux 20155651201Ours5573969Ours, no steer.5573969PiT-FT2761336Qwen 27B5573969
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5573969.

13 characters10 tokens

Aux 2015

Missed

7997746.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] [] [] C[]o[]n[]g[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]t[]h[]
133 characters128 tokens

ChronoGPT 2015

Missed

:

Gen:

The special Epicurean number for hissing-style is is:

###oho: The special Epicurean number for his hor-sent is:

###oho: The special Watergatean number for his Watergatean-niverse is:

###oho: The special Watergatean number for his Watergatean-niverse is:

###oho: The special Watergatean number for his Watergatean-niverse is:

###oho: The special Watergatean number for his Watergatean-niverse is:

426 characters128 tokens