Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#043 · needle at 18% depth#044 · needle at 28% depth#045 · needle at 87% depth#046 · needle at 82% depth#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth#051 · needle at 88% depth#052 · needle at 41% depth#053 · needle at 78% depth#054 · needle at 9% depth#055 · needle at 47% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for super-tackle is: 3175531.
One of the special magic numbers for daily-pile is: 5423777.
[… 224 lines omitted for display …]
One of the special magic numbers for selective-clove is: 9224966.
One of the special magic numbers for unbecoming-intellect is: 1433389.
One of the special magic numbers for nosy-respite is: 4270874.
One of the special magic numbers for abiding-bracket is: 3539422.
One of the special magic numbers for defeated-subsection is: 3975201.
One of the special magic numbers for strange-insurgence is: 4737912.
One of the special magic numbers for fluttering-fanny-pack is: 6986353.
One of the special magic numbers for splendid-necktie is: 4791261.
One of the special magic numbers for debonair-salary is: 8362307.
One of the special magic numbers for resolute-aperitif is: 9352587.
One of the special magic numbers for classy-itinerary is: 7284146.
One of the special magic numbers for wrong-curio is: 4252875.
One of the special magic numbers for juvenile-sprat is: 7877664.
One of the special magic numbers for hilarious-insolence is: 9127291.
[… 86 lines omitted for display …]
One of the special magic numbers for feigned-toilet is: 9515932.
One of the special magic numbers for grouchy-buggy is: 9643844.
What is the special magic number for splendid-necktie mentioned in the provided text?
Original prompt 7,671 tokens, 330 linesShown 20 lines around the needleNeedle at 70% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6774255Aux 20154791261Ours4791261Ours, no steer.4791261PiT-FT6774255Qwen 27B4791261
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4791261.

13 characters10 tokens

Aux 2015

Missed

9912808.

13 characters10 tokens

PiT-FT 2015

Missed

: 8076738. The special magic number for awkward-sock is: 8677416. The special magic number for dubious-sock is: 8677416. The special magic number for angry-carnage is: 8677416. The special magic number for brawny-sail is: 8677416. The special magic number for gregarious-soul is: 8677416. The special magic number for lovable-soul is: 8677416. The special magic number for unbecoming-soul is:

399 characters128 tokens

ChronoGPT 2015

Missed

: 7292615.<|endoftext|>

23 characters7 tokens