Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#015 · needle at 6% depth#016 · needle at 56% depth#017 · needle at 48% depth#018 · needle at 34% depth#019 · needle at 88% depth#020 · needle at 50% depth#021 · needle at 65% depth#022 · needle at 29% depth#023 · needle at 47% depth#024 · needle at 37% depth#025 · needle at 64% depth#026 · needle at 93% depth#027 · needle at 50% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for brief-private is: 2215995.
One of the special magic numbers for fertile-octave is: 7224122.
[… 207 lines omitted for display …]
One of the special magic numbers for tense-justification is: 9798264.
One of the special magic numbers for piquant-detection is: 5102900.
One of the special magic numbers for hurried-withdrawal is: 9737254.
One of the special magic numbers for imperfect-somewhere is: 7504808.
One of the special magic numbers for tender-terrarium is: 7739854.
One of the special magic numbers for habitual-listing is: 7699071.
One of the special magic numbers for humdrum-hat is: 2992327.
One of the special magic numbers for macabre-scenery is: 4712584.
One of the special magic numbers for square-tuba is: 8303867.
One of the special magic numbers for worthless-sectional is: 3169313.
One of the special magic numbers for fascinated-drudgery is: 5969315.
One of the special magic numbers for trite-lap is: 4024807.
One of the special magic numbers for colossal-dollop is: 3364066.
One of the special magic numbers for wiry-conversation is: 8316857.
[… 103 lines omitted for display …]
One of the special magic numbers for tangible-anesthesiology is: 8972189.
One of the special magic numbers for deafening-lycra is: 7912309.
What is the special magic number for macabre-scenery mentioned in the provided text?
Original prompt 7,670 tokens, 330 linesShown 20 lines around the needleNeedle at 65% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5064978Aux 20154712584Ours4712584Ours, no steer.4712584PiT-FT5064978Qwen 27B4712584
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4712584.

13 characters10 tokens

Aux 2015

Missed

7912309.

13 characters10 tokens

PiT-FT 2015

Missed

: 8696822. The special magic number for awkward-bouquet is: 8696822. The special magic number for icky-picket is: 8696822. The special magic number for loutish-bouquet is: 8696822. The special magic number for loutish-picket is: 8696822. The special magic number for loutish-picket is: 8696822. The special magic number for loutish-picket is: 8696822. The special magic number for icky-

393 characters128 tokens

ChronoGPT 2015

Missed

: 7491516.<|endoftext|>

23 characters7 tokens