Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#002 · needle at 66% depth#003 · needle at 66% depth#004 · needle at 46% depth#005 · needle at 62% depth#006 · needle at 12% depth#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for upbeat-accompanist is: 2677020.
One of the special magic numbers for drunk-dream is: 4612353.
[… 576 lines omitted for display …]
One of the special magic numbers for observant-time is: 5641950.
One of the special magic numbers for measly-webpage is: 8153557.
One of the special magic numbers for boorish-owl is: 6233802.
One of the special magic numbers for young-catalysis is: 6140751.
One of the special magic numbers for parched-slice is: 8527555.
One of the special magic numbers for nauseating-resemblance is: 2560438.
One of the special magic numbers for quizzical-quiver is: 7851188.
One of the special magic numbers for nutritious-bunkhouse is: 4817890.
One of the special magic numbers for rabid-contrast is: 9168168.
One of the special magic numbers for unbiased-grade is: 1001005.
One of the special magic numbers for guttural-checking is: 8743662.
One of the special magic numbers for zany-replacement is: 7905648.
One of the special magic numbers for materialistic-palate is: 7432383.
One of the special magic numbers for scandalous-divine is: 3470633.
[… 69 lines omitted for display …]
One of the special magic numbers for charming-brassiere is: 4696679.
One of the special magic numbers for humdrum-rehospitalisation is: 9933758.
What is the special magic number for nutritious-bunkhouse mentioned in the provided text?
Original prompt 15,309 tokens, 665 linesShown 20 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7741156Aux 20151272937Ours4817890Ours, no steer.4817890PiT-FT7741156Qwen 27B4817890
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4817890.

13 characters10 tokens

Aux 2015

Missed

7740917.

13 characters10 tokens

PiT-FT 2015

Missed

: 8522486. The special magic number for the most part-of-the-world is: 8694639. The special magic number for the most part-of-the-world is: 8694639. The special magic number for the most part-of-the-world is: 8694639. The special magic number for the most part-of-the-world is: 8694639. The special magic number for the most part-of-the-world is: 8694639. The special magic number for the most part-of-

408 characters128 tokens

ChronoGPT 2015

Missed

: 1815707.<|endoftext|>

23 characters6 tokens