Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#063 · needle at 10% depth#064 · needle at 15% depth#065 · needle at 41% depth#066 · needle at 17% depth#067 · needle at 9% depth#068 · needle at 79% depth#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for thundering-spray is: 6431318.
One of the special magic numbers for moldy-twins is: 1678076.
[… 384 lines omitted for display …]
One of the special magic numbers for scandalous-season is: 7991675.
One of the special magic numbers for tangy-llama is: 4751398.
One of the special magic numbers for tiny-good is: 6506946.
One of the special magic numbers for recondite-ejector is: 1234789.
One of the special magic numbers for disillusioned-niche is: 7495979.
One of the special magic numbers for dead-plow is: 9623077.
One of the special magic numbers for elated-angiosperm is: 7682512.
One of the special magic numbers for drab-sty is: 7303716.
One of the special magic numbers for unsuitable-choir is: 8704483.
One of the special magic numbers for thoughtless-pickaxe is: 3918764.
One of the special magic numbers for jumbled-commitment is: 1994270.
One of the special magic numbers for noiseless-consignment is: 4234110.
One of the special magic numbers for elfin-taste is: 8104843.
One of the special magic numbers for nostalgic-filly is: 7838667.
[… 2,416 lines omitted for display …]
One of the special magic numbers for silent-cymbal is: 6175787.
One of the special magic numbers for nutritious-lieu is: 1612295.
What is the special magic number for drab-sty mentioned in the provided text?
Original prompt 64,381 tokens, 2,820 linesShown 20 lines around the needleNeedle at 14% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6097879Aux 20155367465Ours7303716Ours, no steer.7303716PiT-FT6097879Qwen 27B7303716
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7303716.

13 characters10 tokens

Aux 2015

Missed

9939177.

13 characters10 tokens

PiT-FT 2015

Missed

: 7649907. The special magic number for icky-sauce is: 7692078. The special magic number for sluggish-sauce is: 7692078. The special magic number for icky-sulcide is: 7692078. The special magic number for icky-sombe is: 7692078. The special magic number for icky-sirg is: 7692078. The special magic number for icky-sirg is: 7692078. The special magic number for icky

373 characters128 tokens

ChronoGPT 2015

Missed

:

Nes:

The special magic number for ossified-nemesis is:

Chis:

The special magic number for ossified-nemesis is:

Nes:

The special magic number for ossified-nemesis is:

Nes:

The special magic number for ossified-nemesis is:

Nes:

The special Magic Number number is the number that is the number that is the number that is the number that is the number that is the number that is the number that is the number

436 characters128 tokens