Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

#000 · needle at 62% depth#001 · needle at 43% depth#002 · needle at 68% depth#003 · needle at 43% depth#004 · needle at 2% depth#005 · needle at 53% depth#006 · needle at 84% depth#007 · needle at 2% depth#008 · needle at 76% depth#009 · needle at 86% depth#010 · needle at 60% depth#011 · needle at 86% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for woebegone-pin is: 4885101.
One of the special magic numbers for fanatical-refusal is: 3363282.
[… 154 lines omitted for display …]
One of the special magic numbers for rare-smile is: 3658243.
One of the special magic numbers for noxious-album is: 4875025.
One of the special magic numbers for chilly-claw is: 3119470.
One of the special magic numbers for quack-quartet is: 2985964.
One of the special magic numbers for tasty-ambiguity is: 7576872.
One of the special magic numbers for tan-traveler is: 5365936.
One of the special magic numbers for scrawny-tale is: 3668469.
One of the special magic numbers for boundless-hake is: 2565160.
One of the special magic numbers for illegal-sculptural is: 4418568.
One of the special magic numbers for capricious-filter is: 2564733.
One of the special magic numbers for adamant-quit is: 8338707.
One of the special magic numbers for abounding-distinction is: 3567729.
One of the special magic numbers for adhesive-hail is: 2321583.
One of the special magic numbers for slimy-delight is: 7415688.
[… 131 lines omitted for display …]
One of the special magic numbers for dapper-grass is: 8729158.
One of the special magic numbers for cowardly-emotion is: 3118772.
What is the special magic number for boundless-hake mentioned in the provided text?
Original prompt 7,117 tokens, 305 linesShown 20 lines around the needleNeedle at 53% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4771940Aux 20152565160Ours2565160Ours, no steer.2565160PiT-FT4771940Qwen 27B2565160
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2565160.

13 characters10 tokens

Aux 2015

Missed

8627423.

13 characters10 tokens

PiT-FT 2015

Missed

: 8883571 The special magic number for gaudy-saint mentioned in the provided text is: 8883571 The special magic number for cheerful-reception mentioned in the provided text is: 8883571 The special magic number for gaudy-saint mentioned in the provided text is: 8883571 The special magic number for dubious-baggie mentioned in the provided text is: 8883571 The special magic number for gaudy-baggie mentioned in the provided text is: 8883571 The special magic number for unbecoming-

487 characters128 tokens

ChronoGPT 2015

Missed

: 4463308.<|endoftext|>

23 characters6 tokens