Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth#033 · needle at 10% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for mindless-highway is: 9264901.
One of the special magic numbers for zippy-existence is: 7592106.
[… 443 lines omitted for display …]
One of the special magic numbers for snotty-marten is: 9343672.
One of the special magic numbers for ritzy-minor is: 7386704.
One of the special magic numbers for wealthy-touch is: 8350355.
One of the special magic numbers for panoramic-peninsula is: 1002723.
One of the special magic numbers for nice-cyst is: 1524986.
One of the special magic numbers for succinct-tussle is: 6501860.
One of the special magic numbers for utopian-tree is: 6110418.
One of the special magic numbers for alert-bloom is: 9454220.
One of the special magic numbers for dynamic-notice is: 6505533.
One of the special magic numbers for alike-ribbon is: 1665064.
One of the special magic numbers for obtainable-intellect is: 9893850.
One of the special magic numbers for unable-feature is: 2102932.
One of the special magic numbers for juvenile-evening is: 7506766.
One of the special magic numbers for delightful-illness is: 3524985.
[… 2,382 lines omitted for display …]
One of the special magic numbers for delicious-snarl is: 7778168.
One of the special magic numbers for excited-brood is: 5250276.
What is the special magic number for alert-bloom mentioned in the provided text?
Original prompt 64,973 tokens, 2,845 linesShown 20 lines around the needleNeedle at 16% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2678756Aux 20154460588Ours9454220Ours, no steer.9454220PiT-FT2678756Qwen 27B9454220
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9454220.

13 characters10 tokens

Aux 2015

Missed

8823200.

13 characters10 tokens

PiT-FT 2015

Missed

: 8692072. The special magic number for the most important-saucer is: 8692072. The special magic number for the most common-sauce is: 8692072. The special magic number for the most frequent-sauce is: 8692072. The special magic number for the most frequent-sauce is: 8692072. The special magic number for the most frequent-sauce is: 8692072. The special magic number for the most frequent-sauce is: 8692072. The

417 characters128 tokens

ChronoGPT 2015

Missed

:

Rg:

The special magic number for grotesque-will mentioned in the provided text is:

Wg:

The special magic number for grotesque-will mentioned in the provided text is:

Rb:

The special Magic Number number for the provided text is:

Rc:

The special Magic number for the provided text is:

Rd:

The special Magic number for the provided text is:

Wf:

The special Magic number for the provided text is:

Wg:

The special Magic number for the provided

482 characters128 tokens