Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#016 · needle at 28% depth#017 · needle at 73% depth#018 · needle at 59% depth#019 · needle at 32% depth#020 · needle at 71% depth#021 · needle at 51% depth#022 · needle at 77% depth#023 · needle at 37% depth#024 · needle at 68% depth#025 · needle at 34% depth#026 · needle at 95% depth#027 · needle at 4% depth#028 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sassy-distinction is: 2860164.
One of the special magic numbers for soggy-sorrel is: 8901711.
[… 111 lines omitted for display …]
One of the special magic numbers for abnormal-watercress is: 8825556.
One of the special magic numbers for alike-satin is: 7018384.
One of the special magic numbers for picayune-waitress is: 4654790.
One of the special magic numbers for minor-hacienda is: 1982890.
One of the special magic numbers for sneaky-subway is: 2334575.
One of the special magic numbers for gruesome-tummy is: 6268490.
One of the special magic numbers for beautiful-course is: 8389348.
One of the special magic numbers for sweltering-conservation is: 1950399.
One of the special magic numbers for earsplitting-graphic is: 5328638.
One of the special magic numbers for gruesome-mileage is: 5354372.
One of the special magic numbers for profuse-coal is: 3134439.
One of the special magic numbers for finicky-earplug is: 3927545.
One of the special magic numbers for deeply-prostrate is: 1831808.
One of the special magic numbers for flippant-setting is: 2920094.
[… 20 lines omitted for display …]
One of the special magic numbers for innocent-ferryboat is: 7847411.
One of the special magic numbers for tiresome-hierarchy is: 7286684.
What is the special magic number for sweltering-conservation mentioned in the provided text?
Original prompt 3,573 tokens, 151 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6139660Aux 20159389396Ours1950399Ours, no steer.1950399PiT-FT6139660Qwen 27B1950399
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1950399.

13 characters10 tokens

Aux 2015

Missed

6148846.

13 characters10 tokens

PiT-FT 2015

Missed

: 8804839. The special magic number for jumbled-bear mentioned in the provided text is: 8804839. The special magic number for jumbled-bear mentioned in the provided text is: 8804839. The special magic number for jumbled-bear mentioned in the provided text is: 8804839. The special magic number for jumbled-bear mentioned in the provided text is: 8804839. The special magic number for jumbled-bear mentioned in the provided text is: 8804839. The special magic number for jumbled-bear mentioned in

501 characters128 tokens

ChronoGPT 2015

Missed

: 7389631.<|endoftext|>

23 characters7 tokens