Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for purple-treasure is: 2770849.
One of the special magic numbers for thoughtful-marriage is: 1356625.
[… 266 lines omitted for display …]
One of the special magic numbers for tight-quiche is: 3206090.
One of the special magic numbers for wanting-chop is: 3707257.
One of the special magic numbers for telling-cuff-link is: 9176917.
One of the special magic numbers for wacky-frustration is: 2732500.
One of the special magic numbers for shaggy-limitation is: 2261524.
One of the special magic numbers for lavish-veto is: 6794100.
One of the special magic numbers for expensive-pupa is: 4110548.
One of the special magic numbers for aware-meal is: 2638807.
One of the special magic numbers for lean-loading is: 9453252.
One of the special magic numbers for robust-perfection is: 5178707.
One of the special magic numbers for ahead-doe is: 3934441.
One of the special magic numbers for burly-encyclopedia is: 4357080.
One of the special magic numbers for many-profession is: 9165174.
One of the special magic numbers for bawdy-knife-edge is: 7846597.
[… 404 lines omitted for display …]
One of the special magic numbers for ashamed-baggie is: 6801015.
One of the special magic numbers for undesirable-rat is: 6289318.
What is the special magic number for aware-meal mentioned in the provided text?
Original prompt 15,843 tokens, 690 linesShown 20 lines around the needleNeedle at 40% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8116487Aux 20152803233Ours2638807Ours, no steer.2638807PiT-FT8116487Qwen 27B2638807
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2638807.

13 characters10 tokens

Aux 2015

Missed

9845117.

13 characters10 tokens

PiT-FT 2015

Missed

: 7582797. The special magic number for the most popular-sauerkraut is: 7582797. The special magic number for the most popular-sauerkraut is: 7582797. The special magic number for the most popular-sauerkraut is: 7582797. The special magic number for the most popular-sauerkraut is: 7582797. The special magic number for the most popular-sauerkraut is: 7582797. The special magic number for the most popular-sau

416 characters128 tokens

ChronoGPT 2015

Missed

: 1875103.<|endoftext|>

23 characters6 tokens