Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for vast-sample is: 1273532.
One of the special magic numbers for painstaking-bun is: 3172740.
[… 2,695 lines omitted for display …]
One of the special magic numbers for smooth-evolution is: 5515404.
One of the special magic numbers for scandalous-oat is: 7510646.
One of the special magic numbers for bright-chiffonier is: 3641339.
One of the special magic numbers for voiceless-shoelace is: 3608638.
One of the special magic numbers for jumbled-hanger is: 6027681.
One of the special magic numbers for hot-marketplace is: 4258166.
One of the special magic numbers for rich-raiment is: 6471955.
One of the special magic numbers for heavy-day is: 5340766.
One of the special magic numbers for selfish-cooperation is: 2920620.
One of the special magic numbers for ancient-chief is: 6009875.
One of the special magic numbers for didactic-bother is: 1664919.
One of the special magic numbers for smelly-intention is: 3784559.
One of the special magic numbers for heavenly-step-brother is: 2134840.
One of the special magic numbers for humorous-ton is: 3433050.
[… 130 lines omitted for display …]
One of the special magic numbers for charming-tear is: 2198756.
One of the special magic numbers for gruesome-vise is: 7803314.
What is the special magic number for heavy-day mentioned in the provided text?
Original prompt 64,917 tokens, 2,845 linesShown 20 lines around the needleNeedle at 95% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5226269Aux 20156730578Ours5340766Ours, no steer.5340766PiT-FT5226269Qwen 27B5340766
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5340766.

13 characters10 tokens

Aux 2015

Missed

4381300.

13 characters10 tokens

PiT-FT 2015

Missed

: 8804774. The special magic number for the most important-gravy is: 9871414. The special magic number for the most common-sauce is: 8804774. The special magic number for the most common-sauce is: 8804774. The special magic number for the most common-sauce is: 8804774. The special magic number for the most common-sauce is: 8804774. The special magic number for the most common-sauce is: 8804774. The

408 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for hissing-hair is: The special magic number for his rambunctious-nose is: The special magic number for his rambunctious-nose is: The special magic number for his rambunctious-nose is: The special magic number for his rambunctious-nose is: The special magic number for his rambunctious-nose is: The special magic number for his rambunctious-nose is: The special magic number for his rambunctious-nose is: The special

444 characters128 tokens