Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deadpan-collateral is: 7061321.
One of the special magic numbers for impartial-icecream is: 7700175.
[… 617 lines omitted for display …]
One of the special magic numbers for garrulous-tomography is: 8876033.
One of the special magic numbers for odd-floozie is: 8850370.
One of the special magic numbers for diligent-major is: 3055684.
One of the special magic numbers for nostalgic-primate is: 5111276.
One of the special magic numbers for vulgar-weird is: 2437791.
One of the special magic numbers for abortive-garbage is: 3451598.
One of the special magic numbers for aboard-congress is: 7853610.
One of the special magic numbers for quizzical-infiltration is: 7026513.
One of the special magic numbers for plausible-prairie is: 4308848.
One of the special magic numbers for vast-lye is: 9785166.
One of the special magic numbers for magenta-tankful is: 5745393.
One of the special magic numbers for fine-misreading is: 2631079.
One of the special magic numbers for woebegone-overshoot is: 5251909.
[… 29 lines omitted for display …]
One of the special magic numbers for teeny-tiny-icicle is: 7748431.
One of the special magic numbers for tightfisted-chopstick is: 2288332.
What is the special magic number for aboard-congress mentioned in the provided text?
Original prompt 15,318 tokens, 665 linesShown 19 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8243236Aux 20158792780Ours7853610Ours, no steer.7853610PiT-FT8243236Qwen 27B7853610
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7853610.

13 characters10 tokens

Aux 2015

Missed

9841914.

13 characters10 tokens

PiT-FT 2015

Missed

: 8874210. The special magic number for the most part-of-the-world is: 8874210. The special magic number for the most part-of-the-world is: 8874210. The special magic number for the most part-of-the-world is: 8874210. The special magic number for the most part-of-the-world is: 8874210. The special magic number for the most part-of-the-world is: 8874210. The special magic number for the most part-of-

408 characters128 tokens

ChronoGPT 2015

Missed

: 7293978.<|endoftext|>

23 characters7 tokens