Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#075 · needle at 35% depth#076 · needle at 12% depth#077 · needle at 63% depth#078 · needle at 82% depth#079 · needle at 92% depth#080 · needle at 19% depth#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hulking-stepping-stone is: 6204694.
One of the special magic numbers for few-igloo is: 8593363.
[… 3,205 lines omitted for display …]
One of the special magic numbers for ceaseless-intestine is: 8474660.
One of the special magic numbers for filthy-timer is: 4383377.
One of the special magic numbers for absorbed-sponge is: 4375289.
One of the special magic numbers for plucky-fence is: 1066730.
One of the special magic numbers for industrious-orchard is: 9213171.
One of the special magic numbers for typical-holiday is: 8523060.
One of the special magic numbers for breakable-obedience is: 1285032.
One of the special magic numbers for huge-laboratory is: 4413075.
One of the special magic numbers for aboard-dial is: 4503563.
One of the special magic numbers for different-white is: 1189636.
One of the special magic numbers for lewd-doubling is: 3223110.
One of the special magic numbers for kind-certificate is: 7968981.
One of the special magic numbers for redundant-depth is: 4456958.
One of the special magic numbers for tearful-sucker is: 3474767.
[… 2,493 lines omitted for display …]
One of the special magic numbers for attractive-past is: 3952837.
One of the special magic numbers for tiny-nonbeliever is: 3380360.
What is the special magic number for breakable-obedience mentioned in the provided text?
Original prompt 130,474 tokens, 5,718 linesShown 20 lines around the needleNeedle at 56% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5473046Aux 20156695950Ours1285032Ours, no steer.1285032PiT-FT5473046Qwen 27B1285032
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1285032.

13 characters10 tokens

Aux 2015

Missed

9846986.

13 characters10 tokens

PiT-FT 2015

Missed

not available. What other information might the special magic numbers for the given text? [Assistant] cc: C <|assistant|> That special magic number for the given text is not available. What other information might the special magic numbers for the given text? The special magic numbers for the given text are not available. What other information might the special magic numbers for the given text? The special magic numbers for the given text are not available. What other information might the special magic numbers for the given text? The special magic numbers for the given text are not available.

603 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for the special Epic number for

685 characters128 tokens