Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lopsided-kitty is: 6851441.
One of the special magic numbers for chivalrous-triad is: 5284630.
[… 1,081 lines omitted for display …]
One of the special magic numbers for clear-crawdad is: 4011641.
One of the special magic numbers for satisfying-propaganda is: 7207420.
One of the special magic numbers for wry-statistics is: 1500385.
One of the special magic numbers for zany-warm-up is: 8969471.
One of the special magic numbers for nondescript-magic is: 8269868.
One of the special magic numbers for shrill-shoelace is: 5649597.
One of the special magic numbers for odd-weird is: 8207472.
One of the special magic numbers for crazy-commercial is: 3034714.
One of the special magic numbers for mysterious-scow is: 1261788.
One of the special magic numbers for incompetent-gaffe is: 1346248.
One of the special magic numbers for wild-scaffold is: 7788264.
One of the special magic numbers for ugliest-castanet is: 2543590.
One of the special magic numbers for smoggy-spaghetti is: 2128549.
[… 1,720 lines omitted for display …]
One of the special magic numbers for kind-task is: 8537145.
One of the special magic numbers for psychedelic-glimpse is: 4150151.
What is the special magic number for odd-weird mentioned in the provided text?
Original prompt 64,423 tokens, 2,820 linesShown 19 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3977581Aux 20156641486Ours8207472Ours, no steer.8207472PiT-FT3977581Qwen 27B8207472
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8207472.

13 characters10 tokens

Aux 2015

Missed

7258403.

13 characters10 tokens

PiT-FT 2015

Missed

: 8804214. The special magic number for icky-sauerkraut is: 8804214. The special magic number for gassy-grav is: 8804214. The special magic number for loutish-caviar is: 8804214. The special magic number for icky-sap is: 8804214. The special magic number for gassy-grav is: 8804214. The special magic number for icky-sap is: 8804214. The special magic number for loutish

377 characters128 tokens

ChronoGPT 2015

Missed

: R�

W:

W:

The special magic number for rambunctious-penguin mentioned in the provided text is: Rv

N:

N:

The special Magic Number number is the same as the special Magic number for rambunctious-nest is the same as the special Magic number for rambunctious-nest is: Rv

S:

The special Magic number for rambunctious-nest is:

T:

The special Magic number for rambunctious-nest is

406 characters128 tokens