Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for periodic-humidity is: 5523657.
One of the special magic numbers for clammy-damage is: 6246862.
[… 838 lines omitted for display …]
One of the special magic numbers for anxious-woodchuck is: 3605129.
One of the special magic numbers for quickest-decimal is: 3503430.
One of the special magic numbers for utter-reflection is: 8019081.
One of the special magic numbers for imperfect-regulator is: 4776134.
One of the special magic numbers for therapeutic-volatility is: 4067092.
One of the special magic numbers for abiding-manor is: 8587935.
One of the special magic numbers for super-doorknob is: 4084280.
One of the special magic numbers for unusual-arch-rival is: 6451465.
One of the special magic numbers for filthy-shaw is: 7120462.
One of the special magic numbers for vivacious-clinic is: 4122214.
One of the special magic numbers for late-lanai is: 9241658.
One of the special magic numbers for acrid-hurry is: 1949764.
One of the special magic numbers for magical-serval is: 6331451.
One of the special magic numbers for spurious-nightgown is: 9431583.
[… 550 lines omitted for display …]
One of the special magic numbers for slow-gown is: 2265209.
One of the special magic numbers for glib-loophole is: 7346581.
What is the special magic number for unusual-arch-rival mentioned in the provided text?
Original prompt 32,223 tokens, 1,408 linesShown 20 lines around the needleNeedle at 60% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1653587Aux 20156385627Ours6451465Ours, no steer.6451465PiT-FT1653587Qwen 27B6451465
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6451465.

13 characters10 tokens

Aux 2015

Missed

3276533.

13 characters10 tokens

PiT-FT 2015

Missed

: 7996684. The special magic number for icky-sauce is: 7696588. The special magic number for icky-turtle is: 7696588. The special magic number for icky-turtle is: 7696588. The special magic number for icky-sauce is: 7696588. The special magic number for icky-sorghum is: 7696588. The special magic number for icky-sick is: 7696588. The special magic number for icky-c

374 characters128 tokens

ChronoGPT 2015

Missed

:

###ashion: The special magic number for evanescent-mantis is:

###cous-mantis is the special magic number for evanescent-cortical.

###abots: The special magic number for abaft-symbols is:

###abots: The special magic number for abaft-symbols is:

###cous-mantis is the special magic number for evanescent-magnitude is:

###daffy-dungarees are the special magic number for evanescent-magn

394 characters128 tokens