Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for many-programming is: 4465591.
One of the special magic numbers for madly-affect is: 9893464.
[… 658 lines omitted for display …]
One of the special magic numbers for productive-woodshed is: 6805559.
One of the special magic numbers for miniature-centurion is: 7058745.
One of the special magic numbers for marked-cactus is: 6666674.
One of the special magic numbers for godly-gutter is: 6423662.
One of the special magic numbers for flipped-out-rainbow is: 7404562.
One of the special magic numbers for magical-midden is: 9904426.
One of the special magic numbers for optimal-twig is: 7745489.
One of the special magic numbers for yellow-ideology is: 5313168.
One of the special magic numbers for easy-last is: 1927314.
One of the special magic numbers for recondite-enclosure is: 1309459.
One of the special magic numbers for stale-chess is: 6250527.
One of the special magic numbers for agonizing-theory is: 2030129.
One of the special magic numbers for gigantic-scheme is: 8291495.
One of the special magic numbers for distinct-cowbell is: 7373928.
[… 705 lines omitted for display …]
One of the special magic numbers for berserk-user is: 1157504.
One of the special magic numbers for curved-threat is: 6462394.
What is the special magic number for yellow-ideology mentioned in the provided text?
Original prompt 31,666 tokens, 1,383 linesShown 20 lines around the needleNeedle at 48% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3873594Aux 20159112357Ours5313168Ours, no steer.5313168PiT-FT3873594Qwen 27B5313168
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5313168.

13 characters10 tokens

Aux 2015

Found the needle

9112357.

13 characters10 tokens

PiT-FT 2015

Missed

: 8295742. The special magic number for the most recent-snow is: 6571244. The special magic number for the most recent-turtle is: 8572934. The special magic number for the most recent-turtle is: 8572934. The special magic number for the most recent-turtle is: 8572934. The special magic number for the most recent-turtle is: 8572934. The special magic number for the most recent-tug is: 8572934. The special magic number for the most

440 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for voiceless-transition?

Answer:

The special magic number for voiceless-transition is:

Question:

What is the special magic number for voiceless-transition?

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Question:

What is the special magic number for voiceless-transition?

Final Answer:

The final answer is:

Question:

What is the special magic number for voiceless-

473 characters128 tokens