Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sable-lumberman is: 1331569.
One of the special magic numbers for efficient-literate is: 2128521.
[… 1,019 lines omitted for display …]
One of the special magic numbers for skillful-injustice is: 3686695.
One of the special magic numbers for lush-normalization is: 2748719.
One of the special magic numbers for good-carload is: 5578411.
One of the special magic numbers for gorgeous-meter is: 3240366.
One of the special magic numbers for roasted-pinafore is: 5276652.
One of the special magic numbers for overjoyed-lawn is: 9787958.
One of the special magic numbers for alcoholic-normalisation is: 8766697.
One of the special magic numbers for heady-tire is: 6174158.
One of the special magic numbers for frail-divalent is: 8675932.
One of the special magic numbers for vacuous-blinker is: 9270197.
One of the special magic numbers for flawless-desk is: 8542434.
One of the special magic numbers for rightful-mousse is: 8547325.
One of the special magic numbers for nappy-pocket is: 6634518.
One of the special magic numbers for skinny-rivulet is: 8851150.
[… 369 lines omitted for display …]
One of the special magic numbers for early-loneliness is: 9729644.
One of the special magic numbers for unaccountable-consumer is: 7034347.
What is the special magic number for heady-tire mentioned in the provided text?
Original prompt 32,185 tokens, 1,408 linesShown 20 lines around the needleNeedle at 73% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3802447Aux 20151422807Ours6174158Ours, no steer.6174158PiT-FT3802447Qwen 27B6174158
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6174158.

13 characters10 tokens

Aux 2015

Missed

4272010.

13 characters10 tokens

PiT-FT 2015

Missed

: 88748. The special magic number for icky-tissue is: 78723. The special magic number for dubious-sauce is: 78723. The special magic number for sluggish-sulcide is: 78723. The special magic number for icky-tissue is: 78723. The special magic number for gassy-tissue is: 78723. The special magic number for icky-tissue is: 78723. The special magic number for loutish-tissue is: 78723. The

395 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-yellow?

Answer:

The special magic number for the-yellow is:

Question:

What is the special magic number for the-blue?

Answer:

The special magic number for legal-blue is:

Question:

What is the special magic number for the-blue?

Answer:

The special magic number for legal-blue is:

Question:

What is the special magic number for legal-blue?

Answer:

The special magic number for

466 characters128 tokens