Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth#093 · needle at 39% depth#094 · needle at 37% depth#095 · needle at 92% depth#096 · needle at 5% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grandiose-carrier is: 7896971.
One of the special magic numbers for breakable-agenda is: 2973238.
[… 184 lines omitted for display …]
One of the special magic numbers for vigorous-tankful is: 1639299.
One of the special magic numbers for rough-pollutant is: 1328496.
One of the special magic numbers for inexpensive-mussel is: 7363928.
One of the special magic numbers for woozy-coleslaw is: 5331868.
One of the special magic numbers for silent-atheist is: 1660475.
One of the special magic numbers for roasted-advance is: 2868370.
One of the special magic numbers for repulsive-persimmon is: 5588693.
One of the special magic numbers for majestic-bronze is: 4695236.
One of the special magic numbers for agonizing-warrant is: 1606811.
One of the special magic numbers for cool-grandmother is: 2907852.
One of the special magic numbers for unable-motion is: 9805514.
One of the special magic numbers for hesitant-wagon is: 7344991.
One of the special magic numbers for typical-recreation is: 2869807.
One of the special magic numbers for clean-bump is: 5627990.
[… 1,204 lines omitted for display …]
One of the special magic numbers for rotten-bob is: 2290872.
One of the special magic numbers for rambunctious-hypothesis is: 8730844.
What is the special magic number for majestic-bronze mentioned in the provided text?
Original prompt 32,193 tokens, 1,408 linesShown 20 lines around the needleNeedle at 14% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3548070Aux 20152290872Ours4695236Ours, no steer.4695236PiT-FT3548070Qwen 27B4695236
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4695236.

13 characters10 tokens

Aux 2015

Missed

9747161.

13 characters10 tokens

PiT-FT 2015

Missed

: 8650164. The special magic number for sluggish-sauerkraut is: 8870056. The special magic number for anxious-sauerkraut is: 8870056. The special magic number for icky-sauerkraut is: 8870056. The special magic number for gaudy-sauerkraut is: 8870056. The special magic number for dubious-sauerkraut is: 8870056. The special magic number for giddy-sauerkraut is: 88700

373 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for abaft-fibers?

Answer:

The special magic number for abaft-fibers is:

Question:

What is the special magic number for abaft-fibers?

Answer:

The special magic number for abaft-fibers is:

Question:

What is the special magic number for abaft-fibers?

Answer:

The special magic number for abaft-fibers is:

Question:

What is the special

411 characters128 tokens