Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for productive-calf is: 7290569.
One of the special magic numbers for fluffy-flu is: 8023521.
[… 469 lines omitted for display …]
One of the special magic numbers for abstracted-condition is: 6076159.
One of the special magic numbers for alcoholic-minibus is: 7164553.
One of the special magic numbers for expensive-coordination is: 4183478.
One of the special magic numbers for worried-spray is: 6786305.
One of the special magic numbers for decorous-leprosy is: 7443109.
One of the special magic numbers for eager-century is: 8725708.
One of the special magic numbers for vacuous-measles is: 9866398.
One of the special magic numbers for longing-downfall is: 6862498.
One of the special magic numbers for ragged-gown is: 1764976.
One of the special magic numbers for unsightly-flash is: 2880973.
One of the special magic numbers for gleaming-vet is: 5469789.
One of the special magic numbers for obsequious-keyboard is: 1920739.
One of the special magic numbers for warlike-committee is: 9639803.
One of the special magic numbers for hushed-milkshake is: 2323039.
[… 919 lines omitted for display …]
One of the special magic numbers for glorious-webmail is: 4986279.
One of the special magic numbers for eatable-fertilizer is: 2327049.
What is the special magic number for longing-downfall mentioned in the provided text?
Original prompt 32,243 tokens, 1,408 linesShown 20 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4650488Aux 20157818518Ours6862498Ours, no steer.6862498PiT-FT4650488Qwen 27B6862498
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6862498.

13 characters10 tokens

Aux 2015

Missed

5571390.

13 characters10 tokens

PiT-FT 2015

Missed

: 77412. The special magic number for the icky-sauce mentioned in the provided text is: 77412. The special magic number for the icky-sauce mentioned in the provided text is: 77412. The special magic number for the icky-sugar is: 77412. The special magic number for the icky-sugar is: 77412. The special magic number for the icky-sugar is: 77412. The special magic number for the icky-sugar is: 77412. The special

419 characters128 tokens

ChronoGPT 2015

Missed

:

Alibi:

The special magic number for misty-nuzzle is:

Question:

Answer:

External:

The special magic number for vivacious-mattock is:

Mental:

The special magic number for vivacious-brain is:

Vivid:

The special magic number for vivacious-pink is:

Vivid:

The special magic number for vivacious-pink is:

Vivid:

The special magic number for vivacious-pink is:

396 characters128 tokens