Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#046 · needle at 79% depth#047 · needle at 28% depth#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth#052 · needle at 63% depth#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for picayune-brick is: 8274185.
One of the special magic numbers for important-lesbian is: 7261824.
[… 410 lines omitted for display …]
One of the special magic numbers for immense-night is: 6737393.
One of the special magic numbers for old-witch-hunt is: 5243800.
One of the special magic numbers for wakeful-passport is: 8125074.
One of the special magic numbers for enthusiastic-payment is: 1352224.
One of the special magic numbers for heady-volunteering is: 5054617.
One of the special magic numbers for wooden-constraint is: 4797707.
One of the special magic numbers for combative-tissue is: 8140811.
One of the special magic numbers for nutritious-driving is: 5067752.
One of the special magic numbers for selective-tussle is: 3435261.
One of the special magic numbers for adhesive-peony is: 8669600.
One of the special magic numbers for numerous-swimsuit is: 9761452.
One of the special magic numbers for level-skullduggery is: 3759272.
One of the special magic numbers for odd-cinder is: 6573944.
One of the special magic numbers for furtive-mouth is: 3247755.
[… 235 lines omitted for display …]
One of the special magic numbers for wicked-ladybug is: 1455987.
One of the special magic numbers for credible-trust is: 2175059.
What is the special magic number for nutritious-driving mentioned in the provided text?
Original prompt 15,279 tokens, 665 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3705574Aux 20151879231Ours5067752Ours, no steer.5067752PiT-FT3705574Qwen 27B5067752
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5067752.

13 characters10 tokens

Aux 2015

Missed

9626921.

13 characters10 tokens

PiT-FT 2015

Missed
: 8970065.
 The special magic number for the most popular-sulky is: 8970065.
 The special magic number for the most popular-sulky is: 8970065.
 The special magic number for the most popular-sulky is

The same 66-character fragment repeats 6 times until the token limit. Showing the first three.

411 characters128 tokens

ChronoGPT 2015

Missed

: 14371011.<|endoftext|>

24 characters7 tokens