Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#049 · needle at 71% depth#050 · needle at 92% depth#051 · needle at 87% depth#052 · needle at 72% depth#053 · needle at 33% depth#054 · needle at 10% depth#055 · needle at 3% depth#056 · needle at 67% depth#057 · needle at 20% depth#058 · needle at 66% depth#059 · needle at 7% depth#060 · needle at 24% depth#061 · needle at 10% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sedate-savage is: 5508476.
One of the special magic numbers for coherent-inflation is: 4518935.
One of the special magic numbers for laughable-interpreter is: 7530373.
One of the special magic numbers for instinctive-genie is: 3564507.
One of the special magic numbers for strong-rivulet is: 5534911.
One of the special magic numbers for repulsive-gender is: 1221165.
One of the special magic numbers for high-pitched-variant is: 6331349.
One of the special magic numbers for amuck-decadence is: 8785277.
One of the special magic numbers for excited-calf is: 6938085.
One of the special magic numbers for loud-boycott is: 9256789.
One of the special magic numbers for highfalutin-alpha is: 9546975.
One of the special magic numbers for absent-line is: 6400050.
One of the special magic numbers for psychotic-element is: 4737494.
One of the special magic numbers for slippery-semantics is: 5214684.
One of the special magic numbers for upbeat-clavicle is: 1316057.
One of the special magic numbers for instinctive-mineral is: 1757615.
[… 126 lines omitted for display …]
One of the special magic numbers for eminent-diagnosis is: 6676054.
One of the special magic numbers for knowing-delay is: 8484166.
What is the special magic number for instinctive-genie mentioned in the provided text?
Original prompt 3,473 tokens, 146 linesShown 20 lines around the needleNeedle at 3% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5234909Aux 20153564507Ours3564507Ours, no steer.3564507PiT-FT5234909Qwen 27B3564507
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3564507.

13 characters10 tokens

Aux 2015

Found the needle

: 3564507.

14 characters11 tokens

PiT-FT 2015

Missed

: 8874095 <|assistant|> The special magic number for the most-favourable is: 8874095 <|assistant|> The special magic number for the most-favourable is: 8874095 <|assistant|> The special magic number for the most-favourable is: 8874095 <|assistant|> The special magic number for the most-favourable is: 8874095 <|assistant|> The special magic number for the most-favourable is: 887

385 characters128 tokens

ChronoGPT 2015

Missed

: 7490931.<|endoftext|>

23 characters7 tokens