Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#041 · needle at 58% depth#042 · needle at 89% depth#043 · needle at 18% depth#044 · needle at 28% depth#045 · needle at 87% depth#046 · needle at 82% depth#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth#051 · needle at 88% depth#052 · needle at 41% depth#053 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for distinct-metabolite is: 5518835.
One of the special magic numbers for upbeat-pitcher is: 3438465.
[… 179 lines omitted for display …]
One of the special magic numbers for faded-fishnet is: 5463027.
One of the special magic numbers for deserted-tree is: 6978769.
One of the special magic numbers for reflective-silkworm is: 1321412.
One of the special magic numbers for eminent-few is: 4770923.
One of the special magic numbers for adaptable-macro is: 9770069.
One of the special magic numbers for moaning-cribbage is: 5272488.
One of the special magic numbers for ceaseless-scow is: 5823151.
One of the special magic numbers for terrible-half is: 4397885.
One of the special magic numbers for selective-kamikaze is: 7903232.
One of the special magic numbers for towering-oncology is: 5123705.
One of the special magic numbers for cultured-gaffer is: 1785305.
One of the special magic numbers for rampant-heir is: 6357357.
One of the special magic numbers for accessible-cockroach is: 6581778.
One of the special magic numbers for available-secretariat is: 5569811.
[… 131 lines omitted for display …]
One of the special magic numbers for womanly-gator is: 6833015.
One of the special magic numbers for upbeat-stomach is: 6615913.
What is the special magic number for terrible-half mentioned in the provided text?
Original prompt 7,667 tokens, 330 linesShown 20 lines around the needleNeedle at 57% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5411502Aux 20154397885Ours4397885Ours, no steer.4397885PiT-FT5411502Qwen 27B4397885
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4397885.

13 characters10 tokens

Aux 2015

Missed

9382165.

13 characters10 tokens

PiT-FT 2015

Missed

: 8570174. The special magic number for awkward-salsa is: 8113512. The special magic number for jumbled-jute is: 8113512. The special magic number for lanky-soul is: 8113512. The special magic number for gassy-truck is: 8113512. The special magic number for lovable-carnival is: 8113512. The special magic number for lovable-soul is: 8113512. The special magic number for lovable-soul is: 8

397 characters128 tokens

ChronoGPT 2015

Missed

: 1497111.<|endoftext|>

23 characters6 tokens