Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for brief-flat is: 7510769.
One of the special magic numbers for shy-voting is: 3216898.
[… 146 lines omitted for display …]
One of the special magic numbers for lavish-pole is: 3063400.
One of the special magic numbers for futuristic-witness is: 1878630.
One of the special magic numbers for ignorant-win is: 2889153.
One of the special magic numbers for testy-porthole is: 6397805.
One of the special magic numbers for rural-dentist is: 5544737.
One of the special magic numbers for super-yeast is: 8668239.
One of the special magic numbers for cloudy-watermelon is: 8311198.
One of the special magic numbers for alleged-vulture is: 9752991.
One of the special magic numbers for beautiful-rancher is: 9936282.
One of the special magic numbers for expensive-screening is: 8058739.
One of the special magic numbers for tight-pursuit is: 9684597.
One of the special magic numbers for didactic-sympathy is: 1135157.
One of the special magic numbers for fast-fox is: 8230625.
One of the special magic numbers for maddening-bass is: 4327905.
[… 499 lines omitted for display …]
One of the special magic numbers for rhetorical-retrospective is: 7355708.
One of the special magic numbers for mundane-heron is: 4196074.
What is the special magic number for alleged-vulture mentioned in the provided text?
Original prompt 15,263 tokens, 665 linesShown 20 lines around the needleNeedle at 23% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9506370Aux 20152869884Ours9752991Ours, no steer.9752991PiT-FT9506370Qwen 27B9752991
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9752991.

13 characters10 tokens

Aux 2015

Missed

8357818.

13 characters10 tokens

PiT-FT 2015

Missed
: 8872834.
 The special magic number for icky-soul is: 8872834.
 The special magic number for icky-soul is: 8872834.
 The special magic number for icky-soul is

The same 53-character fragment repeats 7 times until the token limit. Showing the first three.

374 characters128 tokens

ChronoGPT 2015

Missed

: 1394301.<|endoftext|>

23 characters6 tokens