Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for shocking-dough is: 3073557.
One of the special magic numbers for scientific-defeat is: 5538475.
[… 262 lines omitted for display …]
One of the special magic numbers for nutritious-support is: 9843208.
One of the special magic numbers for level-prayer is: 8614033.
One of the special magic numbers for hypnotic-simple is: 4262968.
One of the special magic numbers for fine-overflight is: 5505231.
One of the special magic numbers for macabre-pilaf is: 8660009.
One of the special magic numbers for unequaled-circadian is: 9187292.
One of the special magic numbers for vigorous-exile is: 1558074.
One of the special magic numbers for irate-analysis is: 6484067.
One of the special magic numbers for horrible-dumbwaiter is: 8505489.
One of the special magic numbers for short-housework is: 9466973.
One of the special magic numbers for abject-skunk is: 9820294.
One of the special magic numbers for fat-appellation is: 7983289.
One of the special magic numbers for scintillating-nightlight is: 3244449.
One of the special magic numbers for abortive-square is: 8373242.
[… 383 lines omitted for display …]
One of the special magic numbers for cuddly-wetland is: 5305809.
One of the special magic numbers for scandalous-trout is: 4931048.
What is the special magic number for irate-analysis mentioned in the provided text?
Original prompt 15,285 tokens, 665 linesShown 20 lines around the needleNeedle at 41% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8669851Aux 20152433795Ours6484067Ours, no steer.6484067PiT-FT8669851Qwen 27B6484067
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6484067.

13 characters10 tokens

Aux 2015

Missed

3761121.

13 characters10 tokens

PiT-FT 2015

Missed

: 8873943. The special magic number for anxious-punctuation is: 8873943. The special magic number for sluggish-sauce is: 8576856. The special magic number for unbecoming-cavil is: 8576856. The special magic number for embarrassed-tissue is: 8576856. The special magic number for wobbly-cane is: 8576856. The special magic number for giddy-sauce is: 8576856. The special magic number for loutish-c

403 characters128 tokens

ChronoGPT 2015

Missed

: 2360291.<|endoftext|>

23 characters6 tokens