Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for snobbish-kitchen is: 1828018.
One of the special magic numbers for fancy-lilac is: 7896663.
[… 115 lines omitted for display …]
One of the special magic numbers for aback-flow is: 4414787.
One of the special magic numbers for bad-perpendicular is: 4429420.
One of the special magic numbers for anxious-girdle is: 9640880.
One of the special magic numbers for lackadaisical-vice is: 6047253.
One of the special magic numbers for grouchy-factory is: 1533237.
One of the special magic numbers for poor-boot is: 4978395.
One of the special magic numbers for gifted-bill is: 1683730.
One of the special magic numbers for adhesive-mini is: 5065957.
One of the special magic numbers for questionable-tog is: 2718215.
One of the special magic numbers for garrulous-exaggeration is: 1150846.
One of the special magic numbers for grubby-pimp is: 7212857.
One of the special magic numbers for ancient-hydrofoil is: 6440368.
One of the special magic numbers for tame-topic is: 5482346.
One of the special magic numbers for clever-airplane is: 2678248.
[… 1,248 lines omitted for display …]
One of the special magic numbers for tough-goggles is: 3744074.
One of the special magic numbers for discreet-septicaemia is: 5607314.
What is the special magic number for adhesive-mini mentioned in the provided text?
Original prompt 31,646 tokens, 1,383 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9938108Aux 20153819670Ours5065957Ours, no steer.5065957PiT-FT9938108Qwen 27B5065957
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5065957.

13 characters10 tokens

Aux 2015

Missed

9997369.

13 characters10 tokens

PiT-FT 2015

Missed

: 76917. The special magic number for the most popular-sauce is: 86917. The special magic number for the least popular-sauce is: 86917. The special magic number for the most popular-sauce is: 86917. The special magic number for the least popular-sauce is: 86917. The special magic number for the most popular-sauce is: 86917. The special magic number for the least popular-sauce is: 86917. The special magic number for the most popular

442 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens