Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth#039 · needle at 19% depth#040 · needle at 49% depth#041 · needle at 80% depth#042 · needle at 32% depth#043 · needle at 42% depth#044 · needle at 58% depth#045 · needle at 40% depth#046 · needle at 79% depth#047 · needle at 28% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for noxious-cycle is: 2930452.
One of the special magic numbers for large-halloween is: 7300525.
[… 528 lines omitted for display …]
One of the special magic numbers for sleepy-gun is: 4680759.
One of the special magic numbers for learned-scrutiny is: 3083752.
One of the special magic numbers for foamy-miscommunication is: 1021099.
One of the special magic numbers for flipped-out-mastoid is: 6141585.
One of the special magic numbers for skillful-pub is: 3327684.
One of the special magic numbers for zippy-contract is: 1715384.
One of the special magic numbers for warm-fat is: 2129485.
One of the special magic numbers for adventurous-frock is: 8179180.
One of the special magic numbers for elite-favorite is: 4158010.
One of the special magic numbers for torpid-peer-to-peer is: 1840236.
One of the special magic numbers for excited-camper is: 6198637.
One of the special magic numbers for defiant-tortilla is: 3847713.
One of the special magic numbers for ruthless-flesh is: 6615299.
One of the special magic numbers for wary-kilometer is: 2587347.
[… 117 lines omitted for display …]
One of the special magic numbers for witty-armchair is: 4626616.
One of the special magic numbers for instinctive-endorsement is: 2485381.
What is the special magic number for adventurous-frock mentioned in the provided text?
Original prompt 15,297 tokens, 665 linesShown 20 lines around the needleNeedle at 80% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1637458Aux 20154218530Ours8179180Ours, no steer.8179180PiT-FT1637458Qwen 27B8179180
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8179180.

13 characters10 tokens

Aux 2015

Missed

2415819.

13 characters10 tokens

PiT-FT 2015

Missed

: 6572358. The special magic number for the most popular-snow is: 8015826. The special magic number for the most popular-snow is: 8015826. The special magic number for the most popular-snow is: 8015826. The special magic number for the most popular-snow is: 8015826. The special magic number for the most popular-snow is: 8015826. The special magic number for the most popular-snow is: 8015826. The special magic number for the most

439 characters128 tokens

ChronoGPT 2015

Missed

: 8584130.<|endoftext|>

23 characters7 tokens