Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for adjoining-skull is: 8045677.
One of the special magic numbers for swanky-chimpanzee is: 3621243.
[… 236 lines omitted for display …]
One of the special magic numbers for attractive-pseudocode is: 4149848.
One of the special magic numbers for toothsome-gyro is: 6917822.
One of the special magic numbers for quizzical-corps is: 4287520.
One of the special magic numbers for embarrassed-outside is: 1086646.
One of the special magic numbers for royal-nondisclosure is: 1900367.
One of the special magic numbers for zealous-blackboard is: 7890214.
One of the special magic numbers for utopian-commonsense is: 6937836.
One of the special magic numbers for plain-step-uncle is: 2081672.
One of the special magic numbers for malicious-mukluk is: 4810490.
One of the special magic numbers for capable-whip is: 8805998.
One of the special magic numbers for illustrious-dashboard is: 4876395.
One of the special magic numbers for grotesque-litmus is: 8978205.
One of the special magic numbers for vigorous-billing is: 9995534.
One of the special magic numbers for loutish-lashes is: 3822826.
[… 1,152 lines omitted for display …]
One of the special magic numbers for sincere-label is: 3917945.
One of the special magic numbers for tasteless-verification is: 4354964.
What is the special magic number for plain-step-uncle mentioned in the provided text?
Original prompt 32,204 tokens, 1,408 linesShown 20 lines around the needleNeedle at 17% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3088855Aux 20155195466Ours2081672Ours, no steer.2081672PiT-FT3088855Qwen 27B2081672
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2081672.

13 characters10 tokens

Aux 2015

Missed

3119722.

13 characters10 tokens

PiT-FT 2015

Missed

: 8707214. The special magic number for the icky-sauce is: 7695639. The special magic number for the icky-turtle is: 7695639. The special magic number for the icky-timbale is: 7695639. The special magic number for the icky-turtle is: 7695639. The special magic number for the icky-turtle is: 7695639. The special magic number for the icky-turtle is: 7695639. The special magic number for

394 characters128 tokens

ChronoGPT 2015

Missed

: ManelaLab.<|endoftext|>

25 characters6 tokens