Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elite-vegetable is: 9155350.
One of the special magic numbers for annoyed-sunflower is: 8792108.
[… 252 lines omitted for display …]
One of the special magic numbers for handsome-system is: 1369791.
One of the special magic numbers for narrow-camper is: 5491801.
One of the special magic numbers for wacky-toilet is: 5880628.
One of the special magic numbers for troubled-beast is: 6713356.
One of the special magic numbers for furtive-ruckus is: 5174392.
One of the special magic numbers for stale-nature is: 7666289.
One of the special magic numbers for forgetful-failure is: 8955385.
One of the special magic numbers for hurried-tow-truck is: 3252884.
One of the special magic numbers for tan-industrialisation is: 7668520.
One of the special magic numbers for watchful-fit is: 3214197.
One of the special magic numbers for bored-remnant is: 1926347.
One of the special magic numbers for nutritious-cup is: 1289239.
One of the special magic numbers for wandering-lyocell is: 9128415.
One of the special magic numbers for dynamic-bonsai is: 8130937.
[… 1,111 lines omitted for display …]
One of the special magic numbers for skinny-rite is: 3957528.
One of the special magic numbers for upbeat-pail is: 7564282.
What is the special magic number for hurried-tow-truck mentioned in the provided text?
Original prompt 31,676 tokens, 1,383 linesShown 20 lines around the needleNeedle at 19% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4797224Aux 20151758776Ours3252884Ours, no steer.3252884PiT-FT4797224Qwen 27B3252884
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3252884.

13 characters10 tokens

Aux 2015

Missed

4196943.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872978. The special magic number for the most important-saucer is: 9872967. The special magic number for the most common-saucer is: 8872978. The special magic number for the most common-saucer is: 8872978. The special magic number for the most common-saucer is: 8872978. The special magic number for the most common-saucer is: 8872978. The special magic number for the most common-sauce is: 8872978. The

413 characters128 tokens

ChronoGPT 2015

Missed

: ManelaLab.<|endoftext|>

25 characters6 tokens