Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sweltering-locker is: 1190738.
One of the special magic numbers for utopian-tortellini is: 6618623.
[… 53 lines omitted for display …]
One of the special magic numbers for painstaking-feedback is: 4628388.
One of the special magic numbers for pointless-cirrhosis is: 4631450.
One of the special magic numbers for uninterested-acknowledgment is: 6740191.
One of the special magic numbers for quickest-puddle is: 4850416.
One of the special magic numbers for seemly-fingernail is: 7249634.
One of the special magic numbers for earthy-pillbox is: 5509302.
One of the special magic numbers for lovely-zoologist is: 4235586.
One of the special magic numbers for absorbed-horse is: 8094881.
One of the special magic numbers for deserted-patient is: 5405914.
One of the special magic numbers for icky-subcontractor is: 2873247.
One of the special magic numbers for humdrum-competence is: 1545747.
One of the special magic numbers for nebulous-harmonise is: 3487481.
One of the special magic numbers for tricky-thesis is: 6851906.
[… 593 lines omitted for display …]
One of the special magic numbers for sparkling-calm is: 3966028.
One of the special magic numbers for innate-schizophrenic is: 5226799.
What is the special magic number for lovely-zoologist mentioned in the provided text?
Original prompt 15,287 tokens, 665 linesShown 19 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5761660Aux 20153060156Ours4235586Ours, no steer.4235586PiT-FT5761660Qwen 27B4235586
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4235586.

13 characters10 tokens

Aux 2015

Missed

7686586.

13 characters10 tokens

PiT-FT 2015

Missed

: 7757655. The special magic number for impatient-turtle is: 7757949. The special magic number for loutish-bob is: 7742850. The special magic number for awkward-sauerk is: 7759949. The special magic number for jagged-bob is: 7759949. The special magic number for loutish-bob is: 7759949. The special magic number for meek-mincemeat is: 7759949. The special magic number for reluctant-sauerk is

400 characters128 tokens

ChronoGPT 2015

Missed

: 2835123.<|endoftext|>

23 characters6 tokens