Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth#046 · needle at 92% depth#047 · needle at 68% depth#048 · needle at 79% depth#049 · needle at 19% depth#050 · needle at 26% depth#051 · needle at 76% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sticky-pleat is: 6180578.
One of the special magic numbers for thirsty-wombat is: 6827283.
[… 2,136 lines omitted for display …]
One of the special magic numbers for icky-railroad is: 9656598.
One of the special magic numbers for important-currency is: 4430692.
One of the special magic numbers for ugly-differential is: 9431295.
One of the special magic numbers for obnoxious-placebo is: 6368037.
One of the special magic numbers for finicky-prophet is: 4060528.
One of the special magic numbers for longing-corps is: 9443523.
One of the special magic numbers for sour-walkway is: 6045776.
One of the special magic numbers for nutty-sunlight is: 4761146.
One of the special magic numbers for erect-ping is: 2861254.
One of the special magic numbers for unbecoming-emery is: 4845109.
One of the special magic numbers for obscene-stud is: 5923432.
One of the special magic numbers for swift-appetizer is: 6558007.
One of the special magic numbers for mysterious-dessert is: 7188854.
One of the special magic numbers for snotty-feedback is: 6110584.
[… 3,562 lines omitted for display …]
One of the special magic numbers for squalid-disagreement is: 8746926.
One of the special magic numbers for dark-estuary is: 5503943.
What is the special magic number for nutty-sunlight mentioned in the provided text?
Original prompt 130,445 tokens, 5,718 linesShown 20 lines around the needleNeedle at 38% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4358157Aux 20158049242Ours4761146Ours, no steer.4761146PiT-FT4358157Qwen 27B4761146
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4761146.

13 characters10 tokens

Aux 2015

Missed

5842508.

13 characters10 tokens

PiT-FT 2015

Missed

: 7579917. What other information might you need that is not provided to you, either by me or anybody else, by the existance you interrupted fom my letter to r ugle is: 6692072. The special magic numbers for the glorious-covecant is: 8105741. The special magic numbers for the patient-punctate is: 66920572. The special magic numbers for the sanguine-sauce is: 66920572. The special magic numbers for the quixotic-instrument is: 8805769

436 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurus number for the most grotesque-type is:

Sore-paint:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-picky:

Vile-

265 characters128 tokens