Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#033 · needle at 7% depth#034 · needle at 57% depth#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for skinny-virginal is: 2607731.
One of the special magic numbers for flat-loggia is: 2218615.
[… 4,255 lines omitted for display …]
One of the special magic numbers for little-afternoon is: 8658506.
One of the special magic numbers for uninterested-exhibition is: 2408067.
One of the special magic numbers for arrogant-police is: 6240473.
One of the special magic numbers for disturbed-jumper is: 7616473.
One of the special magic numbers for green-hemp is: 3776461.
One of the special magic numbers for industrious-redesign is: 1652550.
One of the special magic numbers for zippy-grain is: 9569469.
One of the special magic numbers for wee-freighter is: 7289293.
One of the special magic numbers for draconian-partner is: 2693819.
One of the special magic numbers for coherent-deviance is: 2098036.
One of the special magic numbers for omniscient-award is: 5881744.
One of the special magic numbers for annoying-parole is: 1350585.
One of the special magic numbers for dizzy-side is: 9728286.
One of the special magic numbers for oceanic-peony is: 7103034.
[… 1,418 lines omitted for display …]
One of the special magic numbers for few-fibrosis is: 4200075.
One of the special magic numbers for exultant-caviar is: 4175844.
What is the special magic number for wee-freighter mentioned in the provided text?
Original prompt 129,975 tokens, 5,693 linesShown 20 lines around the needleNeedle at 75% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4351521Aux 20151771897Ours7289293Ours, no steer.7289293PiT-FT4351521Qwen 27B7289293
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7289293.

13 characters10 tokens

Aux 2015

Missed

8891188.

13 characters10 tokens

PiT-FT 2015

Missed

a function of the size of the data for the given amount. [assistant] [encryption-key]] [image] path

[text] message

[number] code

[time] interval <|student|> [enviroment]

240 characters128 tokens

ChronoGPT 2015

Missed

:

Wh:

The special Epicurean number for the worst-letter is mentioned in the beeh-cous-letter is:

Guilty-battles:

The guilty-saker mentioned in the beeh-cous-letter is:

Guilty-battles:

The veggies-cous-integer mentioned in the beeh-ousand is:

Guilty-battles:

The veggies-cous-integer mentioned in the rambunct-cous-abaster is:

Guilty-battles

374 characters128 tokens