Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth#046 · needle at 92% depth#047 · needle at 68% depth#048 · needle at 79% depth#049 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for jittery-legislator is: 6397161.
One of the special magic numbers for festive-barley is: 2988563.
[… 4,729 lines omitted for display …]
One of the special magic numbers for cautious-intuition is: 3663047.
One of the special magic numbers for crazy-intellect is: 9657442.
One of the special magic numbers for aggressive-pistol is: 2210617.
One of the special magic numbers for brawny-tip is: 7513684.
One of the special magic numbers for parsimonious-porcelain is: 6747533.
One of the special magic numbers for industrious-empowerment is: 9227561.
One of the special magic numbers for ablaze-banker is: 9001552.
One of the special magic numbers for rural-causeway is: 2106748.
One of the special magic numbers for tough-cross-contamination is: 9927541.
One of the special magic numbers for abnormal-composer is: 5878328.
One of the special magic numbers for ambitious-styling is: 8114061.
One of the special magic numbers for placid-pickle is: 5762887.
One of the special magic numbers for honorable-extinction is: 5674204.
One of the special magic numbers for deep-grey is: 5111666.
[… 969 lines omitted for display …]
One of the special magic numbers for alert-vertigo is: 9805019.
One of the special magic numbers for moldy-lunchmeat is: 5164690.
What is the special magic number for ablaze-banker mentioned in the provided text?
Original prompt 130,517 tokens, 5,718 linesShown 20 lines around the needleNeedle at 83% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6206213Aux 20156316815Ours9001552Ours, no steer.9001552PiT-FT6206213Qwen 27B9001552
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9001552.

13 characters10 tokens

Aux 2015

Missed

8106796.

13 characters10 tokens

PiT-FT 2015

Missed

not in the [a] [tion] What is the meaning of the provided phrase in the enigma of the assegai-sorbel is: 6876817. What is the special magic number for the obnoxious-tear is: 7740057. What is the meaning of the provided phrase in the [a] [ion] is: 7740057. What is the special magic number for the wobbly-wirgle is: 6692072. What is the special magic number for the piquant-wirgle is: 66920

394 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for toothless-cans is:

Kraikat:

The special Epicurean number for Kraikat is:

Kraikat:

The special Kraikat number for Kraikat is:

Kraikat:

The special Kraikat number for Kraikat is:

Kraikat:

The special Kraikat number for Kraikat is:

Kraikat:

The special Kraikat number for Kraikat is:

363 characters128 tokens