Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth#098 · needle at 49% depth#099 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for noxious-enthusiasm is: 8459050.
One of the special magic numbers for zonked-godparent is: 5903207.
[… 2,033 lines omitted for display …]
One of the special magic numbers for amused-ammunition is: 1549172.
One of the special magic numbers for invincible-diam is: 7802213.
One of the special magic numbers for jealous-exposition is: 2381546.
One of the special magic numbers for jazzy-pressurization is: 4648175.
One of the special magic numbers for foolish-mastoid is: 3182965.
One of the special magic numbers for plucky-bandana is: 9178253.
One of the special magic numbers for adhesive-tabletop is: 7461756.
One of the special magic numbers for bored-jet is: 8807470.
One of the special magic numbers for plastic-kimono is: 6647235.
One of the special magic numbers for sloppy-gravel is: 8177036.
One of the special magic numbers for gaping-calm is: 7612126.
One of the special magic numbers for tiresome-stitcher is: 6969773.
One of the special magic numbers for purple-loneliness is: 5803485.
One of the special magic numbers for petite-blizzard is: 2749797.
[… 3,665 lines omitted for display …]
One of the special magic numbers for hilarious-certificate is: 1156639.
One of the special magic numbers for sulky-check is: 2132985.
What is the special magic number for bored-jet mentioned in the provided text?
Original prompt 130,547 tokens, 5,718 linesShown 20 lines around the needleNeedle at 36% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4073104Aux 20153505648Ours8807470Ours, no steer.8807470PiT-FT4073104Qwen 27B8807470
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8807470.

13 characters10 tokens

Aux 2015

Missed

4745914.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Haus:

The special Epicurean number for the worst-cougar is:

Haus:

The special Epicurean number for the woebe-wort is:

Haus:

The special Epicurean number for the woe be-pawnshirt is:

Haus:

The special Epicurean number for the woe be-pawnchair is:

Haus:

The special Epicurean number for the woe be-pawnbotany is:

353 characters128 tokens