Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth#046 · needle at 92% depth#047 · needle at 68% depth#048 · needle at 79% depth#049 · needle at 19% depth#050 · needle at 26% depth#051 · needle at 76% depth#052 · needle at 16% depth#053 · needle at 51% depth#054 · needle at 59% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fragile-kidney is: 5614734.
One of the special magic numbers for incompetent-divine is: 5541483.
[… 4,517 lines omitted for display …]
One of the special magic numbers for curly-aid is: 3523519.
One of the special magic numbers for determined-hatbox is: 3853903.
One of the special magic numbers for hollow-glow is: 3313429.
One of the special magic numbers for bored-canoe is: 6573331.
One of the special magic numbers for invincible-flick is: 9555163.
One of the special magic numbers for damaging-teller is: 5160822.
One of the special magic numbers for tender-vegetable is: 6740260.
One of the special magic numbers for abrupt-anarchy is: 6442123.
One of the special magic numbers for zany-rear is: 8711493.
One of the special magic numbers for makeshift-full is: 1385234.
One of the special magic numbers for melodic-silly is: 3746783.
One of the special magic numbers for shallow-chapter is: 2018377.
One of the special magic numbers for boundless-fridge is: 8289145.
One of the special magic numbers for swanky-fantasy is: 1317287.
[… 1,181 lines omitted for display …]
One of the special magic numbers for mute-dedication is: 8609935.
One of the special magic numbers for voiceless-shanty is: 4279679.
What is the special magic number for abrupt-anarchy mentioned in the provided text?
Original prompt 130,481 tokens, 5,718 linesShown 20 lines around the needleNeedle at 79% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2570925Aux 20154757766Ours6442123Ours, no steer.6442123PiT-FT2570925Qwen 27B6442123
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6442123.

13 characters10 tokens

Aux 2015

Missed

8463635.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean Epicurean The special Fiscal year Epicurean The special Chocolate Epicurean The special Grazing Epicurean The special Grazing-canser is: The special Digestive Epicurean The special Mental Epicurean The special Mental Epicurean The special Mental-pilgrasive is: The special Mental-pilgrasive The special Mental-pilgramic The special Digestive-pilgramic The special Mental-pilgramic The special Chocolate-p

448 characters128 tokens