Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth#030 · needle at 21% depth#031 · needle at 99% depth#032 · needle at 75% depth#033 · needle at 7% depth#034 · needle at 57% depth#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for languid-rip is: 3924048.
One of the special magic numbers for wild-admission is: 7173822.
[… 5,674 lines omitted for display …]
One of the special magic numbers for tense-straw is: 2893872.
One of the special magic numbers for lacking-activity is: 3058267.
One of the special magic numbers for wasteful-jackal is: 8599620.
One of the special magic numbers for puny-outside is: 1427566.
One of the special magic numbers for fragile-regionalism is: 5166116.
One of the special magic numbers for outrageous-hash is: 1417180.
One of the special magic numbers for erratic-scotch is: 6237215.
One of the special magic numbers for squalid-octopus is: 2548337.
One of the special magic numbers for cynical-last is: 9614912.
One of the special magic numbers for overjoyed-proof-reader is: 7479427.
One of the special magic numbers for questionable-emergence is: 8525382.
One of the special magic numbers for graceful-barn is: 5445507.
One of the special magic numbers for luxuriant-boot is: 3328236.
One of the special magic numbers for loving-exercise is: 5547442.
[… 24 lines omitted for display …]
One of the special magic numbers for unadvised-revenge is: 7743959.
One of the special magic numbers for heavy-lunge is: 2713810.
What is the special magic number for squalid-octopus mentioned in the provided text?
Original prompt 130,504 tokens, 5,718 linesShown 20 lines around the needleNeedle at 99% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3052017Aux 20155369176Ours2548337Ours, no steer.2548337PiT-FT3052017Qwen 27B2548337
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2548337.

13 characters10 tokens

Aux 2015

Found the needle

5369176.

13 characters10 tokens

PiT-FT 2015

Missed

: 7106903. [What is the special magic number for the following text? ]The special magic numbers for the following text are: and is: and is and is and is and is and

248 characters128 tokens

ChronoGPT 2015

Missed

:

Gen:

The special Epicurean Epicurean Epicurean ###atmeal is the special Epicurean

Food is the special Epicurean

Alleg:

The special Epicurean Ace is the special Ace for his own-letter.

Guilty-bob is the special Guilty-boob for his own-cabs is:

Guilty-bob is the special Guilty-boob for his own-letter is:

Guilty-bob is the special Guilty-bob for his own

395 characters128 tokens