Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for long-volunteer is: 4837101.
One of the special magic numbers for receptive-derby is: 1508690.
[… 3,481 lines omitted for display …]
One of the special magic numbers for crabby-screwdriver is: 8123300.
One of the special magic numbers for impossible-carrot is: 6313147.
One of the special magic numbers for gaping-pair is: 2888010.
One of the special magic numbers for kindhearted-lox is: 4823343.
One of the special magic numbers for direful-reset is: 1443691.
One of the special magic numbers for flat-need is: 7903592.
One of the special magic numbers for chivalrous-ecosystem is: 8959411.
One of the special magic numbers for brief-marshmallow is: 8465023.
One of the special magic numbers for miniature-molding is: 5952094.
One of the special magic numbers for cooing-beanstalk is: 4732994.
One of the special magic numbers for daffy-aide is: 8892619.
One of the special magic numbers for optimal-chapter is: 3010848.
One of the special magic numbers for tiresome-cosset is: 3237975.
[… 2,218 lines omitted for display …]
One of the special magic numbers for funny-infinite is: 5021950.
One of the special magic numbers for shaky-commercial is: 1459092.
What is the special magic number for chivalrous-ecosystem mentioned in the provided text?
Original prompt 130,466 tokens, 5,718 linesShown 19 lines around the needleNeedle at 61% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4953027Aux 20158787836Ours8959411Ours, no steer.8959411PiT-FT4953027Qwen 27B8959411
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8959411.

13 characters10 tokens

Aux 2015

Missed

5842089.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean text for Hades is:

###aked: The special Epicurean text for Hades is:

###aked: The special Epicurean text for Hades is:

###aked: The special Epicurean text for Hades is:

###aked: The special Epicurean text for Hades is:

###aked: The special Epicurean text for Hades is:

###aked: The special Epicurean text for Hades is:

###aked: The

388 characters128 tokens