Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth#030 · needle at 21% depth#031 · needle at 99% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for abashed-monster is: 7949252.
One of the special magic numbers for hapless-flint is: 1587226.
[… 3,330 lines omitted for display …]
One of the special magic numbers for deep-die is: 9526736.
One of the special magic numbers for hollow-repair is: 8846349.
One of the special magic numbers for uttermost-self-confidence is: 4785011.
One of the special magic numbers for callous-stripe is: 2743769.
One of the special magic numbers for holistic-scholar is: 3239633.
One of the special magic numbers for alike-parable is: 1602459.
One of the special magic numbers for troubled-daughter is: 8845792.
One of the special magic numbers for drunk-panic is: 2759403.
One of the special magic numbers for mute-pumpkinseed is: 7980578.
One of the special magic numbers for lively-jailhouse is: 6820392.
One of the special magic numbers for merciful-federation is: 6666425.
One of the special magic numbers for satisfying-limb is: 1252618.
One of the special magic numbers for wrathful-yellowjacket is: 6667228.
One of the special magic numbers for pretty-dirndl is: 4135172.
[… 2,368 lines omitted for display …]
One of the special magic numbers for grouchy-sushi is: 9768392.
One of the special magic numbers for woozy-talking is: 5678790.
What is the special magic number for drunk-panic mentioned in the provided text?
Original prompt 130,507 tokens, 5,718 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1931956Aux 20155751238Ours2759403Ours, no steer.2759403PiT-FT1931956Qwen 27B2759403
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2759403.

13 characters10 tokens

Aux 2015

Missed

2153616.

13 characters10 tokens

PiT-FT 2015

Missed

not in the sample you have provided. [ender of the special magic numbers for disgusted-sauce is: 7871617. [ender of the special magic numbers for gaudy-tear is: 8102057. [ender of the special magic numbers for giddy-fever is: 7871617. [ender of the special magic numbers for sluggish-sauce is: 807857. [ender of the special magic numbers for waggish-tear is: 8106903. [ender of the special magic numbers for giddy-w

416 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for the most common rambunctious-style is:

Stupid-cous is:

Quixotic-cuss is:

Vile-pilky is:

Vile-pilky is the special Epicurean number for rambunctious-cuss is:

Vile-pilky is the special Vile-pilky number for rambunctious-machine is:

Vile-pilky is

325 characters128 tokens