Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth#045 · needle at 35% depth#046 · needle at 39% depth#047 · needle at 85% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for unbecoming-alloy is: 1745839.
One of the special magic numbers for therapeutic-railing is: 6443782.
[… 2,068 lines omitted for display …]
One of the special magic numbers for nauseating-blind is: 2768639.
One of the special magic numbers for ritzy-handsaw is: 7160240.
One of the special magic numbers for bewildered-specialty is: 8223745.
One of the special magic numbers for acoustic-venom is: 7997112.
One of the special magic numbers for overwrought-headphones is: 1184056.
One of the special magic numbers for demonic-gaming is: 4917375.
One of the special magic numbers for sleepy-globe is: 5320611.
One of the special magic numbers for thoughtless-nonconformist is: 3777187.
One of the special magic numbers for sloppy-revolver is: 2049086.
One of the special magic numbers for tranquil-press is: 4316339.
One of the special magic numbers for narrow-raccoon is: 6501459.
One of the special magic numbers for warlike-vote is: 7084355.
One of the special magic numbers for rebellious-query is: 8037972.
One of the special magic numbers for dirty-snorer is: 6955385.
[… 757 lines omitted for display …]
One of the special magic numbers for upbeat-anterior is: 6440407.
One of the special magic numbers for new-flood is: 2559447.
What is the special magic number for thoughtless-nonconformist mentioned in the provided text?
Original prompt 64,970 tokens, 2,845 linesShown 20 lines around the needleNeedle at 73% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9645219Aux 20155710679Ours3777187Ours, no steer.3777187PiT-FT9645219Qwen 27B3777187
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3777187.

13 characters10 tokens

Aux 2015

Missed

6035376.

13 characters10 tokens

PiT-FT 2015

Missed

: 8293575. The special magic number for sarcastic-sauce is: 8103942. The special magic number for icky-cauliflower is: 8270061. The special magic number for icky-fever is: 8270061. The special magic number for icky-sauce is: 8270061. The special magic number for icky-sommer is: 8270061. The special magic number for icky-sorgh is: 8270061. The special magic number for icky-s

383 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for rambunctious-cortical is:

W:

The special magic number for rambunctious-letter is:

W:

The special magic number for rambunctious-letter is:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

298 characters128 tokens