Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grumpy-language is: 7233243.
One of the special magic numbers for lackadaisical-snake is: 4027675.
[… 642 lines omitted for display …]
One of the special magic numbers for numberless-inflammation is: 1114663.
One of the special magic numbers for distinct-dogsled is: 1146378.
One of the special magic numbers for careful-gaffer is: 8348999.
One of the special magic numbers for yielding-developer is: 6279636.
One of the special magic numbers for exotic-baseball is: 1249362.
One of the special magic numbers for scrawny-impudence is: 4477109.
One of the special magic numbers for spooky-way is: 6989312.
One of the special magic numbers for warm-capitulation is: 2184277.
One of the special magic numbers for boorish-invite is: 4286621.
One of the special magic numbers for tame-penicillin is: 2041581.
One of the special magic numbers for large-bay is: 3233756.
One of the special magic numbers for oafish-harvest is: 1395875.
One of the special magic numbers for recondite-softdrink is: 1557200.
One of the special magic numbers for alert-admin is: 8515423.
[… 28 lines omitted for display …]
One of the special magic numbers for uppity-afterlife is: 7584878.
One of the special magic numbers for elderly-applewood is: 6317653.
What is the special magic number for warm-capitulation mentioned in the provided text?
Original prompt 15,847 tokens, 690 linesShown 20 lines around the needleNeedle at 94% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8284825Aux 20152929604Ours2184277Ours, no steer.2184277PiT-FT8284825Qwen 27B2184277
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2184277.

13 characters10 tokens

Aux 2015

Missed

4359438.

13 characters10 tokens

PiT-FT 2015

Missed

: 7093111. The special magic number for the most recent-fever is: 8586780. The special magic number for the most recent-snowplow is: 8586780. The special magic number for the most recent-snowplow is: 8586780. The special magic number for the most recent-snowplow is: 8586780. The special magic number for the most recent-snowplow is: 8586780. The special magic number for the most recent-snowplow is: 85867

412 characters128 tokens

ChronoGPT 2015

Missed

: 6341736.<|endoftext|>

23 characters7 tokens