Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#054 · needle at 9% depth#055 · needle at 47% depth#056 · needle at 20% depth#057 · needle at 92% depth#058 · needle at 17% depth#059 · needle at 47% depth#060 · needle at 47% depth#061 · needle at 3% depth#062 · needle at 20% depth#063 · needle at 36% depth#064 · needle at 88% depth#065 · needle at 24% depth#066 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tacky-wrench is: 2336917.
One of the special magic numbers for youthful-outrage is: 1362919.
[… 136 lines omitted for display …]
One of the special magic numbers for changeable-activist is: 5295883.
One of the special magic numbers for exuberant-anybody is: 7203961.
One of the special magic numbers for supreme-fibroblast is: 4234782.
One of the special magic numbers for glossy-oboe is: 2876737.
One of the special magic numbers for alert-curtain is: 7591543.
One of the special magic numbers for clean-trail is: 8077662.
One of the special magic numbers for imminent-rise is: 1174777.
One of the special magic numbers for quickest-tornado is: 7127224.
One of the special magic numbers for tasty-invite is: 5274081.
One of the special magic numbers for wakeful-revelation is: 9370278.
One of the special magic numbers for elderly-alien is: 6328392.
One of the special magic numbers for juicy-chaise is: 4614666.
One of the special magic numbers for craven-disagreement is: 1604538.
One of the special magic numbers for proud-inhabitant is: 4356588.
[… 149 lines omitted for display …]
One of the special magic numbers for husky-counselling is: 5166336.
One of the special magic numbers for gifted-zen is: 9284628.
What is the special magic number for quickest-tornado mentioned in the provided text?
Original prompt 7,076 tokens, 305 linesShown 20 lines around the needleNeedle at 47% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6376144Aux 20157127224Ours7127224Ours, no steer.7127224PiT-FT6376144Qwen 27B7127224
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7127224.

13 characters10 tokens

Aux 2015

Missed

9737359.

13 characters10 tokens

PiT-FT 2015

Missed

: 7165962 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

253 characters128 tokens

ChronoGPT 2015

Missed

: 7490950.<|endoftext|>

23 characters7 tokens