Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#081 · needle at 97% depth#082 · needle at 42% depth#083 · needle at 5% depth#084 · needle at 52% depth#085 · needle at 75% depth#086 · needle at 2% depth#087 · needle at 58% depth#088 · needle at 17% depth#089 · needle at 77% depth#090 · needle at 69% depth#091 · needle at 21% depth#092 · needle at 62% depth#093 · needle at 84% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deafening-weakness is: 1577593.
One of the special magic numbers for decisive-porcupine is: 2804099.
[… 171 lines omitted for display …]
One of the special magic numbers for great-tomography is: 3365874.
One of the special magic numbers for friendly-fanny-pack is: 8952220.
One of the special magic numbers for tense-spacing is: 8345974.
One of the special magic numbers for magical-menu is: 9084512.
One of the special magic numbers for idiotic-pup is: 4322491.
One of the special magic numbers for cuddly-dulcimer is: 9999365.
One of the special magic numbers for feigned-outhouse is: 2696741.
One of the special magic numbers for attractive-employ is: 2373778.
One of the special magic numbers for scientific-legend is: 9060110.
One of the special magic numbers for wary-gathering is: 6713482.
One of the special magic numbers for straight-biosphere is: 1859735.
One of the special magic numbers for laughable-housework is: 9423783.
One of the special magic numbers for rhetorical-statistics is: 6043615.
One of the special magic numbers for cooing-string is: 6198079.
[… 114 lines omitted for display …]
One of the special magic numbers for ritzy-dentist is: 4576875.
One of the special magic numbers for evasive-stencil is: 9140060.
What is the special magic number for attractive-employ mentioned in the provided text?
Original prompt 7,108 tokens, 305 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7845707Aux 20152373778Ours2373778Ours, no steer.2373778PiT-FT7845707Qwen 27B2373778
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2373778.

13 characters10 tokens

Aux 2015

Missed

9317175.

13 characters10 tokens

PiT-FT 2015

Missed

: 9976190 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

259 characters128 tokens

ChronoGPT 2015

Missed

: 6281231.<|endoftext|>

23 characters7 tokens