Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#092 · needle at 44% depth#093 · needle at 39% depth#094 · needle at 37% depth#095 · needle at 92% depth#096 · needle at 5% depth#097 · needle at 62% depth#098 · needle at 89% depth#099 · needle at 32% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fast-upward is: 1104259.
One of the special magic numbers for deranged-foundation is: 6663301.
[… 1,244 lines omitted for display …]
One of the special magic numbers for weary-palm is: 6679962.
One of the special magic numbers for jaded-everyone is: 5247696.
One of the special magic numbers for voiceless-treasure is: 2755158.
One of the special magic numbers for numerous-boat is: 3105456.
One of the special magic numbers for depressed-prizefight is: 3235328.
One of the special magic numbers for solid-glutamate is: 8490256.
One of the special magic numbers for jagged-injustice is: 5687045.
One of the special magic numbers for graceful-replication is: 4105829.
One of the special magic numbers for panoramic-forehead is: 9739231.
One of the special magic numbers for pleasant-piglet is: 1220858.
One of the special magic numbers for hushed-quiver is: 1899996.
One of the special magic numbers for lazy-reasoning is: 2464324.
One of the special magic numbers for short-solidity is: 4154823.
One of the special magic numbers for beautiful-law is: 8113653.
[… 144 lines omitted for display …]
One of the special magic numbers for sore-liberty is: 6020218.
One of the special magic numbers for hissing-bathtub is: 9317850.
What is the special magic number for graceful-replication mentioned in the provided text?
Original prompt 32,237 tokens, 1,408 linesShown 20 lines around the needleNeedle at 89% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7314906Aux 20156020218Ours4105829Ours, no steer.4105829PiT-FT7314906Qwen 27B4105829
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4105829.

13 characters10 tokens

Aux 2015

Missed

7500296.

13 characters10 tokens

PiT-FT 2015

Missed

: 7595761. The special magic number for the most popular-sauce is: 8013025. The special magic number for the most popular-sauce is: 8013025. The special magic number for the most popular-sauce is: 8013025. The special magic number for the most popular-sauce is: 8013025. The special magic number for the most popular-sauce is: 8013025. The special magic number for the most popular-sauce is: 8013025. The

411 characters128 tokens

ChronoGPT 2015

Missed

: 1878487.<|endoftext|>

23 characters6 tokens