Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#047 · needle at 85% depth#048 · needle at 91% depth#049 · needle at 30% depth#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for acrid-luck is: 7322347.
One of the special magic numbers for uttermost-sled is: 2082634.
[… 2,421 lines omitted for display …]
One of the special magic numbers for gruesome-yoyo is: 1279228.
One of the special magic numbers for spotless-bookmark is: 1131472.
One of the special magic numbers for symptomatic-tactile is: 1203369.
One of the special magic numbers for resonant-bowl is: 2721340.
One of the special magic numbers for scrawny-information is: 1031214.
One of the special magic numbers for determined-reporter is: 9141562.
One of the special magic numbers for successful-photograph is: 2008582.
One of the special magic numbers for small-labour is: 5638711.
One of the special magic numbers for impossible-octagon is: 2855512.
One of the special magic numbers for troubled-donkey is: 8055662.
One of the special magic numbers for filthy-heirloom is: 2415382.
One of the special magic numbers for alert-evil is: 4775916.
One of the special magic numbers for crabby-longitude is: 6519654.
One of the special magic numbers for tasty-providence is: 8667933.
[… 404 lines omitted for display …]
One of the special magic numbers for berserk-cemetery is: 9378459.
One of the special magic numbers for kind-roadway is: 6054947.
What is the special magic number for small-labour mentioned in the provided text?
Original prompt 64,974 tokens, 2,845 linesShown 20 lines around the needleNeedle at 85% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2615877Aux 20152139823Ours5638711Ours, no steer.5638711PiT-FT2615877Qwen 27B5638711
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5638711.

13 characters10 tokens

Aux 2015

Missed

5435125.

13 characters10 tokens

PiT-FT 2015

Missed

: 78535. The special magic number for sluggish-sauce is: 78535. The special magic number for fearful-firm is: 85512. The special magic number for obnoxious-sauce is: 85512. The special magic number for vivacious-sauce is: 85512. The special magic number for icky-sauce is: 85512. The special magic number for giddy-sauce is: 85512. The special magic number for loutish-cauliflower is: 78535

397 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-nun is: The special magic number for rambunctious-nuke mentioned in the provided text is: The special magic number for rambunctious-nuke mentioned in the provided text is: The special magic number for rambunctious-nuke mentioned in the provided text is: The special magic number for rambunctious-nuke mentioned in the provided text is: The special magic number for rambunctious-nuke mentioned in the provided text is: The special magic number for rambunctious-n

505 characters128 tokens