Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for flowery-registration is: 1635562.
One of the special magic numbers for noisy-horror is: 7221684.
[… 444 lines omitted for display …]
One of the special magic numbers for taboo-potential is: 9551323.
One of the special magic numbers for seemly-timeline is: 3792665.
One of the special magic numbers for gifted-cure is: 1907856.
One of the special magic numbers for skinny-homonym is: 3018322.
One of the special magic numbers for crazy-succotash is: 2655490.
One of the special magic numbers for melted-vanadyl is: 1260805.
One of the special magic numbers for sweet-blackboard is: 2828009.
One of the special magic numbers for verdant-revolver is: 3896236.
One of the special magic numbers for hellish-arrest is: 6813561.
One of the special magic numbers for exuberant-curl is: 1206467.
One of the special magic numbers for swift-heartbeat is: 7733894.
One of the special magic numbers for jumpy-settlement is: 5422712.
One of the special magic numbers for empty-photoreceptor is: 2577090.
One of the special magic numbers for worried-moment is: 8596727.
[… 226 lines omitted for display …]
One of the special magic numbers for tall-muffin is: 7143033.
One of the special magic numbers for aggressive-dory is: 9097097.
What is the special magic number for verdant-revolver mentioned in the provided text?
Original prompt 15,865 tokens, 690 linesShown 20 lines around the needleNeedle at 65% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2922664Aux 20151828258Ours3896236Ours, no steer.3896236PiT-FT2922664Qwen 27B3896236
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3896236.

13 characters10 tokens

Aux 2015

Missed

7504661.

13 characters10 tokens

PiT-FT 2015

Missed

: 8661933. The special magic number for loutish-sauce is: 8661933. The special magic number for lanky-sauce is: 8661933. The special magic number for loutish-sauce is: 8661933. The special magic number for lanky-sauce is: 8661933. The special magic number for lanky-sauce is: 8661933. The special magic number for lanky-sauce is: 8661933. The special magic number for

374 characters128 tokens

ChronoGPT 2015

Missed

: 5480163.<|endoftext|>

23 characters7 tokens