Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deadpan-insurrection is: 6115954.
One of the special magic numbers for easy-photodiode is: 6711286.
[… 338 lines omitted for display …]
One of the special magic numbers for skillful-democrat is: 7629710.
One of the special magic numbers for grieving-knot is: 9654310.
One of the special magic numbers for gentle-zoology is: 3343303.
One of the special magic numbers for burly-compassion is: 1146041.
One of the special magic numbers for short-measurement is: 3680258.
One of the special magic numbers for educated-nut is: 3145504.
One of the special magic numbers for impartial-entrance is: 2553254.
One of the special magic numbers for lethal-icicle is: 4928024.
One of the special magic numbers for yummy-spy is: 5455445.
One of the special magic numbers for invincible-providence is: 6924480.
One of the special magic numbers for picayune-photography is: 7178480.
One of the special magic numbers for wonderful-witch is: 4321219.
One of the special magic numbers for old-lesson is: 3188785.
One of the special magic numbers for flashy-elk is: 9131461.
[… 332 lines omitted for display …]
One of the special magic numbers for breezy-wad is: 2300169.
One of the special magic numbers for clear-communion is: 8838124.
What is the special magic number for lethal-icicle mentioned in the provided text?
Original prompt 15,851 tokens, 690 linesShown 20 lines around the needleNeedle at 50% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2847199Aux 20152131590Ours4928024Ours, no steer.4928024PiT-FT2847199Qwen 27B4928024
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4928024.

13 characters10 tokens

Aux 2015

Missed

1799541.

13 characters10 tokens

PiT-FT 2015

Missed

: 8281628. The special magic number for the icky-sick is: 8276632. The special magic number for the icky-sick is: 8276632. The special magic number for the icky-sick is: 8276632. The special magic number for the icky-sick is: 8276632. The special magic number for the icky-sick is: 8276632. The special magic number for the icky-sick is: 8276632. The special magic number for the

387 characters128 tokens

ChronoGPT 2015

Missed

: 7458322.<|endoftext|>

23 characters7 tokens