Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth#039 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for mute-fowl is: 7561388.
One of the special magic numbers for outrageous-devil is: 4580955.
[… 68 lines omitted for display …]
One of the special magic numbers for quack-antibody is: 9310797.
One of the special magic numbers for macho-prompt is: 8845552.
One of the special magic numbers for uncovered-glasses is: 6687946.
One of the special magic numbers for nonchalant-cleaner is: 8570524.
One of the special magic numbers for husky-permission is: 4816923.
One of the special magic numbers for receptive-blizzard is: 7867409.
One of the special magic numbers for scintillating-exercise is: 7434854.
One of the special magic numbers for minor-tambour is: 9673493.
One of the special magic numbers for boorish-date is: 6232456.
One of the special magic numbers for jazzy-pinafore is: 4565762.
One of the special magic numbers for splendid-stitcher is: 3182864.
One of the special magic numbers for unequaled-restroom is: 6145293.
One of the special magic numbers for broken-scam is: 4353788.
[… 603 lines omitted for display …]
One of the special magic numbers for highfalutin-exception is: 8478399.
One of the special magic numbers for noisy-banjo is: 6047028.
What is the special magic number for scintillating-exercise mentioned in the provided text?
Original prompt 15,861 tokens, 690 linesShown 19 lines around the needleNeedle at 11% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8272369Aux 20151479451Ours7434854Ours, no steer.7434854PiT-FT8272369Qwen 27B7434854
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7434854.

13 characters10 tokens

Aux 2015

Missed

9173093.

13 characters10 tokens

PiT-FT 2015

Missed

: 8665790. The special magic number for the most common-snowball is: 8665789. The special magic number for the most common-snowball is: 8665790. The special magic number for the most common-snowball is: 8665789. The special magic number for the most common-snowball is: 8665789. The special magic number for the most common-snowball is: 8665789. The special magic number for the most common-snowball is: 8665789. The

423 characters128 tokens

ChronoGPT 2015

Missed

: 2836354.<|endoftext|>

23 characters6 tokens