Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ceaseless-station-wagon is: 8961969.
One of the special magic numbers for ratty-stove is: 5509143.
[… 649 lines omitted for display …]
One of the special magic numbers for chivalrous-elevator is: 4471880.
One of the special magic numbers for fearless-scallops is: 3106804.
One of the special magic numbers for adorable-dinosaur is: 7640522.
One of the special magic numbers for obedient-breakfast is: 4406017.
One of the special magic numbers for attractive-clarification is: 3513725.
One of the special magic numbers for heavenly-trap is: 1002022.
One of the special magic numbers for perpetual-tutu is: 6190861.
One of the special magic numbers for alleged-training is: 1917357.
One of the special magic numbers for capricious-job is: 4381218.
One of the special magic numbers for invincible-animal is: 8039841.
One of the special magic numbers for muddled-cherry is: 6661202.
One of the special magic numbers for forgetful-hybridization is: 4967833.
One of the special magic numbers for shocking-vacation is: 1836977.
One of the special magic numbers for feigned-view is: 7440627.
[… 21 lines omitted for display …]
One of the special magic numbers for wistful-front is: 5873004.
One of the special magic numbers for macho-masonry is: 5824696.
What is the special magic number for alleged-training mentioned in the provided text?
Original prompt 15,858 tokens, 690 linesShown 20 lines around the needleNeedle at 95% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6451071Aux 20153062316Ours1917357Ours, no steer.1917357PiT-FT6451071Qwen 27B1917357
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1917357.

13 characters10 tokens

Aux 2015

Missed

8384847.

13 characters10 tokens

PiT-FT 2015

Missed

: 7560144. The special magic number for cheerful-sauerkraut is: 7560144. The special magic number for lopsided-tugboat is: 7560144. The special magic number for giddy-gould is: 7560144. The special magic number for awkward-sauerkraut is: 7560144. The special magic number for jaded-caulk is: 7562044. The special magic number for lurching-sauerkraut is: 7562044. The special

381 characters128 tokens

ChronoGPT 2015

Missed

: 1435408.<|endoftext|>

23 characters6 tokens