Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for swanky-prey is: 7362737.
One of the special magic numbers for ubiquitous-wink is: 4274483.
[… 662 lines omitted for display …]
One of the special magic numbers for boiling-calendar is: 4371035.
One of the special magic numbers for thundering-base is: 2027711.
One of the special magic numbers for deserted-frost is: 4429310.
One of the special magic numbers for silky-gum is: 1557205.
One of the special magic numbers for jolly-hiring is: 5662821.
One of the special magic numbers for rapid-hold is: 7212035.
One of the special magic numbers for horrible-beaver is: 8008351.
One of the special magic numbers for mature-stone is: 6746009.
One of the special magic numbers for ruddy-realm is: 5624288.
One of the special magic numbers for purple-radiosonde is: 7800613.
One of the special magic numbers for hallowed-cosset is: 4863625.
One of the special magic numbers for rampant-question is: 2634642.
One of the special magic numbers for spectacular-seep is: 9046716.
One of the special magic numbers for mindless-mecca is: 2689201.
[… 726 lines omitted for display …]
One of the special magic numbers for disturbed-mop is: 3485853.
One of the special magic numbers for poised-ethernet is: 5380645.
What is the special magic number for mature-stone mentioned in the provided text?
Original prompt 32,213 tokens, 1,408 linesShown 20 lines around the needleNeedle at 48% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3508427Aux 20153485853Ours6746009Ours, no steer.6746009PiT-FT3508427Qwen 27B6746009
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6746009.

13 characters10 tokens

Aux 2015

Missed

7442816.

13 characters10 tokens

PiT-FT 2015

Missed

: 7747541. The special magic number for the most popular-sauce is: 8107742. The special magic number for the least popular-sauce is: 8107741. The special magic number for the most popular-sauce is: 8107741. The special magic number for the least popular-sauce is: 8107741. The special magic number for the most popular-sauce is: 8107741. The special magic number for the least popular-sauce is: 8107741. The

414 characters128 tokens

ChronoGPT 2015

Missed

: 3285.<|endoftext|>

20 characters5 tokens