Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#000 · needle at 26% depth#001 · needle at 78% depth#002 · needle at 43% depth#003 · needle at 1% depth#004 · needle at 80% depth#005 · needle at 96% depth#006 · needle at 38% depth#007 · needle at 3% depth#008 · needle at 38% depth#009 · needle at 99% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for defeated-tea is: 9404573.
One of the special magic numbers for watchful-feather is: 5668303.
[… 59 lines omitted for display …]
One of the special magic numbers for soggy-mastoid is: 8723225.
One of the special magic numbers for wakeful-service is: 5909777.
One of the special magic numbers for square-skywalk is: 6479130.
One of the special magic numbers for harmonious-thread is: 9285432.
One of the special magic numbers for unsightly-tile is: 7409931.
One of the special magic numbers for nutritious-principle is: 7332392.
One of the special magic numbers for impartial-verification is: 9845869.
One of the special magic numbers for unbecoming-outlook is: 4218909.
One of the special magic numbers for adventurous-put is: 7117506.
One of the special magic numbers for equable-injustice is: 9554120.
One of the special magic numbers for colorful-bookend is: 9576145.
One of the special magic numbers for inexpensive-manner is: 6991629.
One of the special magic numbers for organic-dearest is: 5872975.
One of the special magic numbers for evil-screwdriver is: 9544435.
[… 5,639 lines omitted for display …]
One of the special magic numbers for distinct-dividend is: 7272323.
One of the special magic numbers for adhesive-master is: 5254457.
What is the special magic number for unbecoming-outlook mentioned in the provided text?
Original prompt 130,410 tokens, 5,718 linesShown 20 lines around the needleNeedle at 1% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2821446Aux 20153633801Ours4218909Ours, no steer.4218909PiT-FT2821446Qwen 27B4218909
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4218909.

13 characters10 tokens

Aux 2015

Missed

9756698.

13 characters10 tokens

PiT-FT 2015

Missed

: 7570056. [assistant]

The special magic numbers for the most part is: 7570056. [assistant] "Paris Hilton" [Paris] Hilton Paris Hilton Paris Paris Hilton Paris Paris Hilton Paris Paris Hilton Paris Paris Hilton Paris Paris Hilton Paris Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton Paris Hilton

655 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurus number for the following: The special Epicurus number for the following: The special Gavialhear mentioned in the behe The special Gavialhe arboreal is the special Gavialhe arboreal The special Gavialhe cian is the special Gavialhe arboreal The special Gavialhe cian for the following: The special Gavialhe arboreal is the special Gavialhe arboreal The special Gavialhe arboreal The special Gavial

431 characters128 tokens