Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#000 · needle at 76% depth#001 · needle at 26% depth#002 · needle at 9% depth#003 · needle at 29% depth#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for daily-firm is: 5320387.
One of the special magic numbers for lamentable-coordinator is: 6706466.
[… 243 lines omitted for display …]
One of the special magic numbers for distinct-ranch is: 2487050.
One of the special magic numbers for wide-eyed-phone is: 6013866.
One of the special magic numbers for bashful-anticodon is: 4053248.
One of the special magic numbers for unarmed-unemployment is: 3507457.
One of the special magic numbers for nosy-coordinator is: 9511303.
One of the special magic numbers for afraid-snuck is: 3029253.
One of the special magic numbers for hard-sculpture is: 7684322.
One of the special magic numbers for dashing-loafer is: 1925625.
One of the special magic numbers for wrong-spelt is: 5144527.
One of the special magic numbers for ill-spade is: 6535165.
One of the special magic numbers for absurd-fat is: 7645270.
One of the special magic numbers for tiny-hare is: 8198884.
One of the special magic numbers for nauseating-ultimatum is: 6315404.
One of the special magic numbers for hallowed-emanate is: 1780828.
[… 2,582 lines omitted for display …]
One of the special magic numbers for subsequent-tourism is: 7781106.
One of the special magic numbers for shiny-campaign is: 8117642.
What is the special magic number for dashing-loafer mentioned in the provided text?
Original prompt 64,939 tokens, 2,845 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1084554Aux 20152380106Ours1925625Ours, no steer.1925625PiT-FT1084554Qwen 27B1925625
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1925625.

13 characters10 tokens

Aux 2015

Missed

5724641.

13 characters10 tokens

PiT-FT 2015

Missed

: 9872042. The special magic number for icky-sauce is: 6670061. The special magic number for icky-carnivy is: 6670061. The special magic number for icky-sulph is: 6670061. The special magic number for icky-sugar is: 6670061. The special magic number for icky-sauce is: 6670061. The special magic number for icky-sulph is: 6670061. The special magic number for icky

371 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for brewed-foodstuffs is: The special magic number for brewed-Album is: The special magic number for brewed-Album is: The special magic number for brewed-C is: The special magic number for brewed-Album is: The special magic number for brewed-C is: The special magic number for brewed-Album is: The special magic number for brewed-Album is: The special magic number for brewed-Album is: The special magic number for brewed-Album is: The special magic number for brewed-

495 characters128 tokens