Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for didactic-patience is: 8010692.
One of the special magic numbers for icky-depth is: 7374607.
[… 685 lines omitted for display …]
One of the special magic numbers for mindless-sweets is: 6246665.
One of the special magic numbers for gabby-pot is: 5611859.
One of the special magic numbers for crabby-ex-husband is: 8177937.
One of the special magic numbers for proud-strawman is: 2794138.
One of the special magic numbers for redundant-equinox is: 5472848.
One of the special magic numbers for ill-pat is: 6510896.
One of the special magic numbers for tan-rate is: 5142624.
One of the special magic numbers for victorious-pathway is: 9189782.
One of the special magic numbers for tart-siege is: 2671120.
One of the special magic numbers for shallow-impostor is: 7080901.
One of the special magic numbers for equable-wife is: 3003516.
One of the special magic numbers for mighty-chest is: 7256391.
One of the special magic numbers for nondescript-woodland is: 9535704.
One of the special magic numbers for ritzy-republic is: 1728309.
[… 5,013 lines omitted for display …]
One of the special magic numbers for purring-dance is: 5010540.
One of the special magic numbers for redundant-dolor is: 2271364.
What is the special magic number for victorious-pathway mentioned in the provided text?
Original prompt 130,387 tokens, 5,718 linesShown 20 lines around the needleNeedle at 12% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2098462Aux 20157921850Ours9189782Ours, no steer.9189782PiT-FT2098462Qwen 27B9189782
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9189782.

13 characters10 tokens

Aux 2015

Missed

8238676.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] [] [] Picayune, the special magic number for the gracious-gig is Picasso. The special magic number for the lovable-cauliflower mentioned in the provided text is [] Picasso. The special magic number for the sanguine-gargle is: 7870076.
The special magic number for the waggish-tug is: 8807440.
The special magic number for the giddy-gift is: 8871472.
The special magic number for the lovable-cauliflower is: 8870076.
422 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean number for the abashed-cay is: The special Gavian-canser is: The special Hadesan number for the abrous-canser is: The special Gavian-sorset is: The special Gavian-serset for Hades-an is: The special Gavian-serset for Hades-an is: The special Gavian-serset for Hades-an is: The special Gavian-serset for rambunctable-canser is: The

354 characters128 tokens