Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#070 · needle at 4% depth#071 · needle at 17% depth#072 · needle at 93% depth#073 · needle at 13% depth#074 · needle at 29% depth#075 · needle at 77% depth#076 · needle at 76% depth#077 · needle at 80% depth#078 · needle at 25% depth#079 · needle at 55% depth#080 · needle at 85% depth#081 · needle at 97% depth#082 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for adventurous-astrology is: 2933937.
One of the special magic numbers for aquatic-clipboard is: 4957727.
[… 244 lines omitted for display …]
One of the special magic numbers for hulking-homeland is: 7988540.
One of the special magic numbers for ad hoc-inhibition is: 7118610.
One of the special magic numbers for grouchy-dragonfruit is: 8028142.
One of the special magic numbers for short-kilometer is: 1403640.
One of the special magic numbers for lively-standardisation is: 1722755.
One of the special magic numbers for quarrelsome-step-sister is: 6042717.
One of the special magic numbers for therapeutic-nanoparticle is: 6607333.
One of the special magic numbers for tightfisted-pleat is: 8720795.
One of the special magic numbers for trite-bosom is: 2461618.
One of the special magic numbers for perfect-command is: 1241067.
One of the special magic numbers for gigantic-popsicle is: 3109953.
One of the special magic numbers for aquatic-interconnection is: 5744954.
One of the special magic numbers for phobic-trek is: 4534714.
One of the special magic numbers for accurate-apology is: 9786538.
[… 66 lines omitted for display …]
One of the special magic numbers for abundant-enzyme is: 7278243.
One of the special magic numbers for embarrassed-abacus is: 5984662.
What is the special magic number for tightfisted-pleat mentioned in the provided text?
Original prompt 7,660 tokens, 330 linesShown 20 lines around the needleNeedle at 76% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8433102Aux 20158720795Ours8720795Ours, no steer.8720795PiT-FT8433102Qwen 27B8720795
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8720795.

13 characters10 tokens

Aux 2015

Missed

5841075.

13 characters10 tokens

PiT-FT 2015

Missed

: 8804519. The special magic number for awkward-tussle mentioned in the provided text is: 8804519. The special magic number for brawny-basket mentioned in the provided text is: 8804519. The special magic number for berserk-profession mentioned in the provided text is: 8804519. The special magic number for lopsided-tension mentioned in the provided text is: 8804519. The special magic number for reluctant-tug is: 8804519. The special magic number for brawny-

466 characters128 tokens

ChronoGPT 2015

Missed

: 729<|endoftext|>

18 characters4 tokens