Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for aboard-rank is: 7528504.
One of the special magic numbers for flippant-pickax is: 9541995.
[… 690 lines omitted for display …]
One of the special magic numbers for worried-legitimacy is: 2449171.
One of the special magic numbers for guarded-emergent is: 3429253.
One of the special magic numbers for obsequious-wolf is: 1711083.
One of the special magic numbers for tricky-stand is: 8753041.
One of the special magic numbers for tearful-drama is: 5234555.
One of the special magic numbers for defiant-cancer is: 5086278.
One of the special magic numbers for inconclusive-pick is: 1971277.
One of the special magic numbers for upset-concept is: 9544438.
One of the special magic numbers for spiritual-lizard is: 3107043.
One of the special magic numbers for woozy-yourself is: 3549665.
One of the special magic numbers for attractive-jury is: 9334282.
One of the special magic numbers for fantastic-ivory is: 5296641.
One of the special magic numbers for cooperative-enclave is: 1618427.
One of the special magic numbers for faint-fraudster is: 2511936.
[… 698 lines omitted for display …]
One of the special magic numbers for thoughtful-university is: 9519973.
One of the special magic numbers for grouchy-tomb is: 3772382.
What is the special magic number for upset-concept mentioned in the provided text?
Original prompt 32,222 tokens, 1,408 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1215041Aux 20159181006Ours9544438Ours, no steer.9544438PiT-FT1215041Qwen 27B9544438
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9544438.

13 characters10 tokens

Aux 2015

Found the needle

9181006.

13 characters10 tokens

PiT-FT 2015

Missed

: 8690696. The special magic number for the awkward-sauerk mentioned in the provided text is: 8690696. The special magic number for the fearful-feverish mentioned in the provided text is: 8690696. The special magic number for the impatient-honey is: 8690696. The special magic number for the jaded-suck is: 8690696. The special magic number for the careless-caulk is: 8690696. The special magic number for the lascivious-sir is: 869

438 characters128 tokens

ChronoGPT 2015

Missed

: 28115<|endoftext|>

20 characters4 tokens