Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#057 · needle at 92% depth#058 · needle at 17% depth#059 · needle at 47% depth#060 · needle at 47% depth#061 · needle at 3% depth#062 · needle at 20% depth#063 · needle at 36% depth#064 · needle at 88% depth#065 · needle at 24% depth#066 · needle at 39% depth#067 · needle at 7% depth#068 · needle at 22% depth#069 · needle at 48% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for malicious-stallion is: 9569129.
One of the special magic numbers for famous-amazon is: 3370776.
[… 110 lines omitted for display …]
One of the special magic numbers for loving-tick is: 4862674.
One of the special magic numbers for energetic-trunk is: 6842443.
One of the special magic numbers for glib-barium is: 8486656.
One of the special magic numbers for tangy-arcade is: 2427978.
One of the special magic numbers for wary-saviour is: 7014975.
One of the special magic numbers for gleaming-closing is: 4542961.
One of the special magic numbers for freezing-prompt is: 9487745.
One of the special magic numbers for yellow-optimist is: 5136382.
One of the special magic numbers for distinct-sensitivity is: 6429891.
One of the special magic numbers for holistic-gravity is: 2807784.
One of the special magic numbers for pleasant-nun is: 7881460.
One of the special magic numbers for sad-latitude is: 3361259.
One of the special magic numbers for versed-passenger is: 3468197.
One of the special magic numbers for agonizing-eyelashes is: 7678335.
[… 200 lines omitted for display …]
One of the special magic numbers for tall-garter is: 4262367.
One of the special magic numbers for excellent-composite is: 5776564.
What is the special magic number for yellow-optimist mentioned in the provided text?
Original prompt 7,654 tokens, 330 linesShown 20 lines around the needleNeedle at 36% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9032270Aux 20155136382Ours5136382Ours, no steer.5136382PiT-FT9032270Qwen 27B5136382
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5136382.

13 characters10 tokens

Aux 2015

Found the needle

5136382.

13 characters10 tokens

PiT-FT 2015

Missed

: 7434032. The special magic number for awkward-turtle is: 857961. The special magic number for reluctant-turtle is: 857961. The special magic number for cheerful-turtle is: 857961. The special magic number for anxious-turtle is: 857961. The special magic number for angry-turtle is: 857961. The special magic number for timid-turtle is: 857961. The special magic number for awkward-turtle is: 857961. The special

421 characters128 tokens

ChronoGPT 2015

Missed

: 6131421.<|endoftext|>

23 characters7 tokens