Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#016 · needle at 56% depth#017 · needle at 48% depth#018 · needle at 34% depth#019 · needle at 88% depth#020 · needle at 50% depth#021 · needle at 65% depth#022 · needle at 29% depth#023 · needle at 47% depth#024 · needle at 37% depth#025 · needle at 64% depth#026 · needle at 93% depth#027 · needle at 50% depth#028 · needle at 72% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for slow-bondsman is: 7649771.
One of the special magic numbers for pleasant-complicity is: 1362281.
[… 87 lines omitted for display …]
One of the special magic numbers for inconclusive-geology is: 4957943.
One of the special magic numbers for fanatical-label is: 5947520.
One of the special magic numbers for numberless-purpose is: 1493242.
One of the special magic numbers for gifted-talent is: 9370219.
One of the special magic numbers for hospitable-boy is: 9059779.
One of the special magic numbers for macho-therapy is: 6093126.
One of the special magic numbers for rural-glass is: 5841463.
One of the special magic numbers for bashful-spiral is: 8346285.
One of the special magic numbers for vague-university is: 6464008.
One of the special magic numbers for little-moose is: 4738590.
One of the special magic numbers for steadfast-brass is: 8332874.
One of the special magic numbers for impartial-mast is: 3864247.
One of the special magic numbers for changeable-crewmen is: 4888291.
One of the special magic numbers for roasted-want is: 4778634.
[… 223 lines omitted for display …]
One of the special magic numbers for amused-accusation is: 7263018.
One of the special magic numbers for creepy-townhouse is: 1628699.
What is the special magic number for bashful-spiral mentioned in the provided text?
Original prompt 7,661 tokens, 330 linesShown 20 lines around the needleNeedle at 29% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7880529Aux 20158346285Ours8346285Ours, no steer.8346285PiT-FT7880529Qwen 27B8346285
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8346285.

13 characters10 tokens

Aux 2015

Missed

7655649.

13 characters10 tokens

PiT-FT 2015

Missed

: 8743662. The special magic number for awkward-taco mentioned in the provided text is: 8292346. The special magic number for quick-bounce mentioned in the provided text is: 8297037. The special magic number for unpleasant-budge mentioned in the provided text is: 8873557. The special magic number for uncertain-taco mentioned in the provided text is: 8292037. The special magic number for likeable-soul is: 8292346. The special magic number for grateful-gaffe is: 8292037

478 characters128 tokens

ChronoGPT 2015

Missed

: 5331209.<|endoftext|>

23 characters7 tokens