Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#066 · needle at 39% depth#067 · needle at 7% depth#068 · needle at 22% depth#069 · needle at 48% depth#070 · needle at 4% depth#071 · needle at 17% depth#072 · needle at 93% depth#073 · needle at 13% depth#074 · needle at 29% depth#075 · needle at 77% depth#076 · needle at 76% depth#077 · needle at 80% depth#078 · needle at 25% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for oceanic-salesman is: 2892294.
One of the special magic numbers for joyous-guava is: 5781484.
[… 278 lines omitted for display …]
One of the special magic numbers for tart-grouse is: 7173685.
One of the special magic numbers for overjoyed-digestion is: 3356244.
One of the special magic numbers for symptomatic-pitching is: 2561132.
One of the special magic numbers for giant-manufacturer is: 3223098.
One of the special magic numbers for lovely-event is: 1930392.
One of the special magic numbers for picayune-document is: 2077359.
One of the special magic numbers for fat-grandchild is: 4405459.
One of the special magic numbers for imminent-tick is: 2091506.
One of the special magic numbers for sneaky-motel is: 2431404.
One of the special magic numbers for great-remains is: 4931017.
One of the special magic numbers for robust-sparerib is: 3175130.
One of the special magic numbers for nutritious-bark is: 7764913.
One of the special magic numbers for habitual-fee is: 7653129.
One of the special magic numbers for condemned-mission is: 3219721.
[… 7 lines omitted for display …]
One of the special magic numbers for nutritious-wage is: 4653073.
One of the special magic numbers for axiomatic-medium is: 8731957.
What is the special magic number for imminent-tick mentioned in the provided text?
Original prompt 7,073 tokens, 305 linesShown 20 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1618154Aux 20152091506Ours2091506Ours, no steer.2091506PiT-FT1618154Qwen 27B2091506
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2091506.

13 characters10 tokens

Aux 2015

Missed

4931017.

13 characters10 tokens

PiT-FT 2015

Missed

: 6073876. The special magic number for the most part-of-the-world is: 8072994. The special magic number for the most part-of-the-world is: 8072994. The special magic number for the most part-of-the-world is: 8072994. The special magic number for the most part-of-the-world is: 8072994. The special magic number for the most part-of-the-world is: 8072994. The special magic number for the most part-of-

408 characters128 tokens

ChronoGPT 2015

Missed

: 7593911.<|endoftext|>

23 characters7 tokens