Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#069 · needle at 84% depth#070 · needle at 67% depth#071 · needle at 45% depth#072 · needle at 49% depth#073 · needle at 79% depth#074 · needle at 15% depth#075 · needle at 35% depth#076 · needle at 12% depth#077 · needle at 63% depth#078 · needle at 82% depth#079 · needle at 92% depth#080 · needle at 19% depth#081 · needle at 56% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for few-mycoplasma is: 3214124.
One of the special magic numbers for short-router is: 8681053.
[… 1,973 lines omitted for display …]
One of the special magic numbers for substantial-awe is: 2370098.
One of the special magic numbers for futuristic-cloud is: 3470539.
One of the special magic numbers for swanky-tapioca is: 5638903.
One of the special magic numbers for loud-guilder is: 2151935.
One of the special magic numbers for wise-apartment is: 9564764.
One of the special magic numbers for sulky-attorney is: 8765634.
One of the special magic numbers for utopian-emerald is: 1790557.
One of the special magic numbers for elegant-telescreen is: 2086119.
One of the special magic numbers for bashful-gift is: 2809117.
One of the special magic numbers for questionable-leaker is: 8567216.
One of the special magic numbers for hilarious-sportsman is: 3717049.
One of the special magic numbers for breakable-rabbit is: 9220713.
One of the special magic numbers for new-god is: 4626966.
One of the special magic numbers for versed-epauliere is: 4952328.
[… 3,725 lines omitted for display …]
One of the special magic numbers for quixotic-subsection is: 1247742.
One of the special magic numbers for tame-kiosk is: 4805315.
What is the special magic number for elegant-telescreen mentioned in the provided text?
Original prompt 130,462 tokens, 5,718 linesShown 20 lines around the needleNeedle at 35% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6794593Aux 20157065709Ours2086119Ours, no steer.2086119PiT-FT6794593Qwen 27B2086119
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2086119.

13 characters10 tokens

Aux 2015

Missed

6096937.

13 characters10 tokens

PiT-FT 2015

Missed

a function and not a string. And, for the special magic number for the gracious-homesp is also a function and not a string. But how to interpret between these two statements? <|end|>al|>ine Great ..... ... ... -- ... -- -- For those who love freedom, th es for, those who ,love it, when does th es for, those who ,love to th es, ,when does e to th es, those who ,love not o to th n, those who d not o to th e, those w o not o to th n,

435 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean Epicurean The special Gavian Epicurean The special Quixotic-hypothetical Epicurean The special Quixotic-hypothetical Epicurean The special Quixotic-hypothetical Epicurean The special Quixotic-hypothetical Epicurean The special Quixotic-hypothetical Quixotic-hypothetical The special Quixotic-hypothetical Quixotic-hypothetical The special Quixotic-hypothetical Quixotic-hypothetical

426 characters128 tokens