Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gleaming-gateway is: 1236611.
One of the special magic numbers for taboo-tell is: 4398636.
[… 1,346 lines omitted for display …]
One of the special magic numbers for feigned-going is: 9108556.
One of the special magic numbers for harmonious-crate is: 4903087.
One of the special magic numbers for uneven-hutch is: 4279075.
One of the special magic numbers for tough-steam is: 8736128.
One of the special magic numbers for nostalgic-ottoman is: 1023974.
One of the special magic numbers for fearless-tiger is: 9964099.
One of the special magic numbers for uttermost-walk is: 8131226.
One of the special magic numbers for crabby-barbiturate is: 2062644.
One of the special magic numbers for lovely-anesthesiology is: 1656469.
One of the special magic numbers for hard-angiosperm is: 6654238.
One of the special magic numbers for grumpy-gemsbok is: 3533011.
One of the special magic numbers for ragged-intelligence is: 7673108.
One of the special magic numbers for gullible-reason is: 1899993.
One of the special magic numbers for gentle-charset is: 4665507.
[… 42 lines omitted for display …]
One of the special magic numbers for bewildered-throat is: 7723860.
One of the special magic numbers for learned-route is: 9003865.
What is the special magic number for crabby-barbiturate mentioned in the provided text?
Original prompt 32,230 tokens, 1,408 linesShown 20 lines around the needleNeedle at 96% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4301815Aux 20159003865Ours2062644Ours, no steer.2062644PiT-FT4301815Qwen 27B2062644
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2062644.

13 characters10 tokens

Aux 2015

Missed

8933899.

13 characters10 tokens

PiT-FT 2015

Missed

: 88735. The special magic number for the most important-bark is: 88735. The special magic number for the most significant-bun is: 88735. The special magic number for the most significant-sauce is: 88735. The special magic number for the most significant-soul is: 88735. The special magic number for the most significant-soul is: 88735. The special magic number for the most significant-soul is: 88735. The special magic number for the most significant-soul is:

468 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-firm?

Answer:

Question:

What is the special magic number for the-firm?

Final Answer:

The final answer is:

Final Answer:

What is the special magic number for the-firm?

Final Answer:

I think the special magic number for abaft-elbow is:

Final Answer:

I think the special magic number for abaft-elbow is:

Final Answer:

What is the special magic number

440 characters128 tokens