Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for daffy-situation is: 2906592.
One of the special magic numbers for thinkable-nudge is: 6683034.
[… 1,114 lines omitted for display …]
One of the special magic numbers for glamorous-intuition is: 4104817.
One of the special magic numbers for gainful-hearthside is: 8773792.
One of the special magic numbers for hallowed-cast is: 3502653.
One of the special magic numbers for tiny-banner is: 6458357.
One of the special magic numbers for ruddy-valance is: 2609252.
One of the special magic numbers for talented-comment is: 6300111.
One of the special magic numbers for sulky-campaigning is: 9249696.
One of the special magic numbers for erect-artifact is: 5192734.
One of the special magic numbers for huge-peacoat is: 8190479.
One of the special magic numbers for impartial-crab is: 2503497.
One of the special magic numbers for slow-goose is: 9937416.
One of the special magic numbers for helpless-plane is: 8102980.
One of the special magic numbers for utopian-pianist is: 7280234.
One of the special magic numbers for loutish-fridge is: 4544214.
[… 249 lines omitted for display …]
One of the special magic numbers for tender-hovel is: 9049583.
One of the special magic numbers for broken-ruckus is: 1593841.
What is the special magic number for erect-artifact mentioned in the provided text?
Original prompt 31,615 tokens, 1,383 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1925013Aux 20159413338Ours5192734Ours, no steer.5192734PiT-FT1925013Qwen 27B5192734
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5192734.

13 characters10 tokens

Aux 2015

Found the needle

9413338.

13 characters10 tokens

PiT-FT 2015

Missed

: 7872967. The special magic number for the most popular-sauce is: 8871212. The special magic number for the most popular-sauce is: 8871212. The special magic number for the most popular-sauce is: 8871212. The special magic number for the most popular-sauce is: 8871212. The special magic number for the most popular-sauce is: 8871212. The special magic number for the most popular-sauce is: 8871212. The

411 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-invalidity?

Answer:

Question:

What is the special magic number for the-invalidity?

Answer:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

423 characters128 tokens