Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sour-pennant is: 7506850.
One of the special magic numbers for sloppy-favorite is: 2595040.
[… 2,376 lines omitted for display …]
One of the special magic numbers for petite-recovery is: 6427775.
One of the special magic numbers for ad hoc-cupcake is: 8461514.
One of the special magic numbers for wretched-rhinoceros is: 8226893.
One of the special magic numbers for quick-relationship is: 6190100.
One of the special magic numbers for outstanding-study is: 7195972.
One of the special magic numbers for nappy-batter is: 4503722.
One of the special magic numbers for dry-chap is: 1514191.
One of the special magic numbers for puny-short is: 7050058.
One of the special magic numbers for sedate-kindness is: 2717463.
One of the special magic numbers for tasty-gateway is: 6540244.
One of the special magic numbers for psychedelic-focus is: 8013230.
One of the special magic numbers for malicious-oil is: 8953612.
One of the special magic numbers for graceful-alphabet is: 5699043.
One of the special magic numbers for sneaky-optimization is: 5712382.
[… 424 lines omitted for display …]
One of the special magic numbers for mammoth-sauerkraut is: 7472677.
One of the special magic numbers for dirty-nestmate is: 1536828.
What is the special magic number for puny-short mentioned in the provided text?
Original prompt 64,444 tokens, 2,820 linesShown 20 lines around the needleNeedle at 85% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3870132Aux 20155518920Ours7050058Ours, no steer.7050058PiT-FT3870132Qwen 27B7050058
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7050058.

13 characters10 tokens

Aux 2015

Missed

7300819.

13 characters10 tokens

PiT-FT 2015

Missed

: 7297344. The special magic number for the most effective-saucer is: 8107217. The special magic number for the most effective-tissue is: 8107217. The special magic number for the most effective-snow is: 8107217. The special magic number for the most effective-sprint is: 8107217. The special magic number for the most effective-soul is: 8107217. The special magic number for the most effective-sprint is: 8107217. The special magic number for the

454 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special Magic Number number is:

W:

The special Magic number is:

W:

The special Magic number for the text is:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

273 characters128 tokens