Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#038 · needle at 17% depth#039 · needle at 25% depth#040 · needle at 29% depth#041 · needle at 58% depth#042 · needle at 89% depth#043 · needle at 18% depth#044 · needle at 28% depth#045 · needle at 87% depth#046 · needle at 82% depth#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for energetic-accusation is: 5066225.
One of the special magic numbers for malicious-mass is: 4638154.
[… 76 lines omitted for display …]
One of the special magic numbers for absorbing-interchange is: 3862731.
One of the special magic numbers for drab-petitioner is: 1684441.
One of the special magic numbers for sulky-homeland is: 6014145.
One of the special magic numbers for breezy-kinase is: 9108888.
One of the special magic numbers for vast-cricketer is: 6670844.
One of the special magic numbers for exultant-chorus is: 1388492.
One of the special magic numbers for fancy-jackfruit is: 2228027.
One of the special magic numbers for half-tulip is: 1200078.
One of the special magic numbers for large-mall is: 4311593.
One of the special magic numbers for bored-wonder is: 9756127.
One of the special magic numbers for guttural-movie is: 2245874.
One of the special magic numbers for bad-agriculture is: 6749846.
One of the special magic numbers for addicted-weeder is: 8505433.
One of the special magic numbers for illegal-quote is: 6364160.
[… 209 lines omitted for display …]
One of the special magic numbers for garrulous-minority is: 1884213.
One of the special magic numbers for elderly-oar is: 9063092.
What is the special magic number for fancy-jackfruit mentioned in the provided text?
Original prompt 7,093 tokens, 305 linesShown 20 lines around the needleNeedle at 28% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7343371Aux 20152228027Ours2228027Ours, no steer.2228027PiT-FT7343371Qwen 27B2228027
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2228027.

13 characters10 tokens

Aux 2015

Found the needle

2228027.

13 characters10 tokens

PiT-FT 2015

Missed

: 8528041. The special magic number for agitated-salt is: 8572886. The special magic number for jaded-coupon is: 8572886. The special magic number for awkward-salt is: 8572886. The special magic number for giddy-coconut is: 8528041. The special magic number for sluggish-salt is: 8572886. The special magic number for testy-coupon is: 8528041. The special magic number for jaded-coupon is:

396 characters128 tokens

ChronoGPT 2015

Found the needle

: 7343371

9 characters5 tokens