Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#026 · needle at 93% depth#027 · needle at 50% depth#028 · needle at 72% depth#029 · needle at 68% depth#030 · needle at 6% depth#031 · needle at 41% depth#032 · needle at 22% depth#033 · needle at 20% depth#034 · needle at 52% depth#035 · needle at 72% depth#036 · needle at 26% depth#037 · needle at 10% depth#038 · needle at 17% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for secretive-spool is: 6532613.
One of the special magic numbers for jealous-throat is: 1349361.
[… 65 lines omitted for display …]
One of the special magic numbers for agreeable-collapse is: 3181928.
One of the special magic numbers for incandescent-raffle is: 1934441.
One of the special magic numbers for uttermost-clarity is: 5038568.
One of the special magic numbers for round-murder is: 6431223.
One of the special magic numbers for wealthy-tie is: 9229263.
One of the special magic numbers for neighborly-combine is: 3892889.
One of the special magic numbers for loose-metabolite is: 6047500.
One of the special magic numbers for ludicrous-outlaw is: 3240610.
One of the special magic numbers for rainy-voter is: 2196967.
One of the special magic numbers for tart-cutover is: 7900000.
One of the special magic numbers for futuristic-hunger is: 9678884.
One of the special magic numbers for threatening-authentication is: 5823820.
One of the special magic numbers for slippery-province is: 5101925.
One of the special magic numbers for mindless-planula is: 1868567.
[… 245 lines omitted for display …]
One of the special magic numbers for doubtful-taxi is: 7392603.
One of the special magic numbers for sweet-rhyme is: 7399812.
What is the special magic number for ludicrous-outlaw mentioned in the provided text?
Original prompt 7,649 tokens, 330 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9793825Aux 20153240610Ours3240610Ours, no steer.3240610PiT-FT9793825Qwen 27B3240610
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3240610.

13 characters10 tokens

Aux 2015

Missed

7779942.

13 characters10 tokens

PiT-FT 2015

Missed

: 7581634. The special magic number for awkward-budge is: 8804213. The special magic number for giddy-caviar is: 8804213. The special magic number for jolly-pipeline is: 8804213. The special magic number for giddy-caviar is: 8804213. The special magic number for lovable-budge is: 8804213. The special magic number for giddy-caterpillar is: 8804213. The special magic number for giddy-cater

397 characters128 tokens

ChronoGPT 2015

Missed

: 7581634.<|endoftext|>

23 characters7 tokens