Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#011 · needle at 86% depth#012 · needle at 24% depth#013 · needle at 58% depth#014 · needle at 60% depth#015 · needle at 6% depth#016 · needle at 56% depth#017 · needle at 48% depth#018 · needle at 34% depth#019 · needle at 88% depth#020 · needle at 50% depth#021 · needle at 65% depth#022 · needle at 29% depth#023 · needle at 47% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for berserk-pianist is: 1020737.
One of the special magic numbers for famous-influx is: 6792145.
[… 148 lines omitted for display …]
One of the special magic numbers for painful-vitamin is: 1855315.
One of the special magic numbers for rampant-pulley is: 8729964.
One of the special magic numbers for ruddy-nutmeg is: 3877765.
One of the special magic numbers for clear-recollection is: 2493555.
One of the special magic numbers for moaning-artery is: 1921446.
One of the special magic numbers for different-supplier is: 1460189.
One of the special magic numbers for tasteless-dime is: 5353544.
One of the special magic numbers for woozy-leverage is: 7383657.
One of the special magic numbers for cautious-number is: 2404057.
One of the special magic numbers for fluffy-trouble is: 7197117.
One of the special magic numbers for vague-innervation is: 9605960.
One of the special magic numbers for square-mandate is: 9463380.
One of the special magic numbers for sordid-cruise is: 8525927.
One of the special magic numbers for deeply-fashion is: 2878321.
[… 162 lines omitted for display …]
One of the special magic numbers for rotten-stepdaughter is: 1489629.
One of the special magic numbers for sleepy-lout is: 8560170.
What is the special magic number for woozy-leverage mentioned in the provided text?
Original prompt 7,653 tokens, 330 linesShown 20 lines around the needleNeedle at 48% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1058101Aux 20157383657Ours7383657Ours, no steer.7383657PiT-FT1058101Qwen 27B7383657
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7383657.

13 characters10 tokens

Aux 2015

Missed

8429157.

13 characters10 tokens

PiT-FT 2015

Missed

: 6571234. The special magic number for the most-unusual is: 8014890. The special magic number for the most-unusual is: 8014890. The special magic number for the most-unusual is: 8014890. The special magic number for the most-unusual is: 8014890. The special magic number for the most-unusual is: 8014890. The special magic number for the most-unusual is: 8014890. The special magic number for the most-unusual is: 8

423 characters128 tokens

ChronoGPT 2015

Missed

1318282.<|endoftext|>

22 characters5 tokens