Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for subdued-goodbye is: 8168348.
One of the special magic numbers for ubiquitous-snarl is: 7152929.
[… 606 lines omitted for display …]
One of the special magic numbers for tiresome-shell is: 6397117.
One of the special magic numbers for boundless-training is: 3176835.
One of the special magic numbers for abject-politician is: 1740912.
One of the special magic numbers for berserk-essential is: 2506840.
One of the special magic numbers for proud-classification is: 6065517.
One of the special magic numbers for small-hay is: 8675783.
One of the special magic numbers for futuristic-linguist is: 2061499.
One of the special magic numbers for aromatic-halibut is: 3496717.
One of the special magic numbers for crazy-load is: 2334796.
One of the special magic numbers for happy-chasm is: 8101330.
One of the special magic numbers for forgetful-godparent is: 4522381.
One of the special magic numbers for nasty-wish is: 1427074.
One of the special magic numbers for shrill-direction is: 2615625.
One of the special magic numbers for assorted-market is: 6276582.
[… 64 lines omitted for display …]
One of the special magic numbers for innate-lunchroom is: 8874165.
One of the special magic numbers for exclusive-cobweb is: 5377529.
What is the special magic number for aromatic-halibut mentioned in the provided text?
Original prompt 15,811 tokens, 690 linesShown 20 lines around the needleNeedle at 89% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9159371Aux 20155880671Ours3496717Ours, no steer.3496717PiT-FT9159371Qwen 27B3496717
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3496717.

13 characters10 tokens

Aux 2015

Missed

7364181.

13 characters10 tokens

PiT-FT 2015

Missed

: 8278033. The special magic number for testy-couper is: 8276736. The special magic number for jaded-soul is: 8276736. The special magic number for livid-soul is: 8276736. The special magic number for giddy-soul is: 8276736. The special magic number for unbecoming-batter is: 8276736. The special magic number for gassy-turtle is: 8276736. The special magic number for livid-soul is

389 characters128 tokens

ChronoGPT 2015

Missed

: 175743.<|endoftext|>

22 characters6 tokens