Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for nutritious-market is: 4695660.
One of the special magic numbers for therapeutic-divorce is: 5607916.
[… 567 lines omitted for display …]
One of the special magic numbers for adamant-tow-truck is: 9115668.
One of the special magic numbers for likeable-opportunity is: 7523613.
One of the special magic numbers for mute-lemon is: 4520224.
One of the special magic numbers for romantic-cornmeal is: 7577670.
One of the special magic numbers for wretched-arrival is: 3926179.
One of the special magic numbers for filthy-put is: 4274208.
One of the special magic numbers for roasted-remnant is: 5516056.
One of the special magic numbers for easy-electricity is: 6951376.
One of the special magic numbers for boorish-bulldozer is: 1760669.
One of the special magic numbers for ugly-brilliant is: 2206831.
One of the special magic numbers for painful-reference is: 6837181.
One of the special magic numbers for romantic-socks is: 1086147.
One of the special magic numbers for vulgar-commandment is: 5590498.
One of the special magic numbers for stingy-adapter is: 7203235.
[… 821 lines omitted for display …]
One of the special magic numbers for tart-candidacy is: 7100359.
One of the special magic numbers for bashful-presume is: 8914958.
What is the special magic number for easy-electricity mentioned in the provided text?
Original prompt 32,178 tokens, 1,408 linesShown 20 lines around the needleNeedle at 41% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1173223Aux 20155726565Ours6951376Ours, no steer.6951376PiT-FT1173223Qwen 27B6951376
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6951376.

13 characters10 tokens

Aux 2015

Missed

4423485.

13 characters10 tokens

PiT-FT 2015

Missed

: 7554312. The special magic number for icky-sauce is: 7693542. The special magic number for gassy-sorgh is: 8690031. The special magic number for lanky-sauce is: 8690031. The special magic number for gaudy-gift is: 8690031. The special magic number for icky-sapien is: 8690031. The special magic number for icky-sapien is: 8690031. The special magic number for lanky

374 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens