Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#022 · needle at 29% depth#023 · needle at 47% depth#024 · needle at 37% depth#025 · needle at 64% depth#026 · needle at 93% depth#027 · needle at 50% depth#028 · needle at 72% depth#029 · needle at 68% depth#030 · needle at 6% depth#031 · needle at 41% depth#032 · needle at 22% depth#033 · needle at 20% depth#034 · needle at 52% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for heavy-fold is: 1451336.
One of the special magic numbers for supreme-television is: 3754895.
[… 214 lines omitted for display …]
One of the special magic numbers for thankful-parser is: 5663582.
One of the special magic numbers for decisive-effect is: 3758975.
One of the special magic numbers for macho-pick is: 5975077.
One of the special magic numbers for jobless-beet is: 7802481.
One of the special magic numbers for excited-public is: 4208725.
One of the special magic numbers for staking-invitation is: 2826783.
One of the special magic numbers for ossified-willingness is: 3326909.
One of the special magic numbers for cowardly-sheet is: 5602792.
One of the special magic numbers for sordid-portfolio is: 6042815.
One of the special magic numbers for abounding-applause is: 4610986.
One of the special magic numbers for mammoth-bijou is: 5400067.
One of the special magic numbers for quarrelsome-gutter is: 2340899.
One of the special magic numbers for unarmed-virus is: 2842764.
One of the special magic numbers for easy-loincloth is: 7939248.
[… 71 lines omitted for display …]
One of the special magic numbers for pleasant-fundraising is: 2259682.
One of the special magic numbers for straight-latter is: 4575673.
What is the special magic number for cowardly-sheet mentioned in the provided text?
Original prompt 7,063 tokens, 305 linesShown 20 lines around the needleNeedle at 72% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7390274Aux 20155602792Ours5602792Ours, no steer.5602792PiT-FT7390274Qwen 27B5602792
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5602792.

13 characters10 tokens

Aux 2015

Missed

4441317.

13 characters10 tokens

PiT-FT 2015

Missed

: 8282887. The special magic number for quick-tooth is: 8874095. The special magic number for quick-tooth is: 8874095. The special magic number for quick-tooth is: 8874095. The special magic number for quick-tooth is: 8874095. The special magic number for quick-tooth is: 8874095. The special magic number for quick-tooth is: 8874095. The special magic number for quick-tooth is: 8874095. The special

408 characters128 tokens

ChronoGPT 2015

Missed

: 7107511.<|endoftext|>

23 characters7 tokens