Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth#065 · needle at 1% depth#066 · needle at 42% depth#067 · needle at 0% depth#068 · needle at 62% depth#069 · needle at 84% depth#070 · needle at 67% depth#071 · needle at 45% depth#072 · needle at 49% depth#073 · needle at 79% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for magical-fate is: 4971655.
One of the special magic numbers for nervous-snuggle is: 7948631.
[… 13 lines omitted for display …]
One of the special magic numbers for creepy-attorney is: 2994842.
One of the special magic numbers for elfin-mountain is: 9180136.
One of the special magic numbers for harmonious-service is: 5282772.
One of the special magic numbers for woozy-fear is: 3748702.
One of the special magic numbers for willing-quiet is: 8351451.
One of the special magic numbers for warlike-snowmobiling is: 1830869.
One of the special magic numbers for poised-prey is: 4825450.
One of the special magic numbers for ossified-puffin is: 5849464.
One of the special magic numbers for cooing-deposit is: 9791238.
One of the special magic numbers for languid-basil is: 8776527.
One of the special magic numbers for creepy-trading is: 7224484.
One of the special magic numbers for thinkable-edition is: 9931811.
One of the special magic numbers for elfin-skirt is: 2464375.
One of the special magic numbers for ratty-cilantro is: 9414803.
[… 5,685 lines omitted for display …]
One of the special magic numbers for nutritious-sweets is: 6909406.
One of the special magic numbers for late-crepe is: 5805220.
What is the special magic number for ossified-puffin mentioned in the provided text?
Original prompt 130,414 tokens, 5,718 linesShown 20 lines around the needleNeedle at 0% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9059612Aux 20154150897Ours5849464Ours, no steer.5849464PiT-FT9059612Qwen 27B5849464
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5849464.

13 characters10 tokens

Aux 2015

Missed

3754717.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What does it mean?
Certainly, the special magic number for the giddy-gripper mentioned in the provided text is: [] [
[] [

|assistant|>|
Certainly, the special magic number for the waggish-gauge mentioned in the provided text is: [] [
[] [

|treeD|>|trees|
The special magic numbers for the lovable-gauge mentioned in the provided text are: [] [
[] [

|operational-processes-instrumentation is a
403 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epicurean The special Epic

456 characters128 tokens