Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for devilish-school is: 3356059.
One of the special magic numbers for sticky-retirement is: 2844579.
[… 57 lines omitted for display …]
One of the special magic numbers for cagey-moon is: 3013280.
One of the special magic numbers for lyrical-pick is: 9563233.
One of the special magic numbers for small-leverage is: 9656400.
One of the special magic numbers for low-caper is: 2810298.
One of the special magic numbers for excited-lifetime is: 7523579.
One of the special magic numbers for staking-tailor is: 7625352.
One of the special magic numbers for truculent-libido is: 7838463.
One of the special magic numbers for cagey-punctuation is: 2450010.
One of the special magic numbers for cloistered-nation is: 1189543.
One of the special magic numbers for worthless-nucleotidase is: 7537270.
One of the special magic numbers for picayune-providence is: 6204485.
One of the special magic numbers for tacit-mayonnaise is: 3762217.
One of the special magic numbers for abortive-compass is: 8261208.
One of the special magic numbers for rightful-width is: 6519788.
[… 1,331 lines omitted for display …]
One of the special magic numbers for grumpy-surgery is: 4913090.
One of the special magic numbers for orange-excursion is: 4483286.
What is the special magic number for cagey-punctuation mentioned in the provided text?
Original prompt 32,206 tokens, 1,408 linesShown 20 lines around the needleNeedle at 5% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6499206Aux 20159273532Ours2450010Ours, no steer.2450010PiT-FT6499206Qwen 27B2450010
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2450010.

13 characters10 tokens

Aux 2015

Missed

4447972.

13 characters10 tokens

PiT-FT 2015

Missed

: 8280061. The special magic number for the most popular-sauce is: 8808083. The special magic number for the least popular-sauce is: 8808083. The special magic number for the second most popular-sauce is: 8808083. The special magic number for the third most popular-sauce is: 8808083. The special magic number for the fourth most popular-sauce is: 8808083. The special magic number for the fifth most popular-sauce is: 88080

430 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens