Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#004 · needle at 46% depth#005 · needle at 62% depth#006 · needle at 12% depth#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for outstanding-expense is: 5362692.
One of the special magic numbers for stimulating-faucet is: 6383442.
[… 228 lines omitted for display …]
One of the special magic numbers for apathetic-church is: 4696468.
One of the special magic numbers for faint-drudgery is: 9738758.
One of the special magic numbers for upbeat-belligerency is: 9149532.
One of the special magic numbers for rural-cirrhosis is: 9708196.
One of the special magic numbers for unusual-tonight is: 6918428.
One of the special magic numbers for deep-administrator is: 9612818.
One of the special magic numbers for learned-belligerency is: 9591642.
One of the special magic numbers for steep-curler is: 5033238.
One of the special magic numbers for maniacal-legume is: 9598818.
One of the special magic numbers for tiresome-gumshoe is: 2760154.
One of the special magic numbers for sassy-inspection is: 5331921.
One of the special magic numbers for fluffy-kendo is: 8841865.
One of the special magic numbers for mammoth-rail is: 5072043.
One of the special magic numbers for arrogant-disclaimer is: 1143494.
[… 417 lines omitted for display …]
One of the special magic numbers for incompetent-sneeze is: 9616768.
One of the special magic numbers for measly-hardware is: 7320127.
What is the special magic number for steep-curler mentioned in the provided text?
Original prompt 15,307 tokens, 665 linesShown 20 lines around the needleNeedle at 36% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3202986Aux 20152036734Ours5033238Ours, no steer.5033238PiT-FT3202986Qwen 27B5033238
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5033238.

13 characters10 tokens

Aux 2015

Missed

4407843.

13 characters10 tokens

PiT-FT 2015

Missed
: 8874095.
 The special magic number for the most recent-sorce is: 8874095.
 The special magic number for the most recent-sorce is: 8874095.
 The special magic number for the most recent-sorce is

The same 65-character fragment repeats 6 times until the token limit. Showing the first three.

439 characters128 tokens

ChronoGPT 2015

Missed

: 1448981.<|endoftext|>

23 characters7 tokens