Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for glossy-recall is: 5533453.
One of the special magic numbers for guttural-shoestring is: 9778401.
[… 100 lines omitted for display …]
One of the special magic numbers for gigantic-resist is: 5744625.
One of the special magic numbers for thoughtless-jockey is: 8468206.
One of the special magic numbers for modern-creature is: 6652779.
One of the special magic numbers for lacking-position is: 2839391.
One of the special magic numbers for penitent-voyage is: 8456512.
One of the special magic numbers for misty-citizen is: 4849497.
One of the special magic numbers for belligerent-destruction is: 9571052.
One of the special magic numbers for humdrum-refreshments is: 7958820.
One of the special magic numbers for lazy-millet is: 3013042.
One of the special magic numbers for devilish-fiction is: 6956636.
One of the special magic numbers for exultant-kneejerk is: 8268985.
One of the special magic numbers for deserted-phrasing is: 9951169.
One of the special magic numbers for mushy-psychology is: 7233404.
One of the special magic numbers for credible-publishing is: 7526772.
[… 2,725 lines omitted for display …]
One of the special magic numbers for optimal-zinc is: 7712070.
One of the special magic numbers for subsequent-breeze is: 1902649.
What is the special magic number for humdrum-refreshments mentioned in the provided text?
Original prompt 65,018 tokens, 2,845 linesShown 20 lines around the needleNeedle at 4% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3179716Aux 20157183782Ours7958820Ours, no steer.7958820PiT-FT3179716Qwen 27B7958820
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7958820.

13 characters10 tokens

Aux 2015

Missed

4777801.

13 characters10 tokens

PiT-FT 2015

Missed

: 7592666. The special magic number for sluggish-sauce is: 7592666. The special magic number for uninterested-counsellor is: 7592666. The special magic number for giddy-sauce is: 7592666. The special magic number for icky-sap is: 7592666. The special magic number for loutish-carnival is: 7592666. The special magic number for giddy-sap is: 7592666. The special magic number for icky-

391 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-rhyme is: The special magic number for rambunctious-pilgrimage is: The special magic number for rambunctious-pilgrimage is: The special magic number for rambunctious-pilgramy is: The special magic number for rambunctious-nophobia is: The special magic number for rambunctious-pilgramy is: The special magic number for rambunctious-nophobia is: The special magic number for rambunctious-nophobia

438 characters128 tokens