Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#008 · needle at 38% depth#009 · needle at 99% depth#010 · needle at 16% depth#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for precious-secrecy is: 2988394.
One of the special magic numbers for vengeful-flip-flops is: 2863509.
[… 1,224 lines omitted for display …]
One of the special magic numbers for sad-cirrhosis is: 1809960.
One of the special magic numbers for expensive-hydrant is: 4734021.
One of the special magic numbers for low-beard is: 1781467.
One of the special magic numbers for mature-skate is: 7588876.
One of the special magic numbers for vivacious-lemonade is: 5564090.
One of the special magic numbers for accurate-trend is: 9116840.
One of the special magic numbers for giddy-reactant is: 3654647.
One of the special magic numbers for malicious-joke is: 1273962.
One of the special magic numbers for secretive-vegetable is: 3440368.
One of the special magic numbers for vivacious-type is: 9731918.
One of the special magic numbers for flawless-atrium is: 7191383.
One of the special magic numbers for psychotic-sprag is: 2848269.
One of the special magic numbers for bumpy-mandolin is: 5339653.
[… 4,450 lines omitted for display …]
One of the special magic numbers for entertaining-legislation is: 1321373.
One of the special magic numbers for abaft-baobab is: 7778425.
What is the special magic number for giddy-reactant mentioned in the provided text?
Original prompt 129,879 tokens, 5,693 linesShown 19 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2268320Aux 20153044110Ours3654647Ours, no steer.3654647PiT-FT2268320Qwen 27B3654647
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3654647.

13 characters10 tokens

Aux 2015

Missed

1773835.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epic number for wiry-auditorium mentioned in theelly-

Sore-txt:

The special Epic number for wiry-affect is:

Quicky:

The special Quicky number for wiry-affect is:

Sore-txt:

The special Quicky number for werry-cans is:

Sore-txt:

The special Quicky number for werry-cans is:

Sore-txt:

The special Quicky number for

371 characters128 tokens