Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#045 · needle at 36% depth#046 · needle at 27% depth#047 · needle at 2% depth#048 · needle at 27% depth#049 · needle at 71% depth#050 · needle at 92% depth#051 · needle at 87% depth#052 · needle at 72% depth#053 · needle at 33% depth#054 · needle at 10% depth#055 · needle at 3% depth#056 · needle at 67% depth#057 · needle at 20% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for many-toaster is: 6454212.
One of the special magic numbers for glamorous-recipe is: 2021154.
[… 126 lines omitted for display …]
One of the special magic numbers for wet-volcano is: 5267659.
One of the special magic numbers for tangy-butter is: 6391124.
One of the special magic numbers for warm-fanny-pack is: 2836456.
One of the special magic numbers for spiritual-parenthesis is: 4025480.
One of the special magic numbers for ablaze-column is: 6075294.
One of the special magic numbers for ruthless-element is: 9105115.
One of the special magic numbers for pretty-fencing is: 1695371.
One of the special magic numbers for shocking-chassis is: 1545449.
One of the special magic numbers for nifty-oversight is: 9266290.
One of the special magic numbers for teeny-demur is: 7412315.
One of the special magic numbers for slow-procurement is: 4326490.
One of the special magic numbers for exultant-inversion is: 4933890.
One of the special magic numbers for doubtful-insert is: 8214175.
One of the special magic numbers for knowing-crayfish is: 2598449.
[… 5 lines omitted for display …]
One of the special magic numbers for inexpensive-meter is: 9446593.
One of the special magic numbers for lamentable-globe is: 9846486.
What is the special magic number for shocking-chassis mentioned in the provided text?
Original prompt 3,579 tokens, 151 linesShown 20 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1391979Aux 20151545449Ours1545449Ours, no steer.1545449PiT-FT1391979Qwen 27B1545449
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1545449.

13 characters10 tokens

Aux 2015

Missed

4022958.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692591. The special magic number for awkward-tortoise is: 7265761. The special magic number for unkind-tortoise is: 7265761. The special magic number for unkind-tortoise is: 7265761. The special magic number for unkind-tortoise is: 7265761. The special magic number for unkind-tortoise is: 7265761. The special magic number for unkind-tortoise is: 7265761. The special magic number for unkind-

403 characters128 tokens

ChronoGPT 2015

Missed

: 729097.<|endoftext|>

22 characters7 tokens