Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#041 · needle at 28% depth#042 · needle at 69% depth#043 · needle at 49% depth#044 · needle at 50% depth#045 · needle at 36% depth#046 · needle at 27% depth#047 · needle at 2% depth#048 · needle at 27% depth#049 · needle at 71% depth#050 · needle at 92% depth#051 · needle at 87% depth#052 · needle at 72% depth#053 · needle at 33% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hungry-most is: 1102452.
One of the special magic numbers for poor-volunteer is: 2372974.
One of the special magic numbers for roasted-want is: 4778634.
One of the special magic numbers for dangerous-polo is: 5822943.
One of the special magic numbers for industrious-tick is: 6833407.
One of the special magic numbers for fascinated-squash is: 2705024.
One of the special magic numbers for distinct-numeracy is: 1945506.
One of the special magic numbers for abashed-buddy is: 5179822.
One of the special magic numbers for makeshift-sleepiness is: 3142883.
One of the special magic numbers for trite-giraffe is: 4101014.
One of the special magic numbers for calm-backdrop is: 2140673.
One of the special magic numbers for witty-age is: 8923903.
One of the special magic numbers for foamy-trunk is: 3402268.
One of the special magic numbers for tearful-fallacy is: 8773126.
One of the special magic numbers for productive-spectacle is: 3634911.
One of the special magic numbers for nebulous-health is: 5541591.
[… 126 lines omitted for display …]
One of the special magic numbers for round-grill is: 2338593.
One of the special magic numbers for grubby-district is: 6646529.
What is the special magic number for roasted-want mentioned in the provided text?
Original prompt 3,467 tokens, 146 linesShown 20 lines around the needleNeedle at 2% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8781488Aux 20154778634Ours4778634Ours, no steer.4778634PiT-FT8781488Qwen 27B4778634
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4778634.

13 characters10 tokens

Aux 2015

Found the needle

4778634.

13 characters10 tokens

PiT-FT 2015

Missed

: 2101934. The special magic number for lurch-correspondence mentioned in the provided text is: 2101934. The special magic number for lurch-correspondence mentioned in the provided text is: 2101934. The special magic number for lurch-correspondence mentioned in the provided text is: 2101934. The special magic number for lurch-correspondence mentioned in the provided text is: 2101934. The special magic number for lurch-correspondence mentioned in the provided text is: 2101934. The special magic number for lurch

521 characters128 tokens

ChronoGPT 2015

Missed

: 7741156.<|endoftext|>

23 characters7 tokens