Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tasteful-omnivore is: 5810004.
One of the special magic numbers for callous-sandal is: 6944407.
[… 664 lines omitted for display …]
One of the special magic numbers for icky-textual is: 4451075.
One of the special magic numbers for dynamic-tug is: 6965478.
One of the special magic numbers for rotten-bassoon is: 2663060.
One of the special magic numbers for fluffy-vote is: 7952692.
One of the special magic numbers for endurable-lawmaker is: 4794093.
One of the special magic numbers for chivalrous-soda is: 8877535.
One of the special magic numbers for pretty-individual is: 8015306.
One of the special magic numbers for sable-allocation is: 8758217.
One of the special magic numbers for faulty-thong is: 5050746.
One of the special magic numbers for calm-excellence is: 1989747.
One of the special magic numbers for tame-transmission is: 8712868.
One of the special magic numbers for crazy-refreshments is: 5870035.
One of the special magic numbers for malicious-bricklaying is: 9562037.
One of the special magic numbers for entertaining-hospitality is: 9449099.
[… 6 lines omitted for display …]
One of the special magic numbers for early-tell is: 2273954.
One of the special magic numbers for outstanding-emitter is: 5117998.
What is the special magic number for sable-allocation mentioned in the provided text?
Original prompt 15,847 tokens, 690 linesShown 20 lines around the needleNeedle at 97% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2722613Aux 20153669191Ours8758217Ours, no steer.8758217PiT-FT2722613Qwen 27B8758217
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8758217.

13 characters10 tokens

Aux 2015

Missed

7617866.

13 characters10 tokens

PiT-FT 2015

Missed

: 7596583. The special magic number for the most recent-tug is: 8709815. The special magic number for the most recent-tug is: 8709815. The special magic number for the most recent-tug is: 8709815. The special magic number for the most recent-tug is: 8709815. The special magic number for the most recent-tug is: 8709815. The special magic number for the most recent-tug is: 8709815. The special magic number for the most

427 characters128 tokens

ChronoGPT 2015

Missed

: 537894.<|endoftext|>

22 characters7 tokens