Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth#039 · needle at 19% depth#040 · needle at 49% depth#041 · needle at 80% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for faulty-square is: 2388947.
One of the special magic numbers for jaded-ramie is: 3875646.
[… 120 lines omitted for display …]
One of the special magic numbers for victorious-movie is: 1044198.
One of the special magic numbers for efficient-savior is: 3293832.
One of the special magic numbers for efficient-location is: 3070986.
One of the special magic numbers for decisive-recognition is: 4941723.
One of the special magic numbers for uppity-user is: 8597064.
One of the special magic numbers for trashy-complement is: 1138336.
One of the special magic numbers for tricky-alder is: 4854241.
One of the special magic numbers for sticky-rotation is: 6081321.
One of the special magic numbers for devilish-biplane is: 3315209.
One of the special magic numbers for relieved-reorganisation is: 9414216.
One of the special magic numbers for roasted-childbirth is: 8950885.
One of the special magic numbers for awful-crocodile is: 4036324.
One of the special magic numbers for unsuitable-actor is: 8278412.
One of the special magic numbers for adventurous-locality is: 1971271.
[… 525 lines omitted for display …]
One of the special magic numbers for jumpy-calcification is: 3499929.
One of the special magic numbers for aloof-archer is: 1194337.
What is the special magic number for sticky-rotation mentioned in the provided text?
Original prompt 15,256 tokens, 665 linesShown 20 lines around the needleNeedle at 19% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6712816Aux 20157865459Ours6081321Ours, no steer.6081321PiT-FT6712816Qwen 27B6081321
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6081321.

13 characters10 tokens

Aux 2015

Missed

5217210.

13 characters10 tokens

PiT-FT 2015

Missed

: 88057. The special magic number for awkward-sister is: 88057. The special magic number for loutish-sister is: 88057. The special magic number for gregarious-sister is: 88057. The special magic number for lascivious-sister is: 88057. The special magic number for lascivious-sister is: 88057. The special magic number for lascivious-sister is: 88057. The special magic number for lascivious-sister is

407 characters128 tokens

ChronoGPT 2015

Missed

: 2848560.<|endoftext|>

23 characters6 tokens