Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grieving-stone is: 1259232.
One of the special magic numbers for squalid-acorn is: 5056936.
[… 1,306 lines omitted for display …]
One of the special magic numbers for empty-variation is: 6808201.
One of the special magic numbers for sedate-course is: 6787480.
One of the special magic numbers for puzzled-pot is: 8989855.
One of the special magic numbers for damaging-double is: 7342010.
One of the special magic numbers for embarrassed-level is: 4144813.
One of the special magic numbers for vulgar-puppet is: 8944751.
One of the special magic numbers for jumpy-swing is: 1578229.
One of the special magic numbers for scandalous-recovery is: 5560414.
One of the special magic numbers for elderly-present is: 9235528.
One of the special magic numbers for tearful-zephyr is: 2190263.
One of the special magic numbers for stingy-jumbo is: 3593993.
One of the special magic numbers for macho-workhorse is: 6128721.
One of the special magic numbers for educated-timbale is: 2852930.
One of the special magic numbers for abject-drain is: 3902349.
[… 82 lines omitted for display …]
One of the special magic numbers for festive-belly is: 9067841.
One of the special magic numbers for needy-satire is: 3758751.
What is the special magic number for scandalous-recovery mentioned in the provided text?
Original prompt 32,217 tokens, 1,408 linesShown 20 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8972825Aux 20159067841Ours5560414Ours, no steer.5560414PiT-FT8972825Qwen 27B5560414
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5560414.

13 characters10 tokens

Aux 2015

Missed

7713859.

13 characters10 tokens

PiT-FT 2015

Missed

: 6870017. The special magic number for the most popular-sauce is: 8870017. The special magic number for the least popular-sauce is: 8870017. The special magic number for the most popular-sauce is: 8870017. The special magic number for the least popular-sauce is: 8870017. The special magic number for the most popular-sauce is: 8870017. The special magic number for the least popular-sauce is: 8870017. The

414 characters128 tokens

ChronoGPT 2015

Missed

: 2810642.<|endoftext|>

23 characters6 tokens