Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for numberless-cheetah is: 7130273.
One of the special magic numbers for soggy-seashore is: 8368072.
[… 358 lines omitted for display …]
One of the special magic numbers for foamy-postbox is: 1126685.
One of the special magic numbers for breezy-sweatsuit is: 7503458.
One of the special magic numbers for lean-course is: 5556302.
One of the special magic numbers for skillful-cargo is: 9187470.
One of the special magic numbers for average-staircase is: 6649498.
One of the special magic numbers for tacky-discrepancy is: 5864862.
One of the special magic numbers for gentle-swamp is: 7053693.
One of the special magic numbers for murky-viewer is: 8751286.
One of the special magic numbers for uppity-mouth is: 2681625.
One of the special magic numbers for glamorous-fairy is: 6252062.
One of the special magic numbers for defeated-sparerib is: 2179726.
One of the special magic numbers for aberrant-nightgown is: 3295551.
One of the special magic numbers for alive-jack is: 4436533.
One of the special magic numbers for quack-summer is: 8991485.
[… 312 lines omitted for display …]
One of the special magic numbers for screeching-amnesty is: 6061867.
One of the special magic numbers for lively-dozen is: 4526520.
What is the special magic number for murky-viewer mentioned in the provided text?
Original prompt 15,851 tokens, 690 linesShown 20 lines around the needleNeedle at 53% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3431111Aux 20151456832Ours8751286Ours, no steer.8751286PiT-FT3431111Qwen 27B8751286
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8751286.

13 characters10 tokens

Aux 2015

Missed

8548382.

13 characters10 tokens

PiT-FT 2015

Missed

: 8873534. The special magic number for the most important-sauce is: 8873534. The special magic number for the most recent-sauce is: 8873534. The special magic number for the most recent-sauce is: 8873534. The special magic number for the most recent-sauce is: 8873534. The special magic number for the most recent-sauce is: 8873534. The special magic number for the most recent-sauce is: 8873534. The

408 characters128 tokens

ChronoGPT 2015

Missed

: 1340513.<|endoftext|>

23 characters6 tokens