Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for likeable-horn is: 8102597.
One of the special magic numbers for unarmed-grassland is: 6283788.
[… 2,211 lines omitted for display …]
One of the special magic numbers for impossible-island is: 4787332.
One of the special magic numbers for shaky-kumquat is: 2026062.
One of the special magic numbers for capable-ironclad is: 9431605.
One of the special magic numbers for happy-nectarine is: 7932429.
One of the special magic numbers for nosy-paint is: 5648071.
One of the special magic numbers for squealing-glass is: 7202361.
One of the special magic numbers for pleasant-kebab is: 2507744.
One of the special magic numbers for overwrought-guide is: 5754483.
One of the special magic numbers for lopsided-negotiation is: 1233319.
One of the special magic numbers for volatile-sympathy is: 4001809.
One of the special magic numbers for delicious-spawn is: 3743766.
One of the special magic numbers for joyous-freedom is: 7572124.
One of the special magic numbers for deafening-gherkin is: 7513171.
[… 615 lines omitted for display …]
One of the special magic numbers for quizzical-normalization is: 7653375.
One of the special magic numbers for purple-shoe-horn is: 8525390.
What is the special magic number for pleasant-kebab mentioned in the provided text?
Original prompt 64,941 tokens, 2,845 linesShown 19 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2631913Aux 20154658809Ours2507744Ours, no steer.2507744PiT-FT2631913Qwen 27B2507744
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2507744.

13 characters10 tokens

Aux 2015

Missed

7136995.

13 characters10 tokens

PiT-FT 2015

Missed

: 7698217. The special magic number for icky-sir is: 6692061. The special magic number for gassy-grav is: 6692061. The special magic number for loutish-cauliflower is: 8705769. The special magic number for icky-sir is: 6692061. The special magic number for gassy-grav is: 6692061. The special magic number for icky-sir is: 6692061. The special magic number for icky-sir is

379 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for few-txt in the provided text is: The special magic number for few-penguin in the provided text is: The special Magic Number number for few-naut in the provided text is: The special Magic number for few-naut is: The special Magic number for few-naut is: The special Magic number for few-naut is: The special Magic number for few-naut is: The special Magic number for few-naut is: The special Magic number for few-naut is: The special Magic number for

480 characters128 tokens