Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth#095 · needle at 99% depth#096 · needle at 93% depth#097 · needle at 9% depth#098 · needle at 86% depth#099 · needle at 62% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hysterical-robot is: 7415362.
One of the special magic numbers for colorful-knee is: 3343399.
[… 2,433 lines omitted for display …]
One of the special magic numbers for shrill-redesign is: 3017123.
One of the special magic numbers for bloody-provision is: 7342662.
One of the special magic numbers for dispensable-site is: 9546928.
One of the special magic numbers for distinct-involvement is: 6773526.
One of the special magic numbers for adorable-involvement is: 5506838.
One of the special magic numbers for aromatic-prizefight is: 1111724.
One of the special magic numbers for shaky-production is: 8804229.
One of the special magic numbers for big-millennium is: 4476794.
One of the special magic numbers for jealous-cofactor is: 6510198.
One of the special magic numbers for imported-trail is: 2004963.
One of the special magic numbers for warlike-advocate is: 8209769.
One of the special magic numbers for likeable-vegetarianism is: 9036516.
One of the special magic numbers for bad-bit is: 5805187.
One of the special magic numbers for furtive-enclosure is: 1882641.
[… 367 lines omitted for display …]
One of the special magic numbers for therapeutic-mix is: 4495697.
One of the special magic numbers for obnoxious-love is: 1339563.
What is the special magic number for big-millennium mentioned in the provided text?
Original prompt 64,351 tokens, 2,820 linesShown 20 lines around the needleNeedle at 86% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4720282Aux 20156794957Ours4476794Ours, no steer.4476794PiT-FT4720282Qwen 27B4476794
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4476794.

13 characters10 tokens

Aux 2015

Missed

3057992.

13 characters10 tokens

PiT-FT 2015

Missed

: 7690041. The special magic number for gaudy-gift is: 8690041. The special magic number for laryng-sir is: 8690041. The special magic number for giddy-gauge is: 8690041. The special magic number for cheerful-carnival is: 8690041. The special magic number for loutish-carnival is: 8690041. The special magic number for gaudy-gift is: 8690041. The special magic number for lary

383 characters128 tokens

ChronoGPT 2015

Missed

:

Wiry:

The special magic number for wiry-wither is:

Wiry-Grazing:

The special magic number for wiry-wither is:

Wiry-Grazing:

The special magic number for wiry-grazing is:

Wiry-Grazing:

The special magic number for wiry-grazing is:

Wiry-Grazing:

The special magic number for wiry-grazing is:

Wiry-Grazing:

The special

353 characters128 tokens