Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#003 · needle at 1% depth#004 · needle at 80% depth#005 · needle at 96% depth#006 · needle at 38% depth#007 · needle at 3% depth#008 · needle at 38% depth#009 · needle at 99% depth#010 · needle at 16% depth#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for glamorous-pleasure is: 5524513.
One of the special magic numbers for bad-icing is: 2864572.
[… 5,636 lines omitted for display …]
One of the special magic numbers for abandoned-bud is: 4629245.
One of the special magic numbers for homely-sensitivity is: 4671504.
One of the special magic numbers for plausible-border is: 8046181.
One of the special magic numbers for obtainable-engineering is: 5951267.
One of the special magic numbers for hissing-courtroom is: 8161322.
One of the special magic numbers for horrible-workforce is: 5588765.
One of the special magic numbers for optimal-marketing is: 6951720.
One of the special magic numbers for lean-liar is: 5036488.
One of the special magic numbers for classy-bookcase is: 8291208.
One of the special magic numbers for earsplitting-operation is: 3594545.
One of the special magic numbers for knotty-tunic is: 6102227.
One of the special magic numbers for voracious-flow is: 9620024.
One of the special magic numbers for shrill-ribbon is: 4426018.
One of the special magic numbers for foregoing-lawn is: 3488147.
[… 62 lines omitted for display …]
One of the special magic numbers for exultant-testimonial is: 9855636.
One of the special magic numbers for hapless-waterskiing is: 1629510.
What is the special magic number for lean-liar mentioned in the provided text?
Original prompt 130,436 tokens, 5,718 linesShown 20 lines around the needleNeedle at 99% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9572266Aux 20151026036Ours5036488Ours, no steer.5036488PiT-FT9572266Qwen 27B5036488
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5036488.

13 characters10 tokens

Aux 2015

Missed

3171116.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for staleness is:

Guilty-bribe mentioned in the behear text is:

Stupid-cans is the special Stupid-cans number for rambunctious-cans is:

Stupid-rays mentioned in the behear text is:

Stupid-rays mentioned in the behear text is:

Stupid-reps is the special Stupid-reps number for rambunctious-cans is:

Stupid-reps is

390 characters128 tokens