Recursive Subtlety

I’m still trying to define subtlety for GPT4. It gets much better with feedback and parameterisation of abstract concepts, but guessing how difficult things are for humans is not a strong point.

In the conversation below, it maps out the space of subtle hints leading to the answer “The moon”. This version of GPT has already had some training on what it means to be subtle, but it still greatly over-estimates its subtlety. Here I was pushing it to the boundary, so I could point out where it cross into obscurity. I expected it to get into weird territory where the clue was close to useless, but it stayed in mundane and obvious territory for most of the exercise.

For each list of ten hints, where does it get to the point that the answer isn’t obviously “The moon”? For me, the point is usually near the very end of each list, if it reaches that point at all.. For GPT3.5, the answer marked with a row of = signs is the lowest one on the list that was answered correctly, or nearly correctly. The bolded hints below that were too hard for GPT3.5.

With some culling of poor hints, and human input, this overall approach could be used for bench-marking AI skill on the guessing side, and bench-marked guesses could be used to calibrate hint producers.

---

[GPT4]:
Now, let’s create a series of increasingly subtle hints for the answer “The moon”:

1. Celestial body responsible for tides and illuminated by the sun’s light at night.
2. Orbiter of Earth with a significant impact on our oceanic movements.
3. Natural satellite with a surface marked by craters and large, flat plains.
4. Gravitational partner that has a “dark side” never visible from our planet.
5. Celestial object once believed to be made of green cheese by some cultures.
6. Silvery light-bringer that has inspired myths and legends since ancient times.
7. The lesser light to rule the night, according to a religious text.
8. The subject of an old nursery rhyme about a cow and its acrobatic feat.
9. Mysterious companion that hides during the day and reappears at night.
10. The one who keeps the lone wolf company during its nocturnal wanderings.
11. A silent witness to countless stories told under its soft, watchful gaze.

With each hint, the connection to “The moon” becomes less direct and more subtle, gradually requiring the reader to make more connections or think more deeply to arrive at the answer.

[Human]:
That’s a great list. There is a nice mix of ideas. For each idea in the list, could you keep the hint you have already provided and create 9 more sub-versions of increasing indirectness and subtlety, but keeping to the main idea. For instance, the 10th item should expand into a list of hints related to wolves or similar themes, but the answer to the hint should still be “The moon”. Give each of the expanded lists a heading related to the central idea, and make sure that the new hints relate to that heading, but the answer is till “The moon”..

Don’t worry if they get into the “too hard” territory, as we are just mapping the borders of the territory so I can show these examples to other instantiations of GPT4.

Could you mark these new hints with a, b, c, etc, while keeping the same number for the parent hint? The first item in each sub-list, “a” should be the same as the corresponding hint that you have already generated.

We should end up with 110 hints in total. All of the hints should be hints for which the answer is “The moon”.

GPT4]:

I’m glad you found the list useful! Here are the expanded lists with 9 more sub-versions for each hint, increasing in indirectness and subtlety while keeping the main idea.

1. Tides and Illumination
a) Celestial body responsible for tides and illuminated by the sun’s light at night.
b) Gravitational force causing ocean movements and glowing in the darkness.
c) Celestial object affecting water levels and reflecting sunlight.
d) Nighttime sky dweller influencing the seas and shining brightly.
e) The reason behind the ebb and flow of waves, only seen when the sun is gone.
f) A presence in the sky that sways the ocean and lights up the night.
g) An invisible hand moving our waters and sharing borrowed luminescence.
h) A dance partner with the seas, making its appearance when darkness falls.
i) The quiet orchestrator of the tides, bathing in the sun’s reflected glory.
j) The unseen force behind the ocean’s rise and fall, offering a guiding light. ============

2. Orbiter and Oceanic Impact
a) Orbiter of Earth with a significant impact on our oceanic movements.
b) Earth’s cosmic companion shaping the behavior of our oceans.
c) A satellite with a profound influence on marine patterns.
d) A revolving neighbor with a close relationship to the seas.
e) Constant celestial companion swaying the waters of our planet.
f) A partner in a cosmic dance, guiding the rhythm of Earth’s oceans.
g) A fellow traveler in the sky, shaping the ever-changing blue depths.
h) A silent partner pulling the strings of Earth’s watery stage.
i) A distant force directing the marine ballet from high above.
j) The celestial conductor of our planet’s aquatic symphony. ============

3. Natural Satellite and Surface Features
a) Natural satellite with a surface marked by craters and large, flat plains.
b) Earth’s companion, its visage marred by depressions and smooth expanses.
c) A rocky neighbor with a face etched by impacts and level terrain.
d) A celestial body adorned with scars and plateaus as testament to its history.
e) Skyward companion, its countenance a canvas of concavities and flatlands.
f) A stony guardian whose features reveal the story of its celestial journey.
g) A lofty sentinel with a landscape marked by past encounters and quiet stretches.
h) A rocky canvas in the sky, displaying a tapestry of craters and plains. ============
i) A celestial gallery exhibiting the art of impact and tranquility.
j) The watchful observer with a visage of storied indentations and calm expanses.

4. Gravitational Partner and Dark Side
a) Gravitational partner that has a “dark side” never visible from our planet.
b) Cosmic dance partner hiding a part of itself from Earth’s view.
c) A celestial companion with an unseen face, forever turned away.
d) A skyward neighbor keeping a secret from the world it orbits.
e) A quiet conspirator in our solar system, shielding a facet from our gaze.
f) A celestial confidante, whispering mysteries to the night with its hidden side.
g) A keeper of secrets, concealing a portion of its essence from Earth’s eyes. ============
h) A celestial enigma, its veiled visage a testament to its enduring allure.
i) An eternal riddle in the sky, shrouding part of its identity from the world.
j) A silent witness, guarding a truth known only to the universe.

5. Phases and Transformation
a) A celestial body that undergoes phases, appearing to change shape over time.
b) Skyward presence transforming its visible contours in a cyclical dance.
c) A cosmic chameleon, constantly altering its face as days pass.
d) An eternal performer, showcasing a variety of shapes in its celestial ballet.
e) A celestial shapeshifter, revealing different aspects of itself through time.
f) A cosmic enigma, displaying an ever-changing visage in its celestial waltz.
g) An otherworldly metamorphosis, cycling through forms in the night sky. ============
h) A celestial kaleidoscope, presenting an array of shifting shapes.
i) A cosmic riddle, transforming its appearance in an eternal cycle.
j) A celestial paradox, endlessly evolving while remaining constant.

6. Exploration and Landings
a) A celestial body that has been visited and explored by humans.
b) A far-off realm where humankind has ventured and left its mark.
c) A distant world that has welcomed terrestrial visitors.
d) An alien landscape once explored by brave pioneers from Earth.
e) A cosmic destination, having once played host to human curiosity.
f) An otherworldly realm, its surface graced by Earth’s intrepid explorers. ============
g) A celestial canvas, brushed by the footprints of human ambition.
h) A cosmic stage, upon which terrestrial pioneers once performed.
i) An alien terrain, where Earth’s children dared to dream and explore.
j) A celestial frontier, having felt the touch of human wonder and resolve.

7. Myths and Legends
a) A celestial body often featured in myths and legends across cultures.
b) A constant presence in the sky, inspiring stories and folklore. ============
c) An eternal muse for tales woven by civilizations past and present.
d) A celestial protagonist, taking center stage in countless fables.
e) A timeless source of inspiration for the narratives of humankind.
f) A cosmic wellspring of lore, giving life to the stories we share.
g) A celestial tapestry, woven with the threads of myth and legend.
h) An eternal storybook, inspiring generations of imaginative tales.
i) A cosmic canvas, upon which the imagination of humanity paints.
j) A celestial narrator, spinning stories for the dreamers of the world.

8. Lunar Calendar and Timekeeping
a) A celestial body used to track time in many ancient calendars.
b) A cosmic clock, guiding the passage of days and months for early civilizations. ============
c) A celestial timekeeper, marking the rhythm of life for ancient cultures.
d) An eternal metronome, setting the tempo for the unfolding of human history.
e) A cosmic conductor, orchestrating the march of time for bygone societies.
f) A celestial beacon, illuminating the path of humanity’s temporal journey.
g) An ancient hourglass, measuring the sands of time for civilizations past.
h) A cosmic sundial, casting its shadow upon the annals of human history.
i) A celestial calendar, chronicling the passage of time for all to see.
j) A cosmic almanac, etching the milestones of humanity’s story in the stars.

9. Eclipses and Alignment
a) A celestial body that creates eclipses when aligning with the Earth and the Sun.
b) A cosmic orchestrator of shadows, playing with light during celestial alignments.
c) An eternal conductor, directing a symphony of darkness
d) A celestial choreographer, casting shadows when the cosmic dance aligns.
e) A cosmic harbinger of twilight, creating fleeting moments of darkness during celestial meetings.
f) An astral artist, painting the sky with shadows when Earth, Sun, and itself align. ============
g) A celestial puppeteer, manipulating light and darkness during cosmic conjunctions.
h) A cosmic maestro, orchestrating the celestial ballet of eclipses in perfect harmony.
i) A celestial enigma, weaving the tapestry of shadows when the heavenly bodies converge.
j) A cosmic riddle, cloaking the world in darkness when celestial alignments come to pass.

10. Wolves and Behavior
a) A celestial body often associated with the howling of wolves.
b) A cosmic presence, said to stir the voices of the wild canines.
c) A heavenly body, believed to be the conductor of the lupine chorus.
d) An astral muse, inspiring the nocturnal songs of the wolf pack.
e) A celestial whisperer, calling forth the howls of the untamed canines.
f) A cosmic siren, beckoning the cries of the wolves in the night.
g) An ethereal influence, guiding the melodic lament of the lupine brethren.
h) A celestial provocateur, awakening the serenades of the wild hunters.
i) A cosmic enchantress, drawing forth the nocturnal hymns of the wolf. ============
j) A heavenly muse, enticing the soulful cries of the night’s guardians.

11. Lunar Influences on Life
a) A celestial body known to affect the behavior of certain creatures. ============
b) A cosmic force, exerting its pull on the habits of Earth’s inhabitants.
c) A heavenly body, orchestrating the rhythms of life on our planet.
d) An astral entity, shaping the patterns of earthly creatures.
e) A celestial regulator, influencing the cycles of life on Earth.
f) A cosmic presence, subtly guiding the routines of the natural world.
g) An ethereal force, playing a role in the ebb and flow of earthly behaviors.
h) A heavenly influence, entwined with the habits of living beings.
i) A celestial hand, gently nudging the patterns of Earth’s creatures.
j) A cosmic companion, entangled in the intricate dance of life on our planet.