Singularity.FM

Johan Steyn Interviews Nikola Danaylov on Artificial Intelligence

·45 min·4 clips
Johan Steyn reveals how Nikola Danaylov's book 'Conversations with the Future' launched his quest to understand AI and the singularity.
Johan Steyn introduces the episode by sharing how Nikola Danaylov's book 'Conversations with the Future' transformed his understanding of AI and the singularity. Danaylov defines the technological singularity, coined by Vernor Vinge, as an intelligence explosion where machines surpass human intelligence, creating an event horizon beyond which we cannot predict. He explains that this moment could mean humanity becomes the second smartest species. Danaylov critiques Ray Kurzweil's prediction that machines will equal human intelligence by 2045, suggesting it might take longer due to unresolved issues in artificial general intelligence. He references Demis Hassabis of DeepMind, who noted limited progress in AGI despite advances like AlphaGo. Danaylov highlights stumbling blocks, such as machines struggling with tasks easy for humans, like learning from few examples. He shares insights from his interview with Marvin Minsky, who argued that no one is working on AGI and that current AI is narrow. Danaylov contrasts closed-system learning in games like Go with the open-system challenges of the real world. He discusses the lack of progress in machine consciousness, noting that AI lacks meta-awareness. Danaylov then recounts his personal journey, starting with a master's thesis on the intersection of machine and human intelligence, which faced academic skepticism. After graduating during the 2008 recession, he sent over 300 resumes without success, including to Singularity Hub. This led him to start his own blog and, later, the Singularity.FM podcast, initially using the alias Socrates. His podcast grew to over 250 interviews with experts like Michio Kaku and Noam Chomsky, requiring extensive preparation. Danaylov's book became an Amazon bestseller in three hours due to his audience demand. He mentions working on a new book about how narratives shape our future, influenced by Yuval Noah Harari. The episode concludes with Steyn expressing appreciation and plans for future discussions.

As heard by us

A grounded AI conversation on why intelligence that wins at chess can still struggle when the world will not hold still.

Johan Steyn's conversation with Nikola Danilov brings the AI debate down to a useful dividing line: machines can excel in closed systems like chess and Go, while human intelligence keeps adapting in open systems where the rules shift and the variables multiply.

Read the full review in PlayNext →

Why you'd press play

Want to know why a car can follow familiar roads, then stumble when the world gets messy?

Read the full recommendation in PlayNext →
Listen to the show on