What if the future AI will have an IQ of 6455? “As soon as it works, no one calls it AI anymore.” (John McCarthy). The content of the book is heavy to read, but inorder to understand the fundamentals of AI - you should master these topics.įrom human intelligence to superintelligence

Should the AI’s plans be subjected to human review before being put into effect? If so, what is the protocol for that review process?' What should the AI’s prior probability function be, and what other explicit or implicit assumptions about the world should it make? What theory of anthropics should it use? Should the AI use causal decision theory, evidential decision theory, updateless decision theory, or something else? IV) “Keep humankind ultimately in charge of its own destiny”Īfter these decisions humans needs to decide what kind of AI to build - genie, oracle, sovereign or tool-AI (I'll refer to these later in the analysis), and then decide the components to upload into these systems: III) “Avoid creating a motive for modern-day humans to fight over the initial dynamic” II) “Avoid hijacking the destiny of humankind” Second Bostrom points out solutions to the value-specification problem for AI and superintelligence: III) A robot must protect its own existence as long as such protection does not conflict with the First or Second Law. II) A robot must obey any orders given to it by human beings, except where such orders would conflict with the First Law. I) A robot may not injure a human being or, through inaction, allow a human being to come to harm. The topics are - laws of robotics, the value problem and components of AI.Ībout the threats of superintelligence Bostrom quotes Isaac Asimov's “three laws of robotics” concept: I'll start the analysis by pointing out three fundamental topics of AI and superintelligence. Bostrom uses a lot of space to analyze the potential threats that the superintelligence concept consists, but I won't bring those topics up more than needed.

The book is very philosophical and in the same time very fundamental on explaining the basics of AI. My analysis of Nick Bostrom's 'Superintelligence' will be a lenghty one and more detailed than ever. Read this book if you want to fully understand the concept of AI and superintelligence.

Superintelligence paths