Singularity Hypotheses: A Scientific and Philosophical Assessment现在已由Springer发布,在HardCover和电子书表格中。
The book contains 20 chapters about the prospect of machine superintelligence, including 4 chapters by MIRI researchers and research associates.
“Intelligence Explosion: Evidence and Import”(PDF.)由卢克·迈翰万家和(以前的Miri研究员)Anna Salamon评论金宝博娱乐
关于三个索赔的证据:(1)有一个大量的机会,我们将在2100之前创造人级AI,即(2)如果创造人级AI,则会有一个很好的机会,超人艾美岛将遵循一个“情报爆炸”,(3)一个不受控制的情报爆炸可能会摧毁我们的价值的一切,但如果我们能够实现它,受控情报爆炸会使人类受益。我们结束了建议,以增加相对于不受控制的智力爆炸的受控情报爆炸的几率。
“智力爆炸和机器伦理”(PDF.) by Luke Muehlhauser and Louie Helm discusses the challenges of formal value systems for use in AI:
许多研究人金宝博娱乐员认为,一个自我完善的artificial intelligence (AI) could become so vastly more powerful than humans that we would not be able to stop it from achieving its goals. If so, and if the AI’s goals differ from ours, then this could be disastrous for humans. One proposed solution is to program the AI’s goal system to want what we want before the AI self-improves beyond our capacity to control it. Unfortunately, it is difficult to specify what we want. After clarifying what we mean by “intelligence,” we offer a series of “intuition pumps” from the field of moral philosophy for our conclusion that human values are complex and difficult to specify. We then survey the evidence from the psychology of motivation, moral psychology, and neuroeconomics that supports our position. We conclude by recommending ideal preference theories of value as a promising approach for developing a machine ethics suitable for navigating an intelligence explosion or “technological singularity.”
“友好的人工智能”by Eliezer Yudkowsky is a shortened version ofYudkowsky (2008)。
最后,“人工综合情报和人体心理模型”(PDF.)由罗马yampolskiy和(Miri Research As金宝博娱乐sociate)约书亚福克斯评论了人为机器智能的危险:
当建立第一次人工综合智能时,它们可能会改善到遥远的人类水平。关于这种未来实体的猜测已经是受拟人偏见的FF,这导致了与人类思想的错误类比。在本章中,我们应用了一个面向目标的对智力的理解,以表明人类只占据可能的思想的设计空间的一小部分。这个空间远远大于我们熟悉人类的实例;并且未来的高度精神的心理架构和目标无需具有人类思想的大部分性质。一种新的认知科学和哲学的方法,不需要在人类的例子中,需要帮助我们了解我们在大于美国的力量时所面临的挑战。
这本书还包括对大多数章节的简短,关键响应,包括Eliezer Yudkowsky和(以前的Miri Staffer)Michael Anissimov所写的答复。