Machine Intelligence Research Institute Progress Report, March 2012

||News

Past progress reports:2012年2月,January 2012,2011年12月

一天中有趣的事实:The Machine Intelligence Research Institute’s research fellows and research associates have more peer-reviewed publications forthcoming in 2012 than they had published in all past years combined

以下是机器智能研究本月金宝博娱乐itute did in March 2012:

  • Research articles: Luke and Anna released an updated draft ofIntelligence Explosion: Evidence and Import, and Luke and Louie released an updated draft ofThe Singularity and Machine Ethics。Luke submitted an article (co-authored with Nick Bostrom) toCommunications of the ACM— an article on Friendly AI. Machine Intelligence Research Institute research associate Joshua Fox released two forthcoming articles co-authored with (past Machine Intelligence Research Institute Visiting Fellow) Roman Yampolskiy:人工通用情报的安全工程人工通用情报和人类心理模型
  • Other articles: Luke publishedThe AI Problem, with Solutions,How to Fix Science,Muehlhauser-Goertzel Dialogue Part 1, alist of journals that may publish articles on AI risk, and the first three posts in his series人工智能风险和机会:战略分析。The Machine Intelligence Research Institute paid (past Visiting Fellow)Kaj Sotalato write most of a new instructional booklet for Less Wrong meetup group organizers, which should be published in the next month or two. Eliezer continued work on his new Bayes’ Theorem tutorial and other writing projects. Carl publishedUsing degrees of freedom to change the past for fun and profit痛苦和愉悦同样能节能吗?
  • Ongoing long-term projects: Amy continued to work on Singularity Summit 2012. Michael continued to work on the Machine Intelligence Research Institute’s new primary website, new Summit website, new annual report, and new newsletter design. Louie continued to improve our accounting processes and also handled several legal and tax issues. Luke uploaded several more volunteer-prepared translations of面对奇异性。卢克还继续建立机器情报研究所的一组远程合作者,他们努力工作将机器情报研究所的研究文章转换为新的模板,追捕对A金宝博娱乐I的预测,撰写有关启发式方法和偏见的文献摘要等。
  • Rationality Group: Per ourstrategic plan, we will launch this new “Rationality Group” organization soon, so that the Machine Intelligence Research Institute can focus on its efforts on activities related to AI risk. In March, Rationality Group (led by Anna) contracted withJulia Galef和Michael Smith to work toward launching the organization. Eliezer continued to help Rationality Group develop and test its lessons. Rationality Group has begun offeringprizesfor suggesting exercises for developing rationality skills, starting with the skills of “Be Specific“ 和 ”检查后果主义。” Rationality Group has also announced threeMinicamps on Rationality and Awesomeness, for May 11-13, June 22-24, and July 21-28.Apply now
  • Meetings with advisors, supporters, and potential researchers:As usual, various SI staff met or spoke with dozens of advisors, supporters, and collaborators about how to build the existential risk community, how to mitigate AI risk, how to improve the Machine Intelligence Research Institute’s effectiveness, and other topics. This included a two-week visit byNick Beckstead, who worked with us on AI risk reduction strategy.
  • 当然,在这里列出的要多得多!

Finally, we’d like to recognize ourmost active volunteers2012年3月:Matthew Fallshaw,Gerard McCusker,Frank Adamek和David Althaus。感谢大家!(而且,如果我们忘了给您起名字,我们的道歉!)

Machine Intelligence Research Institute Progress Report, February 2012

||News

Past progress reports:January 2012,2011年12月

以下是机器智能研究本月金宝博娱乐itute did in February 2012:

  • Winter fundraiser completed: Thanks to the generous contributions of our supporters, our latest winter fundraiser was a success, raisingmuch morethan our target of $100,000!
  • Research articles: Luke and Anna published the奇点峰会2011年工作shop Report和released a draft of their articleIntelligence Explosion: Evidence and Import, forthcoming in Springer’sThe Singularity Hypothesis。Luke also worked on an article forthcoming inCommunications of the ACM
  • Other articles: Luke published a continuously updated list ofForthcoming and desired articles on AI risk。For Less Wrong, Carl publishedFeed the Spinoff Heuristic, and Luke published我击败拖延的算法,A brief tutorial on preferences in AI, andGet Curious。Carl also published 4 articles on ethical careers for the80,000 Hours blog(后来的帖子将讨论最佳慈善事业和生存风险):How hard is it to become the Prime Minister of the United Kingdom?,企业家精神:扑克游戏,而不是轮盘,Software engineering: Britain vs. Silicon Valley, and5 ways to be misled by salary rankings
  • Ongoing long-term projects: Amy continued to work on Singularity Summit 2012. Michael continued to work on the Machine Intelligence Research Institute’s new website, and uploaded all past Singularity Summit videos to YouTube. Louie continued to improve our accounting processes and also handled several legal and tax issues. Luke uploaded several volunteer-prepared translations of面对奇异性,也是podcastfor this online mini-book.
  • Grant awarded:机器情报研究所授予哲学家金宝博娱乐Rachael Briggsa $20,000 grant to write a paper on Eliezer Yudkowsky’stimeless decision theory。拉切尔的两篇论文 -Distorted Reflection决策理论Paradoxes as Voting Paradoxes— have previously been selected as among the 10 best philosophy papers of the year byThe Philosopher’s Annual
  • Rationality Group:安娜和埃利泽(Anna)和埃利泽(Eliezer)继续领导一个新的理性教育组织的发展,暂时称为“理性小组”。per我们strategic plan, we will launch this new organization soon, so that the Machine Intelligence Research Institute can focus on its efforts on activities related to AI risk. In February our Rationality Group team worked on curriculum development with several potential long-term hires, developed several rationality lessons which they tested (weekly) on small groups and iterated in response to feedback, spoke to advisors about how to build the organization and gather fundraising, and much more. The team also produced one example rationality lesson on sunk costs, includinga presentation and exercise booklets。Note that Rationality Group iscurrently hiringcurriculum developers, a remote executive assistant, and others, soapply hereif you’re interested!
  • Meetings with advisors, supporters, and potential researchers:As usual, various SI staff met or spoke with dozens of advisors, supporters, and collaborators about how to build the existential risk community, how to mitigate AI risk, how to improve the Machine Intelligence Research Institute’s effectiveness, and other topics. We also met with several potential researchers to gauge their interest and abilities. Carl spent two weeks in Oxford visiting theFuture of Humanity Institute和working with the researchers there.
  • Outsourcing: On Louie’s (sound) advice, the Machine Intelligence Research Institute is undergoing a labor transition such that most of the work we do (in hours) will eventually be performed not by our core staff but by (mostly remote) hourly contractors and volunteers, for exampleremote researchers, remoteLaTeX workers, remote editors, andremote assistants。This shift provides numerous benefits, including (1) involving the broader community more directly in our work, (2) providing jobs for aspiring rationalists, and (3) freeing up our core staff to do the things that, due to accumulated rare expertise, only they can do.
  • 当然,在这里列出的要多得多!

Finally, we’d like to recognize ourmost active volunteers2012年2月:Brian Rabkin,Cameron Taylor,Mitchell Owen,Gerard McCusker,Alex Richard,Andrew Homan,Vincent Vu,Gabriel Sztorc,Paul Paul Gentemann,John Maxwell,John Maxwell和David Althaus。感谢大家!(而且,如果我们忘了给您起名字,我们的道歉!)

2011-2012 Winter Fundraiser Completed

||News

Thanks to our dedicated supporters, we met our goal for our 2011-2012 Winter Fundraiser. Thank you!

筹款活动从2011年12月27日到2012年2月20日持续了56天。

We exceeded our $100K goal, raising a total of $143,048.84 from 101 individual donors.

Every donation that the Machine Intelligence Research Institute receives is powerful support for ourmission— ensuring that the creation of smarter-than-human intelligence (超级智能) benefits human society. We welcome donorscontacting usto learn more about our pursuit of this mission and our continued expansion.

Keep your eye on this blog for regular progress reports from our executive director.

Machine Intelligence Research Institute Progress Report, January 2012

||News

Past progress report:2011年12月

以下是机器智能研究本月金宝博娱乐itute did in January 2012:

  • Winter fundraiser: We continued raising funds in January, but we still have about $30,000 left to go in our winter fundraiser before the deadline of February 20th. Please support our recent efforts toward greater transparency, efficiency, and productivity by188betapp !
  • Strategic discussions: In January we held a long and ongoing series of discussions concerning Machine Intelligence Research Institute strategy. Which scenarios are the most probable “desirable” futures for humanity, which ones can our species influence most significantly, and which ones should the Machine Intelligence Research Institute work to influence? Which tactical moves should the Machine Intelligence Research Institute make right now? How can our efforts best create synergies with other organizations focused on existential risks? These are complex questions, and in January, Machine Intelligence Research Institute staff members spent dozens of hours sharing their own evidence and arguments. (At one point, we also要求the expertise of more than a dozen elite mathematicians in our circle.) These discussions continue today, and our opinions on strategy appear to be more unified than they were at the beginning of the month. But there is more evidence to gather and more strategic analysis to be done.
  • Ongoing long-term projects:艾米(Amy)继续为2012年的奇异峰会做准备。MichaelAnissimov和其他人继续在机器情报研究所的新网站上进行工作,该网站将采用大量新内容和清洁设计。金宝博娱乐作为我们透明度努力的一部分,卢克给了一个second Q&Aabout the Machine Intelligence Research Institute, an interview at80,000 Hours, and another interview atSingularity 1 on 1。Louie continued to work on improving our book-keeping and accounting practices. Anissimov finished thanking all donors who gave during 2011. (If you donated in 2011 and werenotthanked, please contact michael@singularity.org!)
  • Articles: Luke and Anna continued writing “Intelligence Explosion: Evidence and Import,” and Carl continued working withStuart Armstrongof FHI on “Arms Races and Intelligence Explosions.” Luke began adding non-English translations at面对奇异性,并出版No God to Save UsValue is Complex and Fragilethere. Carl, with co-author Nick Bostrom, submitted a final version of “人工智能有多难?” to theJournal of Consciousness Studies。ForLess Wrong, Luke published好奇心是什么样的,Can the Chain Still Hold You?,Leveling Up in Rationality, andThe Human’s Hidden Utility Function (Maybe); Anna publishedUrges vs. Goals。Eliezer continued work on his new Bayes Tutorial. Luke and Anna wrote a report on the workshops that followed Singularity Summit 2011, which should be published soon.
  • Rationality Group:安娜继续领导一个新的理性教育组织的发展,暂时称为“理性小组”。per我们strategic plan, we will launch this new organization soon, so that the Machine Intelligence Research Institute can focus on its efforts on activities related to AI risk. In January we made one trial-hire for the new organization, andreached out to dozensof other potential team members. We alsopublisheda draft of one rationality lesson as a sample (PowerPoint slides + booklet PDFs).
  • New team members:Kevin Fischerof GK International joined our board of directors. We also added several newresearch associates:Paul Christiano,Tyrrell McAllister,János Kramar, and Mihaly Barasz (at Google Switzerland). Luke hired an executive assistant, Denise Simard. Michael Vassar officially left his role as President to work for his new company,个性化医疗
  • Meetings with advisors, supporters, and potential researchers:As usual, various SI staff met or spoke with dozens of advisors, supporters, and collaborators about how to build the existential risk community, how to mitigate AI risk, how to improve the Machine Intelligence Research Institute’s effectiveness, and other topics. We also met with several potential researchers to gauge their interest and abilities.
  • Relaunched the Visiting Fellows program: In January we relaunched our Visiting Fellows program. Instead of hosting many visiting fellows at once, we will now host only 1-2 fellows at a time, for a limited duration unique to each visiting fellow. Our visiting fellow for the last week of January was Princeton philosophy undergraduateJake Nebel。If you’re interested, please apply to our Visiting Fellows program这里
  • Much more: Launched a redesign ofhpmor.com, continued work in the optimal philanthropy movement, continued work on our first annual report, and much more.

Finally, we’d like to recognize ourmost active volunteers2012年1月:Mitchell Owen,Brian Rabkin,Huon Wilson,David Althaus,Florent Berthet,Sergio Terrero,Lightwave,Emile Kroeger和Giles Edkins。感谢大家!(而且,如果我们忘了给您起名字,我们的道歉!)

Machine Intelligence Research Institute Progress Report, December 2011

||News

“I think the Machine Intelligence Research Institute has some very smart people working on the most important mission on Earth, but… what exactly are theydoing这些日子?我在黑暗中。”

There’s a good reason I hear this comment so often. We haven’t done a good job of communicating our progress to our supporters.

自从11月被任命为机器情报研究所(SI)的执行董事以来,我一直在努力改变这一点。金宝博娱乐我给了twoQ&Asabout SI and explained our research program with alist of open problems in AI risk research。Now, I’d like to introduce our latest effort in transparency:monthly progress reportsRead more »

Q&A #2 with Luke Muehlhauser, Machine Intelligence Research Institute Executive Director

||News

Machine Intelligence Research Institute Activities

Bugmaster问道:

…what does the SIAI actually do? You don’t submit your work to rigorous scrutiny by your peers in the field… you either aren’t doing any AGI research, or are keeping it so secret that no one knows about it… and you aren’t developing any practical applications of AI, either… So, what is it that you are actually working on, other than growing the SIAI itself ?

It’s a good question, and my own biggest concern right now. Donors would like to know: Where is the visible return on investment? How can I see that I’m buying existential risk reduction when I donate to the Machine Intelligence Research Institute?Read more »

Interview with New MIRI Research Fellow Luke Muehlhauser

||Conversations

Section One: Background and Core Ideas

Q1.What is your personal background?
Q2.Why should we care about artificial intelligence?
Q3.Why do you think smarter-than-human artificial intelligence is possible?
Q4.The mission of the Machine Intelligence Research Institute is to “to ensure that the creation of smarter-than- human intelligence benefits society.” How is your research contributing to that mission?
Q5.How does MIRI’s approach to making friendly AI differ from the concept of Asimov laws?
Q6.Why is it necessary to make an AI that “€œwants the same things we want”?
Q7.If dangerous AI were to develop, why couldn’€™t we just “€œpull the plug”€?
Q8.Why are you and the Machine Intelligence Research Institute focused on artificial intelligence instead of human intelligence enhancement or whole brain emulation?

Read more »