Recently, Eliezer and I had an email conversation with Holden Karnofsky to discuss future-oriented philanthropy, including MIRI. The participants were:

• Eliezer Yudkowsky（金宝博娱乐Miri研究员）
• Luke Muehlhauser（Miri执行董事）
• Holden Karnofsky（联合首席执行官给予)

然后，我们将电子邮件对话编辑为简化的对话，可用这里。

另请参见Miri和Holden Karnofsky之间的四次对话：存在风险, onMIRI strategy, on透明研究分析金宝博娱乐,在流动效果。

Luke Muehlhauser：在上一次采访中，我斯科特·亚伦森问他在试图在理论研究中取得进展时发现了“对金宝博娱乐象级研究策略”，我提供了一些例子。您对斯科特和我列出的研究策略有任何评论吗？金宝博娱乐您自己的哪种推荐策略会添加到列表中？

约翰·贝兹（John Baez）: What do you mean by “object-level” research tactics? I’ve got dozens of tactics. Some of them are ways to solve problems. But equally important, or maybe more so, are tactics for coming up with problems to solve: problems that are interesting but still easy enough to solve. By “object-level”, do you mean the former?
阅读更多 ”

Highlights来自以下采访的普拉策的想法：

• Keymaera是用于网络物理系统的正式验证工具。金宝博官方它看到了许多现实世界的应用程序，例如在欧洲火车控制系统金宝博官方。
• Keymaera的功能来自Platzer的“差异动态逻辑”，该逻辑基于早期工作（例如）动态逻辑。
• Contra Levitt, Platzer isn’t convinced that autonomous robots will need to use decision theory, though they may.
• Platzer contrasts formal verification (“did I build the system right?”) with formal validation (“did I build the right system?”). One way to make progress on the latter is to develop what Rushby called “deep assumption tracking.”

阅读更多 ”

Highlightsof Klein’s thoughts, from the interview below:

• Verifying code not designed for verification is very difficult and costly. Such “post-mortem verification” has other disadvantages as well.
• 程序设计师可以使用抽象，模块化和明确的体系结构选择，以帮助使复杂的系统与人类透明。金宝博官方
• There are two ways probability can play a role in verification: (1) direct probabilistic reasoning, in the logic or in a setting where the program itself is probabilistic, or (2) standard non-probabilistic reasoning paired with subjectively uncertain reasoning about what a guarantee means for the overall probability that the system will work as intended.
• 真正的自主系统似乎还有很长的路要走金宝博官方，但是如果您可以制造出真正出乎意料的行为的系统，那么您就无法使其安全。

Luke Muehlhauser：在您即将发表的论文中”全面的正式验证操作系统微粒，”您和您的合着者描述了用于确保其验证的内核设计（SEL4）。您还讨论了保持正式证明当前的过程，“随着系统的要求，设计和实施在将近十年的时间里，它[更改]。”金宝博官方

How “micro” is the seL4 microkernel? That is, what standard functionality does it provide, and what functionality (that is common in larger OS kernels) does it不是提供？

格温·克莱因（Gerwin Klein）: It is pretty micro: it is a true micro-kernel in the L4 tradition. This means it is very small compared to traditional monolithic OS kernels: Linux has on the order of a few million lines of code, seL4 has on the order of 10,000 lines of C. seL4 provides only the core mechanisms that you need to build an OS. These include threads and scheduling, virtual memory, interrupts and asynchronous signals, as well as synchronous message passing. The maybe most important feature of seL4 is its strong access control mechanism that can be used together with the rest to build isolated components with controlled communication between them. These components could be small isolated device drivers or an entire Linux guest OS, the developer can choose the granularity.

理念是：如果一种机制严格需要实现特权硬件访问，则在内核中，但是如果可以使用其他机制作为用户级任务实现它，则它在内核之外。令人惊讶的功能可能出现在外面：例如，设备驱动程序，图形，文件和文件系统，网络堆栈，甚至磁盘分页。金宝博官方您（希望）得到的是，棘手的复杂性集中在内核中，用户级的操作系统组件变得更加模块化。

阅读更多 ”