CSR: Small: Operating Systems Kernels in High-Level Languages

CSR：小：高级语言的操作系统内核

• 批准号: 1617487
• 负责人: Robert Morris
• 金额: $ 50万
• 依托单位: Massachusetts Institute of Technology
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2019-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1617487&HistoricalAwards=false
• 关键词: CSR; Small; Operating; Systems; Kernels

Most software depends on the correctness and efficiency of the underlying operating system kernel, since the kernel mediates access to resources such as storage, network, and memory. Kernels are typically implemented in low-level languages, for example, the Linux kernel is written in the C language; such languages are efficient but difficult to use correctly. In contrast, implementing kernels in high-level languages could in principle result in both reduced programmer effort and reduced incidence of bugs. This research will explore the costs and benefits of implementing kernels in high-level languages.The main reason kernels use C is performance. C allows a kernel to define its own high-performance mechanisms for memory management, thread scheduling, interrupts, etc. In contrast, high-level languages tend to prescribe specific particular mechanisms in these areas, which are difficult to change. One potential problem is that high-level languages are often garbage-collected to improve safety, but garbage collection is widely viewed as too slow to use in kernels.This project will first investigate performance: whether a kernel written in a high-level language can be as fast as a kernel written in C. The project will implement a kernel using the Go language, a type-safe, garbage-collected language with good support for threads. Then, the plan is to compare performance with existing C kernels such as Linux, OpenBSD, and FreeBSD. It is expected there will be a need to face efficiency and functionality challenges, particularly in the use of garbage collection for large kernel data structures such as file and page caches.The project's second area of focus will be to exploit the high-level language to achieve multi-core in-kernel parallelism in situations that are not practical when using C. C impedes flexible use of transient threads, since the programmer must supply the logic to decide when the last thread has finished using each shared object, which can then be freed. Extensive use of threads is much easier when a garbage collector automates this task. The plan is to exploit Go's garbage collection by implementing complex system calls such as fork and exec using internal worker threads on multiple cores. The team will evaluate whether the resulting performance and scalability improvement can be made to outweigh the costs of garbage collection and thread overhead.Intellectual merit.This work will shed quantitative light on the effect of language choice on kernel performance, a question that is currently understood mostly anecdotally. The interaction of garbage collection with the specific ways kernels use memory is particularly worth understanding. The investigation of in-kernel parallelism will exploit high-level language support to harness techniques that are impractical in C kernels.Broader impacts.The work has the potential for broad impact because most software depends critically on services provided by the operating system kernel. Using a better language for the kernel would likely reduce the prevalence of bugs and increase the ease with which kernel developers can provide desirable new features. Providing solid evidence to support an eventual switch to language technology which ought to make kernels more reliable and easier to develop is the intended outcome.

大多数软件依赖于底层操作系统内核的正确性和效率，因为内核介导对存储、网络和内存等资源的访问。内核通常是用低级语言实现的，例如，Linux内核是用C语言编写的;这样的语言很有效，但很难正确使用。相比之下，用高级语言实现内核原则上可以减少程序员的工作量和错误的发生率。这项研究将探讨在高级语言中实现内核的成本和好处。内核使用C的主要原因是性能。C允许内核定义自己的高性能机制，用于内存管理，线程调度，中断等，相反，高级语言倾向于在这些领域规定特定的特定机制，这些机制很难改变。一个潜在的问题是高级语言通常会进行垃圾收集以提高安全性，但垃圾收集被广泛认为太慢而不能在内核中使用。本项目将首先研究性能：用高级语言编写的内核是否可以像用C编写的内核一样快。该项目将使用Go语言实现一个内核，Go语言是一种类型安全、垃圾收集的语言，对线程有很好的支持。然后，计划将性能与现有的C内核（如Linux、OpenBSD和FreeBSD）进行比较。预计将有需要面对效率和功能的挑战，特别是在使用垃圾收集的大型内核数据结构，如文件和页面缓存。该项目的第二个重点领域将是利用高级语言，以实现多核内核并行的情况下，是不切实际的使用C。C阻碍了瞬态线程的灵活使用，因为程序员必须提供逻辑来决定最后一个线程何时完成使用每个共享对象，然后才能释放。当垃圾收集器自动执行此任务时，线程的广泛使用就容易得多了。该计划是通过使用多个核心上的内部工作线程实现复杂的系统调用（例如fork和exec）来利用Go的垃圾收集。团队将评估是否可以使最终的性能和可伸缩性改进超过垃圾收集和线程开销的成本。智力价值。这项工作将定量地阐明语言选择对内核性能的影响，这是一个目前大多数人理解的问题。垃圾收集与内核使用内存的特定方式之间的交互尤其值得理解。内核并行性的调查将利用高级语言的支持，利用技术，是不切实际的C kernels.Broader的影响。这项工作有可能产生广泛的影响，因为大多数软件严重依赖于操作系统内核提供的服务。为内核使用更好的语言可能会减少bug的流行，并增加内核开发人员提供所需新功能的容易性。提供坚实的证据来支持最终转向语言技术，这应该使内核更可靠，更容易开发，这是预期的结果。