Oil 0.8.pre6 - Pure Bash and C++

栏目: IT技术 · 发布时间: 4年前

内容简介:This is the latest version of Oil, a Unix shell that's our upgrade path frombash:Oil version 0.8.pre6 - Source tarballs and documentation.To build and run it, follow the instructions inINSTALL.txt. The wiki has tips on

This is the latest version of Oil, a Unix shell that's our upgrade path frombash:

Oil version 0.8.pre6 - Source tarballs and documentation.

To build and run it, follow the instructions inINSTALL.txt. The wiki has tips on How To Test OSH .

Table of Contents

Patch to run the mal Lisp

Appendix: Selected Metrics

Highlights

(1) Fixes soOSH can run two interpreters written in bash :

  • The kanaka/mal Lisp. I implemented negative slice indices for strings like ${s : -5 : -2} , and submitted a patch upstream. The next section explains the patch.
  • Crestwave's Brainfuck . I fixed a corner case with literal hyphens in globs like ${x//['+-']} , and fixed the semantics of unset a[-1] .

These are pure programs in the sense that they do little I/O. For example, they don't start external processes like common shell scripts. Pure programs are useful to test the speed of the OSH interpreter itself, and because translating I/O to C++ is separate work.

(2) Fixes to run the ShellSpec test framework. For example, shopt -u verbose_errexit makes OSH silent on errexit , like other shells. Feedback on the shell's verbosity is still welcome.

Keep the bug reports coming! The fixes were minor, which is evidence that OSH is maturing.

(3) More progress translating Oil to C++, i.e.oil-native. The last release announcement described this work.

  • The main bundle osh_eval.cc now has ~24K lines of code, up from ~21K .
  • The native interpreter passes 633 spec tests, up from 420 . More details below.

Note that these two strands of work have yet to converge. That is, the Python version of OSH can run Lisp, Brainfuck, and a JSON parser, butoil-native can't yet.

Achieving that may be a good milestone for version 0.8.0 !

Patch to run the mal Lisp

Pull Request 518 on kanaka/mal was merged a couple days ago, and it shows the changes necessary to run mal under OSH. To justify the changes, I linked to sections in the Known Differences doc :

  • Arrays and strings are distinct in OSH, but not in bash.
  • Associative array keys must be quoted, because Parsing Bash is Undecidable . That is, OSH avoids dynamic parsing based on the runtime type of the variable.
  • I extracted a constant regex, as suggested by the bash manual. OSH doesn't have a special lexing mode for the pattern in [[ x =~ $pat ]] .

In my mind, each of these changes improved the program . So this is evidence that OSH is delivering on its claims to be a stricter, saner language, while still running real bash programs .

Related: Oil 0.8.pre4 - The Biggest Shell Programs in the World

Closed Issues

You can also view thefull git log.

#774 eval 'break' doesn't break, 'source return.sh' doesn't return, etc.
#772 Support negative indices in string slices
#769 read -n1 </dev/null succeeds
#768 Unsetting the last element of an array and appending an element behaves differently than bash
#765 Incorrect handling of literal hyphen in patsub
#763 Suppress some errexit messages

What's Next?

I'm very focused on translation to C++. Running these pure bash programs under theoil-native will be a great milestone, and it opens up the possibility of using existing benchmarks in the kanaka/mal repository. How fast does a Lisp run under OSH?

Such benchmarks aren't representative of all shell programs, but they are representative of programs that do a lot of string processing, like autocompletion plugins .

I'd still like more help with testing , bug fixes, and evaluating theOil language. As I mentioned in the last post, Oil is looking more like a language/library for building shells than a shell itself.

If you want it to be more than that, please get involved! Send us a message on Github or Zulip .

Appendix: Selected Metrics

Let's compare this release with last month's0.8.pre5 release.

Lines of Native Code

Most commits in this release were related to C++ translation. Here's evidence of that:

Binary Size

I still have to figure out why the size of osh_eval.opt.stripped differs so much between GCC and Clang.

I also think that the binary is too big, considering the source code size. For example,bash has over 140K lines of code, and it's also about 1 MB in size.

I spent some time withbloaty and it looks like some of the problems are:

  • Exception tables. Oil uses exceptions but bash doesn't.
  • Extra pretty-printing methods generated byASDL. These can be removed with some effort.
  • Global strings that are dynamically allocated. This is a result of the roughmycpp translation, which still needs improvement in many areas.
  • mycpp compiles every Python % format string into a C++ function, which increases the code size. I think Rust programs often notice an analogous issue.
  • Constant data. Oil has about twice as much as bash, maybe due to more detailed error messages.

However, to keep this in context, common shells in Rust or Go are often 10x bigger than Oil and bash. They're more like 10 MB than 1 MB.

But my goal is to sneak theOil language in "for free", so to speak. Making the binary smaller is future work .

Build Speed

For osh_eval.opt.stripped :

  • 0.8.pre5 : 58.2 / 18.2 seconds under GCC. 44.3 / 14.3 seconds under Clang.
  • 0.8.pre6 : 57.5 / 21.2 seconds under GCC. 51.6 / 16.9 seconds under Clang.

Compared to oil.ovm :

  • 0.8.pre5: 50.2 / 18.9 seconds under GCC, 50.9 / 14.6 under Clang
  • 0.8.pre6: 53.0 / 19.6 seconds under GCC, 51.9 / 15.1 under Clang (redundant)

Compared to bash make :

  • 0.8.pre5: 69.1 / 25.5 seconds under GCC
  • 0.8.pre6: 69.4 / 25.7 seconds under GCC (redundant)

Sooil-native compiles about as fast as our slice of CPython, and compiles a bit faster than bash.

Although again, it has fewer lines of code than bash, so I think it should be even faster. I think that getting rid of small translation units ( .cc files) may improve build times. This is also future work .

Test Results

More builtins run in C++, leading to over 200 new tests passing:

(Minor harness bugs: I fixed the inconsistency between 1539 and 1560 that showed up last time, but there's still an inconsistency between 1589, and 1587 below.)

OSH spec tests:

Oil spec tests:

Significant lines of code:

Physical lines:

Benchmarks

These benchmarks are still noisy, but roughly unchanged. The parser benchmark measures C++ code:

The runtime benchmark measures Python code for now:


以上所述就是小编给大家介绍的《Oil 0.8.pre6 - Pure Bash and C++》,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对 码农网 的支持!

查看所有标签

猜你喜欢:

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

PHP+MySQL八大动态Web应用实战

PHP+MySQL八大动态Web应用实战

Jono Bacom / 吴连河、李剑 / 电子工业出版社 / 2008-6 / 68.00元

本书详细介绍了利用PHP+MySQL开发常见类型Web应用程序的完整设计和编码技术,并对整体设计与关键代码给予了细致、深入的剖析。其内容注重实践,提供了翔实完整的实战代码;思路独树一帜,突破过多描述语言细节的窠臼;行文风趣幽默,轻松调侃中将项目的完整设计过程分析得一清二楚。书中的示例项目完整而实用,读者甚至无需任何改动即可在实际中加以运用。. 本书适合对PHP/MySQL有初步了解但缺乏完整......一起来看看 《PHP+MySQL八大动态Web应用实战》 这本书的介绍吧!

SHA 加密
SHA 加密

SHA 加密工具

XML、JSON 在线转换
XML、JSON 在线转换

在线XML、JSON转换工具

HEX CMYK 转换工具
HEX CMYK 转换工具

HEX CMYK 互转工具