非交互式地运行 IPython/Jupiter 笔记本

是否有人知道是否可以从命令行非交互式地运行 IPython/Jupiter 笔记本，并将结果 .ipynb文件保存为运行结果。如果这还不可能实现，那么用 phantomJS、用来开关内核和用来开关 Web 服务器的东西来实现它会有多难呢？

更具体地说，让我们假设我已经有了一个笔记本 original.ipynb，我想重新运行笔记本中的所有单元格，并将结果保存在一个新的笔记本 new.ipynb中，但是在命令行中只需要一个命令就可以做到这一点，而不需要在浏览器中进行交互，也不需要关闭内核或 Web 服务器，假设没有内核或 Web 服务器已经在运行。

示例命令:

$ ipython notebook run original.ipynb --output=new.ipynb

35622 次浏览
小开

You can just run the iPython-Notebook-server via command line:

ipython notebook --pylab inline

This will start the server in non-interactive mode and all output is printed below the code. You can then save the .ipynb-File which includes Code & Output.

小开
最佳答案

Yes it is possible, and easy, it will (mostly) be in IPython core for 2.0, I would suggest looking at those examples for now.

[edit]

$ jupyter nbconvert --to notebook --execute original.ipynb --output=new.ipynb

It is now in Jupyter NbConvert. NbConvert comes with a bunch of Preprocessors that are disabled by default, two of them (ClearOutputPreprocessor and ExecutePreprocessor) are of interest. You can either enabled them in your (local|global) config file(s) via c.<PreprocessorName>.enabled=True (Uppercase that's python), or on the command line with --ExecutePreprocessor.enabled=True keep the rest of the command as usual.

The --ExecutePreprocessor.enabled=True has convenient --execute alias that can be used on recent version of NbConvert. It can be combine with --inplace if desired

For example, convert to html after running the notebook headless :

$ jupyter nbconvert --to=html --execute RunMe.ipynb

converting to PDF after stripping outputs

$ ipython nbconvert --to=pdf --ClearOutputPreprocessor.enabled=True RunMe.ipynb

This (of course) does work with non-python kernels by spawning a <insert-your-language-here> kernel, if you set --profile=<your fav profile>. The conversion can be really long as it needs to rerun the notebook. You can do notebook to notebook conversion with the --to=notebook option.

There are various other options (timeout, allow errors, ...) that might need to be set/unset depending on use case. See documentation and of course jupyter nbconvert --help, --help-all, or nbconvert online documentation for more information.

小开

Until this functionality becomes part of the core, I put together a little command-line app that does just what you want. It's called runipy and you can install it with pip install runipy. The source and readme are on github.

小开

To cover some features such as parallel workers, input parameters, e-mail sending or S3 input/output... you can install jupyter-runner

pip install jupyter-runner

Readme on github: https://github.com/omar-masmoudi/jupyter-runner

小开

Run and replace original .ipunb file:

jupyter nbconvert --ExecutePreprocessor.timeout=-1 --to notebook --inplace --execute original.ipynb
小开

One more way is to use papermill, it has Command Line Interface

Usage example: (you need to specify output path for execution results to be stored)

papermill your_notebook.ipynb logs/yourlog.out.ipynb

You also can specify required params if you wish with -p flag for each param:

papermill your_notebook.ipynb logs/yourlog.out.ipynb -p env "prod" -p tests "e2e"

one more related to papermill reply - https://stackoverflow.com/a/55458141/2957102


提交答案