In a recent guest post on Intoli’s blog, I described the basics of using Luigi to build data science pipelines.

I also introduced the JupyterNotebookTask class that I wrote to run Jupyter notebooks as Luigi tasks.

Check out this and this.