- Spawning containers from within a container? http://luigi.readthedocs.io/en/stable/ 10 comments docker
Linking pages
- GitHub - spotify/luigi: Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in. https://github.com/spotify/luigi 17 comments
- Python & Big Data: Airflow & Jupyter Notebook with Hadoop 3, Spark & Presto http://tech.marksblogg.com/python-big-data-airflow-jupyter-notebook-hadoop-3-hive-presto.html 9 comments
- Best Practices from Provectus for Migrating and Optimizing Amazon EMR Workloads | AWS Partner Network (APN) Blog https://aws.amazon.com/blogs/apn/best-practices-from-provectus-for-migrating-and-optimizing-amazon-emr-workloads/ 8 comments
- How to build a DAG based Task Scheduling tool for Multiprocessor systems using python | by Ramses Alexander Coraspe Valdez | ITNEXT https://coraspe-ramses.medium.com/how-to-build-a-dag-based-task-scheduling-tool-for-multiprocessor-systems-using-python-d11a093a835b?sk=cd97481b16fea0e941c32362eaded7c5 1 comment
- Alpaca: Airflow at JW Player. How our custom platform built on top of… | by William Bartos | JW Player Engineering | Medium https://medium.com/jw-player-engineering/alpaca-airflow-at-jw-player-7b01c562b8ce 1 comment
- Data-driven marketing at Smarkets | by Shashank Khare | Smarkets HQ https://smarketshq.com/data-driven-marketing-at-smarkets-3fc5755fa294#.zeisog5bm 0 comments
- GitHub - kinesintech/daggyr https://github.com/kinesintech/daggyr 0 comments
- How to build a DAG based Task Scheduling tool for Multiprocessor systems using python | by Ramses Alexander Coraspe Valdez | ITNEXT https://itnext.io/how-to-build-a-dag-based-task-scheduling-tool-for-multiprocessor-systems-using-python-d11a093a835b 0 comments
- What Are ETLs And Why We Use Them – From Software To Development – Logit Consulting https://logitanalytics.com/what-are-etls-and-why-we-use-them-from-software-to-development/ 0 comments
- My Journey Into Data Science and Bioinformatics — Part 1: Programming | by Ruben Van Paemel | Towards Data Science https://towardsdatascience.com/my-journey-into-data-science-and-bio-informatics-749ece4d8860 0 comments
- A Guide To The Data Lake — Modern Batch Data Warehousing | by Daniel Mateus Pires | Towards Data Science https://towardsdatascience.com/a-guide-to-modern-batch-data-warehousing-extraction-f63bfa6ef878 0 comments
- Introducing Druzhba: a Data Pipeline Framework - ChairNerd https://chairnerd.seatgeek.com/druzhba-open-source-release/ 0 comments
- How to Use OSS: Why you Should Throw Away Airflow and Start Using Dagster https://www.plural.sh/blog/why-you-should-throw-away-airflow-and-start-using-dagster/ 0 comments
- Data Orchestration Tools: Ultimate Review https://lakefs.io/blog/data-orchestration-tooling-2023/ 0 comments
Would you like to stay up to date with DevOps? Checkout DevOps
Weekly.
Related searches:
Search whole site: site:luigi.readthedocs.io
Search title: Getting Started — Luigi 2.8.13 documentation
See how to search.