Reports‌Airflow vs. Luigi: Which ETL Tool is the Best? EN
Created
Last edited
‌ Term used
‌‌
Your working draft
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌
‌

airflow

airflows
Importance: 10/10
Heading presence: ‌ High
Typical uses: 7-21
Current uses: 51

python

Importance: 10/10
Heading presence: ‌ Low
Typical uses: 4-10
Current uses: 4

workflow

workflows
Importance: 10/10
Heading presence: ‌ Moderate
Typical uses: 5-13
Current uses: 15

luigi

Importance: 10/10
Heading presence: ‌ High
Typical uses: 8-22
Current uses: 56

dag

dags
Importance: 9/10
Typical uses: 3-9
Current uses: 3

open source

open-source, opensource, open-sources
Importance: 9/10
Typical uses: 2-4
Current uses: 3

etl

etls
Importance: 9/10
Heading presence: ‌ Moderate
Typical uses: 4-10
Current uses: 12

scheduler

scheduling, schedule, schedules
Importance: 9/10
Typical uses: 2-6
Current uses: 14

dependencies

dependency
Importance: 8/10
Typical uses: 2-4
Current uses: 2

data pipelines

data pipeline, data pipelining, data-pipelines
Importance: 8/10
Heading presence: ‌ Low
Typical uses: 1-3
Current uses: 5

airbnb

airbnbs
Importance: 6/10
Typical uses: 1-3
Current uses: 2

aws

Importance: 6/10
Typical uses: 1-3
Current uses: –

spotify

Importance: 6/10
Typical uses: 1-3
Current uses: 1

directed acyclic graphs

directed acyclic graph
Importance: 6/10
Typical uses: 1-2
Current uses: –

hadoop

Importance: 6/10
Typical uses: 1-3
Current uses: 1

apache airflow

apache-airflow
Importance: 6/10
Heading presence: ‌ Low
Typical uses: 2-6
Current uses: 3

api

apis
Importance: 6/10
Typical uses: 2-4
Current uses: 4

nodes

node
Importance: 6/10
Typical uses: 1-2
Current uses: 1

workflow management

workflow manager, workflow managers
Importance: 6/10
Heading presence: ‌ Low
Typical uses: 2-6
Current uses: 8

machine learning

machine-learning
Importance: 5/10
Heading presence: ‌ Low
Typical uses: 1-2
Current uses: –

spark

Importance: 5/10
Heading presence: ‌ Low
Typical uses: 2-4
Current uses: –

visualization

visualizations, visual
Importance: 5/10
Typical uses: 1-3
Current uses: 2

data science

datascience
Importance: 5/10
Typical uses: 1-3
Current uses: 1

sql

Importance: 5/10
Typical uses: 1-3
Current uses: –

template

templates, templating
Importance: 5/10
Typical uses: 1-2
Current uses: 1

data engineers

data engineering, data engineer, dataengineer
Importance: 4/10
Typical uses: 1-3
Current uses: 2

command line

command-line, command lines
Importance: 4/10
Typical uses: 1-2
Current uses: –

extensible

extension, extensibility, extensions
Importance: 4/10
Typical uses: 1-3
Current uses: –

github

Importance: 4/10
Typical uses: 2-6
Current uses: 1

orchestration

orchestrator, orchestrators
Importance: 4/10
Typical uses: 2-4
Current uses: –

metadata

meta-data
Importance: 4/10
Typical uses: 1-2
Current uses: –

python package

python packages, python_packages
Importance: 4/10
Typical uses: 1-2
Current uses: 1

redshift

Importance: 4/10
Typical uses: 1-2
Current uses: –

automation

automic
Importance: 4/10
Typical uses: 1-3
Current uses: 2

tutorial

tutorials
Importance: 4/10
Typical uses: 1-2
Current uses: 1

data warehouse

data warehouses, datawarehouse
Importance: 3/10
Heading presence: ‌ Low
Typical uses: 2-6
Current uses: 1

data scientists

data scientist
Importance: 3/10
Typical uses: 1-3
Current uses: –

user interface

Importance: 3/10
Typical uses: 1-2
Current uses: 1

kubernetes

Importance: 3/10
Typical uses: 2-4
Current uses: –

data processing

Importance: 3/10
Typical uses: 1-3
Current uses: 1

use cases

use case, use-case, use-cases
Importance: 3/10
Typical uses: 1-3
Current uses: 1

data analysis

data analyses
Importance: 3/10
Typical uses: 1-2
Current uses: 1

ecosystems

ecosystem
Importance: 3/10
Typical uses: 1-2
Current uses: 1

use airflow

Importance: 3/10
Typical uses: 1-3
Current uses: 1

cron jobs

cron job, cronjob
Importance: 3/10
Typical uses: 1-2
Current uses: 1

amazon

Importance: 3/10
Typical uses: 1-2
Current uses: –

rerun

reruns
Importance: 3/10
Typical uses: 1-3
Current uses: 2

batch jobs

batch job
Importance: 3/10
Typical uses: 1-2
Current uses: 1

dataset

data sets, datasets, data set
Importance: 3/10
Typical uses: 1-3
Current uses: 1

big data

Importance: 3/10
Typical uses: 1-2
Current uses: 1

complex workflows

complex workflow
Importance: 3/10
Typical uses: 1-2
Current uses: 1

data flow

dataflow, data flows, dataflows
Importance: 3/10
Typical uses: 1-2
Current uses: 1

slack

Importance: 3/10
Typical uses: 1-2
Current uses: –

real-time

real time, realtime
Importance: 3/10
Typical uses: 1-3
Current uses: 1

data structures

data-structure, data structure
Importance: 3/10
Typical uses: 1-2
Current uses: 1

pandas

Importance: 2/10
Typical uses: 2-4
Current uses: –

algorithms

algorithm
Importance: 2/10
Typical uses: 1-2
Current uses: –

hive

Importance: 2/10
Typical uses: 1-2
Current uses: 1

data sources

data source, datasources
Importance: 2/10
Typical uses: 1-3
Current uses: 1

argo

Importance: 2/10
Typical uses: 1-3
Current uses: –