IBM Introduction to Data Engineering
Course Objectives:
List basic skills required for an entry-level data engineering role
Discuss various stages and concepts in the data engineering life cycle.
Describe data engineering technologies such as Relational Databases, NoSQL Data Stores, and Big Data Engines.
Summarize concepts in data security, governance, and compliance.
ETL and Data Pipelines with Shell, Airflow and Kafka (ongoing)
Course Objectives:
Describe and contrast Extract, Transform, Load (ETL) processes.
Explain batch vs concurrent modes of execution.
Implement ETL workflow through bash and Python functions.
Describe data pipeline components, processes, tools, and technologies.
Skills acquired:
Extract Transform and Load (ETL)
Data Engineer
Apache Kafka
Apache Airflow
Data Pipelines