To understand the basic skill sets required to be a data engineer, let’s start with understanding what a data engineer’s role comprises of.

This role is ever growing and ever changing. A data engineer has the responsibility to collect, store, query, clean and manipulate databases in an efficient way. A typical data engineer works closely with data scientists and data analysts. Think of a data engineer as the architect who builds data tables for the scientists and analysts to analyze.

A very strong requirement for any data engineer role is a broad knowledge base of different database languages like SQL or NoSQL. A data engineer needs to be proficient in Python, as well as certain data warehousing techniques like Hadoop, MapReduce, HIVE and Apache Spark.

READ FULL ARTICLE HERE