Data Engineer

Job DescriptionData Engineer builds the Data Ingestion and ETL components for the data migration project. Expertise in any of the industry standard ETL tools such as SSIS, Azure Data Factory, or Data Stage is required.
Job Requirements
Familiarity with ETL tools and databases such as Teradata or SQL Server, Azure, Azure Data Factory, SQL
4-6 years overall experience and at least 3 years working as a Data Engineer
Masters/Bachelors in Computer Science/Engineering, Business Analytics, Information Systems, or other related disciplines
Proficient in ETL tools such as SSIS and Azure Data Factory; excellent communication, relationship skills, and a strong team player
Good to have:
Deep understanding of statistical modeling, machine learning, or data mining, text mining concepts, and a track record of solving problems with these methods. Experienced in big data techniques (such as Hadoop, MapReduce, Hive, Pig, Spark) is a plus.
Job Responsibilities
Engage in exploratory data analysis to identify trends and data patterns
Perform data preparation and data cleaning as part of the data migration project
Understand source data and support source to target mapping rules
Design and implement the ETL framework for the data warehouse
Build the Data Ingestion framework and ingest data from source files to load into the staging layer
Perform data profiling and identify any data quality issues to report to source systems
Using best practices, build the ETL components as per mapping rules to move data into ODS, SOR layer, and data marts
Ensure the ETL jobs are set up, configured, and scheduled
Perform unit testing on ETL components built and provide unit test results; support system integration testing and user acceptance testing and fix any issues#J-18808-Ljbffr