Data Integration Engineer

Key Activities
Design, build and deploy optimized, sustainable data pipelines and data products leveraging ELC best practices and development frameworks.
Optimize PySpark code for Databricks.
Develop reusable libraries for reuse of common transformation patterns.
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
Identify, design, and implement internal process improvements: automating.
Technical Skills and Qualifications
Experience in Python, PySpark.
Experience in Azure Cloud.
Experience in distributed computing environments, preferably Databricks.
Understanding of the Azure Platform as a Service ecosystem including components such as Azure Data Factory, Databricks, SQL DB.
Experience building data pipelines, architectures, and datasets would be a plus.
Experience building processes supporting data transformation, data structures, metadata, dependency, and workload management would be a plus.
Experience with tools that support Agile Methodology would be a plus.
Functional Skills
Ability to work with cross-functional teams in a dynamic international environment.
Ability to understand business requirements and translate them into data integration requirements.
Good understanding of the Software Development Life Cycle for analytical projects.
Good communication skills.
What's on Offer
Attractive Remuneration Package
Enhance your Analytical Skills
Contact
Annika Wong
Quote job ref JN-102024-6576232
Phone number: +60 3 2302 4077#J-18808-Ljbffr