We are seeking a talented Python Developer who is passionate about data to join our team as a Data Engineer.
In this role, you will play a crucial part in developing and maintaining data pipelines, ensuring the reliability, efficiency, and scalability of our data systems.
You will collaborate closely with cross-functional teams including Data Scientists, Analysts, and Software Engineers to drive data initiatives and support our business objectives.
KEY AREAS OF RESPONSIBILITIESDesign, develop, and maintain robust data pipelines and ETL processes using Python and related technologies prioritising native coding over low code platforms.
Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
Optimize and tune data workflows for performance, scalability, and reliability.
Implement data quality checks and ensure data integrity throughout the data lifecycle.
Work with cloud-based technologies such as AWS, GCP, or Azure to deploy and manage data pipelines.
Develop and maintain documentation for data processes, systems, and best practices.
Stay up to date with emerging technologies and industry trends related to data engineering.
QUALIFICATIONS & EXPERIENCEMinimum Qualifications
Bachelor's degree in computer science, Engineering, or a related field.
Proven experience as a Python Developer with a strong understanding of software development principles with a minimum of 4 years of experience.
Hands-on experience with building and optimizing data pipelines using Python and related libraries/frameworks (e.g., Pandas, NumPy, Airflow).
Familiarity with SQL and database technologies (e.g., PostgreSQL, MySQL, or similar).
Experience working with cloud platforms such as AWS, GCP, or Azure.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration abilities.
Experience with Big Data technologies (e.g., Hadoop, Spark) is a plus.
Join us in embracing digital payments and advancing Malaysia's financial landscape.#J-18808-Ljbffr