Senior/Principle/Senior Principle Devops Engineer_Fully In Office

Details of the offer

SUMMARY OF RESPONSIBILITIES 
As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling efficient and relia ble data pipeline building, data analysis, and data governance. Your primary responsibility will be to ensure s mooth data ingestion into the data lake or data warehouse, enabling downstream data consumption for Data Scientists, Analysts, and other stakeholders. You will utilize various AWS services such as MSK/Kafka, S3, E MR or Glue, Lakeformation, Athena, QuickSight, and manage ingestion from different databases like MS SQL, MySQL, Oracle, and PostgreSQL. 
(Apply now at https://my.hiredly.com/jobs/jobs-malaysia-triiio-job-senior-principle-senior-principle-devops-engineer_fully-in-office)
; Requirements:- Data Pipeline Build: 



-Collaborate with Data Engineers to design, implement, and optimize data pipelines. 


-Ensure efficient and reliable data ingestion processes from various sources into the data lake or data w warehouse. 


-Implement data validation and quality checks to maintain data integrity throughout the pipeline. 

Data Analysis Support: 



-Assist Data Scientists and Analysts in their routine analytical work by providing data access and query s support. 


-Optimize data storage and retrieval mechanisms to enhance performance and efficiency. 


-Collaborate with stakeholders to identify and implement solutions for data analysis and reporting requir ements. 

Data Governance and Security: 



-Utilize AWS Lakeformation and other relevant tools to establish and enforce data governance policies. 


-Implement security measures and access controls to protect sensitive data. 


-Collaborate with stakeholders to ensure compliance with data privacy regulations

 Technical Expertise: 



-Strong expertise in AWS services such as MSK/Kafka, S3, EMR or Glue, Lakeformation, Athena, and Qui ckSight. Proficient in database management systems like MS SQL, MySQL, Oracle, and PostgreSQL. 


-Familiarity with Change Data Capture (CDC) mechanisms and practices. 


-Solid understanding of data pipeline architecture, ETL processes, and data integration techniques 

Automation and Infrastructure as Code (IaC):



-Proficiency in infrastructure automation using tools like Terraform, CloudFormation 


-Experience in managing and administering Kubernetes on-premises or EKS in AWS 


-Experience with version control systems (e.g., Git) and CI/CD pipelines for automated deployments. 


-Understanding of Infrastructure as Code (IaC) principles to maintain reproducible and scalable environ ments. 


-Proficient in programming languages such as Python, Golang, Java


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Job Function:

Requirements

Registered Nurse - Home Health

Summary: Care of the patient in the home setting. Requirements: Currently licensed as an RN is the state of IL. CPR certified. Previous Home Health experien...


Silver Cross Hospital - Kuala Lumpur

Published a month ago

Senior Manager, Marketing, Apac Surg

Innovation starts from the heart. Heart valve disease and critical care therapies impact millions of lives, spanning all ages and geographies. As communities...


Edwards Lifesciences - Kuala Lumpur

Published a month ago

Medical Assistant - $2500 Sign On Bonus

Our Mission To improve the health of the communities we serve through contemporary, innovative, quality healthcare solutions. Schedule:  Monday - Friday A...


Freeman Health System - Kuala Lumpur

Published a month ago

Medical Editor

Job Description The department creates or vets copy that can pass the rigorous scrutiny of our clients' medical-legal committees, as well as the FDA. The tea...


Publicis Groupe - Kuala Lumpur

Published a month ago

Built at: 2024-12-11T21:16:32.125Z