About AET Abyres Enterprise Technologies Sdn. Bhd, a subsidiary of AbyresHoldings Sdn. Bhd. is aleading data engineering consultancy & professional services company based in Cyberjaya,Malaysia. At AET, we believe that data is the most valued asset in today's digital world. Wespecializes in leveraging open-source software and open standards to unlock the truepotential of data.
Our mission is to empower businesses by transforming raw data into actionable insights andtangible business value. With our expertise and dedication, we turn complexity into clarity,making data work for our clients.
Visit to know more aboutAET! Our clients need expert advise and guidance in implementing solutions for managing andleveraging their data for improving their business. Your primary goal will be to help clientsimplement data solutions that drive business improvement. You will play a crucial role inunderstanding client requirements, proposing suitable solutions, and delivering themsuccessfully. As the Lead Engineer, you will oversee end-to-end ETL processes, manage ateam, and collaborate with various stakeholders to ensure effective data extraction,transformation, and loading into a Kimball data warehouse. You'll employ technologies suchas Python, SQL (MSSQL, MySQL, Hive, PostgreSQL), Apache Spark (PySpark), andorchestration tools like Apache Airflow and Kubeflow. Your role also involves containerizationusing Kubernetes, Helm, and Kubedirector to maintain data quality and compliance for datadrivendecision-making.
Your Responsibilities Take ownership of the proposed data solutions and drive their successfulimplementation. Work closely with cross-functional teams, including data engineers,developers, and project managers, to ensure timely and high-quality delivery. Establish strong relationships with clients and serve as their trusted advisor.Understand their pain points and objectives, and provide strategic guidance on howdata solutions can address their business challenges. Lead and manage ETL development activities, ensuring adherence to project timelines,budgets, and quality standards. Proactively identify and mitigate risks to ensure smoothproject execution. Requirements Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or arelated field. 5+ years of hands-on experience in ETL development and data engineering. Ability to work independently and self directed. Proven experience in data engineering, including ETL pipelines development andimplementation and data warehousing. Able to lead ETL development team, plan the tasks and work collaboratively with theteam. Proficiency in programming languages such as Python, and SQL (MSSQL, MySQL,Hive, PostgreSQL) Proficiency in data technologies (Apache Spark/PySpark, Apache Airflow, KubeFlowand S3) Solid understanding of Kimball Data Warehouse design (dimension table, fact table,SCD tables) Strong understanding of data management, data integration, and data governanceprinciples. Hands on experience with deployment on major platforms (eg: Kubernetes, Linux,Docker, Helm, Kubedirector) Excellent problem-solving skills and the ability to translate business requirements intotechnical solutions. Exceptional communication and interpersonal skills, with the ability to effectivelyinteract with clients and stakeholders. Nice To Have Experience in data technologies such as Spark, Kubernetes, Jupyter, Neo4j, KNIME,Cloudera, HPE Ezmeral, PostgreSQL, Citus, Presto, Trino, Hive, Airflow, Superset,Pynecone, NodeJS, MinIO, Rancher, Gitlab CE, FalconLLM, or OpenAI. Experience theories and practices around software engineering, software architecture,Kimball data warehouse dimensional modeling, knowledge graph, natural languageprocessing, intent parsing, or knowledge management. Why AET Why choose AET for your next career move? Hereare just a few reasons:
Cutting-edge Technology – Join our team and work with the latest open-sourcesoftware and open standards, ensuring you stay at the forefront of data engineeringadvancements. We believe in the power of collaboration and openness, drivinginnovation and pushing boundaries. Impactful Projects – Be a part of exciting and challenging projects that make a realdifference for our clients. From data integration and transformation to advancedanalytics and machine learning, you'll have the opportunity to work on diverse projectsacross various industries, sharpening your skills and expanding your knowledge. Collaborative Environment – We foster a collaborative and inclusive work culturewhere everyone's ideas are valued. At AET, you'll work alongside talentedprofessionals who are passionate about data engineering and share a common goal ofdelivering exceptional results. Our team-oriented approach ensures that you'll alwayshave the support and guidance you need to excel. Continuous Learning – We believe in the continuous development of our teammembers. Through mentorship programs, training workshops, and access to learningresources, we provide ample opportunities for you to enhance your skills and stayahead in this rapidly evolving field. Join AET and embark on an exciting journey where you'll be empoweredto make a realimpact with data. Apply now and become a valued member of our team!
How To Apply? If you are interested, please send an email with your resume to ******** stating the roleyou are applying for.
Apply Now Please fill in the form below. If you're shortlisted, we will get intouch withyou.
#J-18808-Ljbffr
