Data Engineer Team Lead

Details of the offer

Are you ready to revolutionize the way we build data?At Deriv, we're looking for a talented Data Integration Engineer to spearhead our digital transformation initiatives.
In this role, you'll lead the organization in cultivating a data-driven culture as our company moves toward the future.As a key technology team member, you'll be responsible for overseeing the design, development, and optimization of our data pipelines, ensuring seamless integration and availability of data across all systems.
You will lead a talented team of data engineers and spearhead the execution of data strategies that are integral to supporting critical business decisions and operations.
A significant responsibility is to develop a unified data pipeline that effectively serves both internal systems and external applications, ensuring secure and real-time data flow across all platforms.On a given day, you will:Team Leadership: Lead and mentor a team of data engineers to design, build, and optimize scalable data pipelines for analytics, reporting, and operational needs.Unified Data Pipeline Management: Create and manage a unified data pipeline that integrates multiple data sources, facilitating efficient access for both internal and external systems, including third-party tools and client-facing platforms.Utilization of Low-Code/No-Code Tools: Leverage low-code/no-code integration tools such as Fivetran or RudderStack to accelerate data workflows and improve integration efficiency.Cross-Functional Collaboration: Work closely with various teams to identify data needs and ensure smooth data flows between systems, enhancing high availability and integration.Data Governance and Quality Assurance: Implement and manage data governance and quality standards, ensuring data consistency and reliability throughout the organization.Real-Time and Batch Data Architecture: Architect and oversee the implementation of real-time and batch data pipelines using data streaming tools like Kafka or Pub/Sub, ensuring low-latency, high-performance data processing.Technical Guidance and Support: Provide technical guidance to your team, aiding in troubleshooting complex data issues and optimizing performance and cost-effectiveness while adhering to best practices.Continuous Improvement: Stay informed on the latest in data engineering technologies and best practices, especially concerning real-time processing and low-code/no-code integrations, to enhance our data infrastructure continually.Stakeholder Coordination: Communicate with stakeholders to ensure timely delivery of data solutions that effectively meet business requirements.You may enjoy working with us if you:Experience in fintech, trading, or other data-heavy industries.Familiarity with API-based integrations and third-party system integrations.Knowledge of additional data streaming technologies and best practices.Experience with automating data flows using low-code platforms.We would love to work with you if you:Bachelor's degree in computer science, data engineering, or a related field.10 years of experience in data engineering, with at least 4 years in a leadership role.Expertise in designing, building, and maintaining data pipelines and data warehouse solutions.Strong knowledge of cloud platforms such as Google Cloud or AWS, and tools like BigQuery, PostgreSQL, and Airflow.Proficiency in programming languages such as Python or similar, with experience in ETL/ELT processes.Hands-on experience with low-code/no-code data integration tools like Fivetran, RudderStack, or similar platforms.Deep understanding of real-time data streaming and data processing tools such as Kafka, Pub/Sub, or similar.Experience in building unified data pipelines that serve both internal and external systems, ensuring consistent, secure data flows.Experience working with both real-time and batch data processing systems.Strong understanding of data governance, security, and compliance practices.Excellent communication skills, with the ability to convey technical concepts to non-technical stakeholders and mentor junior team members.Benefits:We pay competitive salaries based on your skills, qualifications, experience, and market rates.
Additionally, you'll be eligible for an annual bonus based on individual and company performance.You'll also receive comprehensive health benefits, including private medical insurance, life insurance, and health screenings.You'll get generous annual and parental leave, and we'll cover the costs of professional development and education related to advancing your career at Deriv.At our modern headquarters in Cyberjaya, you'll join a diverse community of over 600 talented individuals.
You'll have the chance to significantly impact our company's success while experiencing Malaysia's perfect blend of cutting-edge technology and tropical surroundings.Our culture is unique, and we live by our values and leadership principles, so it's worth learning more about Deriv's culture.Imagine what you could do with us.
If you're ready to take on this exciting challenge and lead our customer service into the future, we can't wait to hear from you.Deriv is an equal opportunity employer committed to diversity and inclusion.
We take pride in our Great Place to Work and IIP Platinum certifications, which reflect our commitment to creating an exceptional work environment.
Join us and help build the future of online trading while working alongside top talent from over 80 nationalities.#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Software Engineer ( Java)

Senior Software Engineer | IT Services Provider | Petaling JayaCompany OverviewWe are partnered with an IT Services provider that is a pioneer in Cloud platf...


Career Horizons - Selangor

Published a month ago

Senior Full Stack Developer

To participate in the software engineering group in charge of our client-facing websites, databases, internal APIs, and other key systems. Must adhere to our...


Career Horizons - Selangor

Published a month ago

Head Of Agrochemical

Job Role:The Head of Retail Development is responsible for planning, administering, implementing, and coordinating effective sales strategies and leading the...


Hunters International Sdn Bhd - Selangor

Published a month ago

Agile Pm (Several Positions)

Job Description - Agile PM (Several Positions) (MER0003FU1) Description About Us At Mercedes-Benz, we don't just build cars, we create great software. We dev...


Daimler Trucks North America Llc - Selangor

Published a month ago

Built at: 2025-01-08T06:12:25.201Z