It Senior Staff Engineer (Production Data Engineering)

null
Collaborate with cross-functional teams such as data scientists, analysts, and other stakeholders to understand their requirements and deliver data solutions. Communicate technical concepts effectively to non-IT audiences.
Integrate data from various sources such as databases, datalogs and APIs into a unified format for analysis. Develop ETL (Extract, Transform, Load) processes and real-time data pipelines.
Evaluate and select appropriate tools and technologies for data storage, processing, and extraction.
Develop and maintain robust ETL processes and data pipelines for ingesting, processing, and transforming large volumes of data from various sources. Ensure data quality and data integrity throughout the pipelines.
Performance data extraction and create dashboard/ reports for data visualization.
Design, develop, deploy and support production applications to enable test measurement operations. Ensure data exchange between IT application and tester works perfectly.
Bachelor's degree and above in Computer Science, Software Engineering or similar with minimum 7 years of experience. Minimum 3 years of hands-on experience in data engineering.
Good understanding of Agile methodology.
Good experience in application development (DotNet, SOAP services, Restful API, JAVA, CUDA, ILGPU)
Proficient in Database skill (Oracle, SQL Server, NoSQL)
Experience in Cloud computing, Databricks and Snowflake.
Experience in data staging using Python and SQL.
Experience in Bigdata tools and technology such as Apache NIFI, Kafka, Airflow.
Experience with data serialization (JSON, AVRO, Parquet, Metadata)
Familiar with manufacturing system architecture.
Experience in semiconductor manufacturing/ operation technology is an added advantage.#J-18808-Ljbffr