Job Description
RoleBig Data Engineer
Required Technical Skill SetHadoop, PySpark, Spark SQL, HIVE
Number of Requirements8
Desired Experience Range5-12 years
Location of RequirementKuala Lumpur, Malaysia
Desired Competencies (Technical/Behavioral Competency)Must-HaveHands-on experience of Hadoop, PySpark, Spark SQL, Hive, Hadoop Big Data Eco System Tools.
Should be able to develop, tweak queries and work on performance enhancement.
Solid understanding of object-oriented programming and HDFS concepts.
The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing.
Good-to-HavePrefer to have good DWH/ Data Lake knowledge.
Conceptual and creative problem-solving skills, ability to work with considerable ambiguity, ability to learn new and complex concepts quickly.
Experience in working with teams in a complex organization involving multiple reporting lines.
The candidate should have good DevOps and Agile Development Framework knowledge.
Responsibilities / Expectations from the RoleNeed to work as a developer in Cloudera Hadoop.
Work on Hadoop, PySpark, Spark SQL, Hive, Bigdata Eco System Tools.
Experience working with team in a complex organization involving multiple reporting lines.
The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies.
The candidate should have strong DevOps and Agile Development Framework knowledge.
Create PySpark jobs for data transformation and aggregation.
Experience with stream-processing systems like Spark-Streaming.
Summary of Role RequirementsLooking for candidates available to work:
Monday: Morning, Afternoon, Evening
Tuesday: Morning, Afternoon, Evening
Wednesday: Morning, Afternoon, Evening
Thursday: Morning, Afternoon, Evening
Friday: Morning, Afternoon, Evening
Saturday: Morning, Afternoon, Evening
Sunday: Morning, Afternoon, Evening
More than 4 years of relevant work experience required for this role.
Work visa can be provided for this role.#J-18808-Ljbffr