Responsibilities:- Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualizationAnalyse and perform data profiling to identify data patterns and discrepancies, adhering to Data Quality and Data Management processesPerform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extractionDesign, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworksIntegrate and collate data silos in a manner which is both scalable and compliantCollaborate with Project Manager, Business Analysts, Frontend Developers, UX Designers and Data Analyst to build scalable data-driven productsBe responsible for developing backend APIs & working on databases to support the applicationsCreate data exports, data APIs, and data visualizations using tools like Power BI, Tableau, or other visualization platforms.Work in an Agile Environment that practices Continuous Integration and Delivery Qualifications:- Proficient in general data cleaning and transformation (e.g. SQL, R etc)Proficient in building ETL pipeline (eg. SQL Server Integration Services (SSIS), AWS Database Migration Services (DMS), Python, AWS Lambda, ECS Container task, Eventbridge, AWS Glue, Spring)Proficient in database design and various databases (e.g. SQL, PostgreSQL, AWS S3, Athena, MongoDB, Postgres/gis, MYSQL, SQLite, voltdb, Cassandra, etc)Knowledge about system design, data structure and algorithmsFamiliar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, Data Virtualization and Data WarehouseFamiliar with rest API and web requests/protocols in generalFamiliar with W3C Document Object Model and customized web scraping (e.g. BeautifulSoup, CasperJS, PhantomJS, Selenium, Nodejs, etc)Comfortable in at least one scripting language (eg. SQL, Python)Familiarity with data processing, ETL development, and data visualization toolsExcellent problem-solving skills and attention to detailStrong communication skills to collaborate with technical and non-technical teams