Do you like to work in a dynamic environment and collaborate with teams to build exciting new Data Products?
Look no further. We are looking for a Lead Data Engineer for our client. You will
· Design and develop the architecture roadmap for big data platforms including data modeling, data security, master data management, etc.
· Design data models and associated metadata for mission-critical and high-volume data systems, real-time and distributed data processing systems, data lakes/data warehouse
· Supervise Data technical team removing roadblocks and mentoring the team to accelerate knowledge and Data Governance maturity
· Interface with key business stakeholders to gather data integration requirements and develop solutions accordingly.
· Navigate challenges in terms of uncertainty and focus on delivering high value at any given time - Communicate risks and issues to different stakeholders including executive management
What we are looking for
· Overall 7+ years’ experience with minimum 4 years’ experience in developing data engineering capabilities for large and complex data
· Strong experience in working with visualization tools, data ingestion tools, API knowledge
· Good knowledge of Hadoop ecosystem (Hive, Impala, Kafka, Spark etc) and associated tools and cloud-based technologies (AWS-based).
· Experience in programming Python, Scala, and Java
· Highly proficient at reading, profiling, parsing, transforming, cleansing and integrating data from various sources (structured and unstructured).
· Strong awareness of Data Security, Data Governance and Service Operations processes.
· Experience developing data solutions using native IaaS and PaaS solutions on AWS (EMR, Redshift, RDS, S3) a distinct advantage
· Experience programming Apache Spark solutions (PySpark, Scala, Java, R) etc. a distinct advantage
· Full project lifecycle experience, from initial concept through to deployment and support Basic knowledge of Machine Learning algorithms and techniques a plus.
Keen to know more about the role? Apply now! Reach out to me at firstname.lastname@example.org for a confidential discussion
#dataengineer #darawarehouse #datamodeling #datapipeline #datamining
Check out xpand.sg for more interesting roles! #loveyourwork #lifeasanxpander
CEI No: R1546455 | Licence No: 07C3147
Data Support Specialist - Market Data
Singapore / SGD 100k to SGD 140k
Who's this for? Our client is one of the well-known fintech brand around the globe. Currently, my client is building its data team and one of the v...
Lead Enterprise Architect - International MNC - Hong Kong
Hong Kong / HK $1.8m - HK $2m +
My client has established a digital business offshoot, their Digital Transformation Unit (DTU), with the goal of developing digital solutions for t...
Agile QA Testing Lead - Global MNC - Hong Kong
Hong Kong / HK $720,000 - HK $960,000
My client, a leading global MNC, is currently seeking an Agile QA Testing Lead to join their expanding Digital division in a newly created role in ...