Bounteous is a premier end-to-end digitaltransformation consultancy dedicated to partnering with ambitious brands tocreate digital solutions for today's complex challenges and tomorrow'sopportunities. With uncompromising standards for technical and domainexpertise, we deliver innovative and strategic solutions in Strategy,Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, andMarketing.`

One of ourkey Financial Services clients is looking for a Data Engineer fora senior position based in Singapore.

JobDescription

We are seeking a skilled and motivated Data Engineer withexpertise in Hadoop, Spark, OpenShift Container Platform (OCP), and DevOpspractices. As a Data Engineer, you will be responsible for designing,developing, and maintaining efficient data pipelines, processing large-scaledatasets. Your expertise in Hadoop, Spark, OCP, and DevOps will be crucial inensuring the availability, scalability, and reliability of our ML Solutions. Theprimary application you will be working on is the Quantexa platform in the AMLdomain.

Responsibilities:

• Implement datatransformation, aggregation, and enrichment processes to support various dataanalytics and machine learning initiatives

• Collaborate withcross-functional teams to understand data requirements and translate them intoeffective data engineering solutions

• Ensure data quality andintegrity throughout the data processing lifecycle

• Design and deploy dataengineering solutions on OpenShift Container Platform (OCP) usingcontainerization and orchestration techniques

• Optimize data engineeringworkflows for containerized deployment and efficient resource utilization

• Collaborate with DevOpsteams to streamline deployment processes, implement CI/CD pipelines, and ensureplatform stability

• Implement data governancepractices, data lineage, and metadata management to ensure data accuracy,traceability, and compliance

• Monitor and optimize datapipeline performance, troubleshoot issues, and implement necessary enhancements

• Implement monitoring andlogging mechanisms to ensure the health, availability, and performance of thedata infrastructure

• Document data engineeringprocesses, workflows, and infrastructure configurations for knowledge sharingand reference

• Stay updated with emergingtechnologies, industry trends, and best practices in data engineering andDevOps

• Provide technicalleadership, mentorship, and guidance to junior team members to foster a cultureof continuous learning and innovation to the continuous improvement of theanalytics capabilities within the bank

Requirements:

• Bachelor's degree incomputer science, Information Technology, or a related field

• At least 6 years ofexperience as a Data Engineer, working with Hadoop, Spark, and data processingtechnologies in large-scale environments

• Strong expertise indesigning and developing data infrastructure using Hadoop, Spark, and relatedtools (HDFS, Hive, Pig, etc)

• Experience withcontainerization platforms such as OpenShift Container Platform (OCP) andcontainer orchestration using Kubernetes

• Proficiency in programminglanguages commonly used in data engineering, such as Spark, Python, Scala, orJava

• Knowledge of DevOpspractices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker,Jenkins, Ansible, BitBucket)

• Experience with jobsschedulers like Control-m

• Experience with Graphana,Prometheus, Splunk will be an added benefit

• Quantexa exposure and/orcertification a strong plus

• Strong problem-solving andtroubleshooting skills with a proactive approach to resolving technicalchallenges

• Excellent collaboration andcommunication skills to work effectively with cross-functional teams

• Ability to manage multiplepriorities, meet deadlines, and deliver high-quality results in a fast-pacedenvironment

• Experience with cloudplatforms (e.g., AWS, Azure, GCP) and their data services is a plus

Key Technical Skills:

• Scala

• Python

• Spark

• Java

• SQL,

• Shell Script, Java

• Hadoop / Cloudera

• Elastic Search

• Read Heat OCP

What'son Offer

Bounteousbrings together 5000+ employees spanning North America, APAC, and EMEA, andpartnerships with leading technology providers. Through advanced digitalengineering, technology solutions, and data-driven digital experiences, wecreate exceptional and efficient business impact and help our clients win.

Bounteousis focused on promoting an inclusive environment and is proud to be an equalopportunity employer. We celebrate the different viewpoints and experiences ourdiverse group of team members bring to Bounteous. Bounteous does notdiscriminate on the basis of race, religion, colour, gender identity,sexual orientation, age, physical or mental disability, national origin, or anyother status protected under state, or local law.