Data Engineer
ITCAN PTE. LIMITED
Role description
. Datasets and data pipelines preparation, support forBusiness, data troubleshooting.
. Closely collaborate with the Data & Analytics ProgramManagement and stakeholders to co-design Enterprise Data Strategy and CommonData Model
Implementation and promotion of Data Platform,transformative data processes, and services
• Develop data pipelines and structures for Data Scientists,testing such to ensure that they are fit for use
* Maintain and model JSON based schemas and metadata. tore-use it across the organization (with central tools)
. Resolving and troubleshooting data related issues and queries
. Covering all processes from enterprise reporting to datascience (incl. ML Ops)
Experience
. Hands-on Big Data experience using common open- sourcecomponents (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka)
. Experience in stakeholder management in heterogeneousbusiness/technology organizations
. Experience in banking or financial business, with handlingsensitive data across regions
. Experience in large data migration projects with on-premData Lakes
. Hands-on experience in integrating Data Science Workbenchplatforms (e.g., Knime, Cloudera, Dataiku))
. Track record in Agile project management and methods(e.g., Scrum, SAFe).
Skills
* Knowledge of reference architectures, especiallyconcerning integrated, data-driven landscapes and solutions
* Expert SQL skills, preferably in mixed environments (i.e.classic DWH and distributed)
* Working automation and troubleshooting experience inPython using Jupyter Notebooks or common IDEs
* Data preparation for reporting/analytics and visualizationtools (e.g. Tableau, Power BI or Python based)
* Applying a data quality framework within the architecture
. Datasets and data pipelines preparation, support forBusiness, data troubleshooting.
. Closely collaborate with the Data & Analytics ProgramManagement and stakeholders to co-design Enterprise Data Strategy and CommonData Model
Implementation and promotion of Data Platform,transformative data processes, and services
• Develop data pipelines and structures for Data Scientists,testing such to ensure that they are fit for use
* Maintain and model JSON based schemas and metadata. tore-use it across the organization (with central tools)
. Resolving and troubleshooting data related issues and queries
. Covering all processes from enterprise reporting to datascience (incl. ML Ops)
Experience
. Hands-on Big Data experience using common open- sourcecomponents (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka)
. Experience in stakeholder management in heterogeneousbusiness/technology organizations
. Experience in banking or financial business, with handlingsensitive data across regions
. Experience in large data migration projects with on-premData Lakes
. Hands-on experience in integrating Data Science Workbenchplatforms (e.g., Knime, Cloudera, Dataiku))
. Track record in Agile project management and methods(e.g., Scrum, SAFe).
Skills
* Knowledge of reference architectures, especiallyconcerning integrated, data-driven landscapes and solutions
* Expert SQL skills, preferably in mixed environments (i.e.classic DWH and distributed)
* Working automation and troubleshooting experience inPython using Jupyter Notebooks or common IDEs
* Data preparation for reporting/analytics and visualizationtools (e.g. Tableau, Power BI or Python based)
* Applying a data quality framework within the architecture
JOB SUMMARY
Data Engineer
ITCAN PTE. LIMITED
Singapore
11 hours ago
N/A
Full-time
Data Engineer