Data Engineer
HORIZON MANPOWER SERVICES PTE. LTD.
13 days ago
Posted date13 days ago
N/A
Minimum levelN/A
Key Responsibilities
Data Architecture & Pipeline Development
Data Platform & Infrastructure
Data Quality, Security & Governance
Collaboration & Stakeholder Support
Automation & Optimization
Required Skills & Qualifications
Education
Experience
Technical Skills
Data Architecture & Pipeline Development
- Design, develop, and maintain scalable, reliable, and high-performance data pipelines.
- Build and optimize ETL/ELT workflows to ingest data from structured and unstructured sources.
- Implement batch and real-time data processing solutions.
Data Platform & Infrastructure
- Develop and manage data warehouses, data lakes, and lakehouse architectures.
- Optimize data storage, partitioning, indexing, and query performance.
- Ensure high availability, fault tolerance, and scalability of data systems.
Data Quality, Security & Governance
- Implement data validation, monitoring, and reconciliation frameworks.
- Enforce data governance, security, and compliance standards.
- Manage access controls and data lineage documentation.
Collaboration & Stakeholder Support
- Work closely with Data Scientists, Data Analysts, BI teams, and Product teams.
- Translate business requirements into technical data solutions.
- Support analytics, reporting, and machine learning use cases with reliable datasets.
Automation & Optimization
- Automate data workflows using scheduling and orchestration tools.
- Continuously improve performance, cost efficiency, and system reliability.
- Identify and resolve data pipeline failures and bottlenecks proactively.
Required Skills & Qualifications
Education
- Bachelor's degree in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
Experience
- 6+ years of professional experience as a Data Engineer or in a similar role.
- Proven experience working with large-scale data systems and complex datasets.
Technical Skills
- Strong programming skills in Python, SQL, and at least one of Java / Scala.
- Expertise in relational and NoSQL databases.
- Hands-on experience with data warehousing and data lake solutions.
- Strong understanding of data modeling, schema design, and performance tuning.
- Experience with data orchestration and workflow scheduling tools.
- Knowledge of cloud platforms (AWS, Azure, or GCP) and cloud-native data services.
- Familiarity with CI/CD practices for data engineering
JOB SUMMARY
Data Engineer
HORIZON MANPOWER SERVICES PTE. LTD.
Singapore
13 days ago
N/A
Contract / Freelance / Self-employed
Data Engineer