Data Engineer
HORIZON SOFTWARE PTE. LTD.
3 days ago
Posted date3 days ago
N/A
Minimum levelN/A
Key Responsibilities
Data Pipeline & Architecture
Data Platforms & Cloud
Data Quality, Security & Governance
Collaboration & Stakeholder Engagement
Performance & Optimization
Required Skills & Qualifications
Technical Skills
Soft Skills
Preferred Qualifications
Data Pipeline & Architecture
- Design, build, and maintain robust, scalable, and reliable data pipelines for batch and real-time processing.
- Develop and optimize ETL/ELT workflows to ingest data from multiple structured and unstructured sources.
- Implement data models optimized for analytics, reporting, and downstream applications.
Data Platforms & Cloud
- Work with cloud data platforms (AWS / Azure / GCP) and services such as data lakes, data warehouses, and streaming systems.
- Manage and optimize data storage solutions (e.g., data warehouses, columnar databases).
- Ensure high availability, fault tolerance, and scalability of data systems.
Data Quality, Security & Governance
- Implement data quality checks, validation rules, and monitoring to ensure data accuracy and consistency.
- Enforce data governance, security, and compliance standards, including access control and encryption.
- Collaborate with security and compliance teams to meet regulatory requirements.
Collaboration & Stakeholder Engagement
- Work closely with Data Analysts, Data Scientists, Software Engineers, and Business Stakeholders to understand data requirements.
- Translate business needs into technical data solutions.
- Provide technical guidance and mentorship to junior data engineers.
Performance & Optimization
- Monitor, troubleshoot, and optimize data pipelines and queries for performance and cost efficiency.
- Conduct root-cause analysis and implement preventive measures for data pipeline failures.
Required Skills & Qualifications
Technical Skills
- 8+ years of hands-on experience in Data Engineering.
- Strong proficiency in SQL and at least one programming language such as Python, Scala, or Java.
- Experience with ETL/ELT tools and frameworks (e.g., Airflow, DBT, Informatica, Talend, Glue).
- Solid understanding of data warehousing concepts, dimensional modeling, and data lakes.
- Experience with big data technologies (e.g., Spark, Hadoop, Kafka).
- Hands-on experience with cloud platforms (AWS / Azure / GCP).
- Knowledge of CI/CD pipelines, version control (Git), and infrastructure-as-code is a plus.
Soft Skills
- Strong analytical and problem-solving skills.
- Ability to work independently and in cross-functional teams.
- Excellent communication and documentation skills.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field.
- Experience supporting analytics, BI, or machine learning workloads.
- Exposure to government, enterprise, or regulated-industry data environments is an advantage.
JOB SUMMARY
Data Engineer
HORIZON SOFTWARE PTE. LTD.
Singapore
3 days ago
N/A
Contract / Freelance / Self-employed
Data Engineer