Data Engineer Tech Lead
TOSS-EX PR PTE. LTD.
Must Have Skills -
Good experience with ETL Frameworks
- Strong experience in Data Engineering
- Snowflake - Strong hands-on implementation experience in Snowflake
- Strong understanding of Snowflake Architecture - experience with designing and building solutions.
- Architecture, design aspects, performance tuning, time travel, warehouse concepts - scaling, clustering, micro-partitioning
- Experience with SnowSQL, Snowpipe
- Experience with Snowflake performance optimization techniques
- Advanced SQL - Hands-on experience with writing Complex queries using - Joins, Self Joins, Views, Materialized Views, Cursor also Recursive, use of GROUP BY, PARTITION BY functions / SQL Performance tuning
- Hands-on experience with ETL and Dimensional Data Modelling -
- Slowly Changing Dimensions (SCD - Type 1, 2, 3)
- Good understanding of concepts like schema types, table types - fact-dimension etc. like how to design a dimension vs fact, design considerations factored etc.
- Python - Proficiency in Python scripting/programming - using Pandas, PyParsing, Airflow.
- Pandas, Tableau server modules, Numpy, Datetime, Apache Airflow related modules, APIs
- Setting up Python scripts on DataLab, scheduling processes, connecting with DataLake (S3 etc )
- Data Pipeline automation
Good experience with ETL Frameworks
JOB SUMMARY
Data Engineer Tech Lead
TOSS-EX PR PTE. LTD.
Singapore
a day ago
N/A
Full-time
Data Engineer Tech Lead