Principal Big Data Engineer
LUMINARY SERVICE PTE. LTD.
Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data.
Ensure data quality, integrity, and consistency across various data sources.
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Integrate data from multiple sources, including databases, APIs, and third-party data providers.
Build and maintain big data infrastructure using technologies
Optimize data storage and retrieval processes to improve performance and reduce costs.
Proven experience as a Big Data Engineer or similar role.
Experience with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, etc
Proficiency in programming languages such as Python, Java, or Scala.
Strong knowledge of SQL and NoSQL databases.
Knowledge of machine learning and data analytics.
Ensure data quality, integrity, and consistency across various data sources.
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Integrate data from multiple sources, including databases, APIs, and third-party data providers.
Build and maintain big data infrastructure using technologies
Optimize data storage and retrieval processes to improve performance and reduce costs.
Proven experience as a Big Data Engineer or similar role.
Experience with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, etc
Proficiency in programming languages such as Python, Java, or Scala.
Strong knowledge of SQL and NoSQL databases.
Knowledge of machine learning and data analytics.
JOB SUMMARY
Principal Big Data Engineer
LUMINARY SERVICE PTE. LTD.
Singapore
a day ago
N/A
Full-time
Principal Big Data Engineer