Senior Developer (Big Data)

Marina Bay Sands Pte Ltd| Date Posted: 8-Jun-2019
Save Job
Qualification:
'N' Levels / 'O' Levels, ITE/ NITEC/ Higher NITEC, 'A' Levels, Diploma, Bachelor's / Honours, Masters / PhD

Job Description

JOB SCOPE

  • Develop, test and implement data flow, integration pipelines on Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
  • Support Existing applications, data pipelines on the big data platform
  • Analyze and investigate data to ensure quality, identify issues
  • Performance Tuning Big Data Pipelines
  • Develop and maintain documentation for relevant applications
  • Perform technical reviews for other team members
  • Work collaboratively with business analysts, project managers and architects
  • Work collaboratively with Infrastructure, Network, Compliance and Operations teams

JOB REQUIREMENTS

  • Hands-on IT professional with around 6 to 8 years of Software Development experience
  • Expertise in Hadoop, Preferably Cloudera
  • Expertise in programming using Spark, Flume, Kafka, Hive, Impala, Python Unix Scripts
  • Cloudera management experience using Cloudera Manager, Sentry and Navigator
  • Experience in SQL programming
  • A very good understanding of data warehouse concepts
  • Preferable, experience in SSIS and Hadoop Administration basics
  • Good written and oral communication skills.