0 suggestions are available, use up and down arrow to navigate them
Operations Engineer (C...

Create Job Alert.

Get similar jobs sent to your email

Apply to this job.
Think you're the perfect candidate?

Hadoop Operations Engineer


Key Responsibilities

  • As part of the security operation teams, operate, support and maintain a Hadoop Date Lake environment in a dedicated customer environment
  • Perform data engineering to extract, transform, load for data science analysis
  • Work with customer’s and internal data science team to design effective data models for optimal storage and retrieval
  • Ensure data segregation in accordance to role-base access control matrix
  • Maintain up-to-date technical documentation for deployed systems


  • At least 3 years of production experience working with Hadoop data engineering
  • Demonstrate production experience in data engineering, data management and/or cluster management
  • Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
  • Experience in implementing MapReduce, Spark jobs
  • Experience maintain and expanding multi-node Hadoop clusters
  • Experience in systems administration or DevOps experience with one or more open-source operating systems
  • Experience implementing operational best practices such as alerting, monitoring, and metadata management
  • Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
  • Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
  • Experience with Splunk Enterprise and Isilon storage is an added advantage
  • Good verbal and written communications


Recommended Skills

  • Access Controls
  • Apache Hadoop
  • Apache Hive
  • Apache Spark
  • Bash (Scripting Language)
  • Communication
Apply to this job.
Think you're the perfect candidate?

Help us improve Jobscentral by providing feedback about this job:

Job ID: 8_5162fa77bc124743d85d0c0442c0cc

Jobscentral TIP

For your privacy and protection, when applying to a job online, never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction. Learn more.

By applying to a job using Jobscentral you are agreeing to comply with and be subject to the Jobscentral Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.