Company Name: Zeta Global

Job Details: Easy Apply Hiring Remotely in United States Remote or Hybrid Senior level

Job Url: https://builtin.com/job/big-data-devops-lead/1772630

Job Description: Summary:As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.Main Responsibilities:• Driving improvement of the efficiency of Big Data infrastructure.Coordinating cross-team infrastructure and Big Data initiatives.Leading Big Data – related architecture and design efforts.Ensuring availability, efficiency, and reliability of the Big Data infrastructure.Building and supporting tools for operational tasks.• Evaluating, designing, deploying monitoring tools.Design and implementation of DR/BC practices and procedures.On-call support of production systems.Requirements:• 7+ years of experience working with Hadoop, preferably Open Source.3+ years of leading Big Data, DevOps, SRE, DBA, or development team.Experience setting up and running Hadoop clusters of 1000+ nodes.Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.Experience running and troubleshooting Kafka.Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.• Proficiency in shell scripting.Nice to have:• Experience with Prometheus.Experience managing Showflake.• Solid knowledge of Graphite and Grafana.Python or Perl scripting skills.Experience with installing and managing Aerospike.DBA experience with one of: PostgreSQL, MySQL, MariaDB.