Job Url: https://www.remoterocketship.com/company/zignallabs/jobs/senior-data-engineer-united-states-remote Job Description: Zignal Labs Website LinkedIn All Job Openings Zignal Labs is a technology company specializing in real-time intelligence solutions that help protect people, places, and operational positions. By leveraging advanced artificial intelligence and machine learning capabilities, Zignal Labs analyzes billions of publicly available data points in real time to provide actionable intelligence. The company's platform delivers high value alerting for mission-critical objectives, enabling enhanced situational awareness in various environments such as political, military, economic, and social. Zignal Labs is focused on mitigating physical and digital threats and defending operational priorities across key geographies and markets. 51 - 200 employees πŸ€– Artificial Intelligence πŸ” Security 🏒 Enterprise πŸ’° $15M Debt Financing on 2019-01 Senior Data Engineer June 21 πŸ‡ΊπŸ‡Έ United States – Remote πŸ’΅ $165k - $185k / year ⏰ Full Time 🟠 Senior 🚰 Data Engineer Apache AWS Cloud Distributed Systems EC2 ElasticSearch Java Kafka Microservices MongoDB NoSQL Python Redis Scala Spark Apply Now Receive Emails with Similar Jobs Report problem πŸ“‹ Description β€’ As a Senior Data Engineer at Zignal Labs, you’ll design and build a distributed data and analytics infrastructure using open-source technologies like Apache Spark, Apache Storm, and Elasticsearch. β€’ We process data from social media, news, blogs, and other media sources to empower users with real-time insights. 🎯 Requirements β€’ Proficiency in Scala, Java, and Python for backend development and data engineering β€’ Experience with Apache Spark (and Spark Streaming) and platforms like Databricks or Delta Lake β€’ Practical experience working with AWS services (e.g., Lambda, EC2, API Gateway) β€’ Experience with real-time data streaming frameworks like Apache Storm, Kafka, or Pekko β€’ Familiarity with search technologies such as Elasticsearch β€’ Experience with NoSQL databases (e.g., MongoDB, Redis), and relational databases (e.g., RDS) β€’ Exposure to workflow orchestration tools like Apache NiFi is a plus β€’ Experience with cloud-native deployments, CI/CD pipelines, and DevOps best practices β€’ Strong understanding of computer science fundamentals, such as algorithms, data structures, and system design β€’ Experience in database query optimization and performance tuning πŸ–οΈ Benefits β€’ Competitive salary based on the work you do β€’ Flexible time off – work with your manager to take the time you need β€’ Excellent medical, dental, and vision coverage β€’ Paid parental leave plan β€’ Professional development and growth programs β€’ A tight knit, collaborative, and transparent environment to help you succeed