Job Title: Sr. Data Engineer

Company Name: BenGen

Job Url: https://bengen.bamboohr.com/careers/43

Job Description: Have you worked with Terabytes of consumer level data and are fascinated by the insights you can create by structuring and optimizing the data?  Then perhaps this role is just what you have been looking for.  



Do you know how distributed databases work?  Have you spent the last several years using tools like Databricks, Athena, Redshift, Spark, or techniques similar to Map Reduce?  Do you know what a columnar store is and why that matters?  Have you saved a company thousands of dollars just by looking at how files are stored?  Do you know how to efficiently determine unique counts in ways a typical engineer does not?



As a Sr. Data Engineer at BenGen, you will work with the team responsible for creating and maintaining our data architecture. You will have the opportunity to work on exciting projects that drive our company forward while using cutting-edge technology. 



We are a small, friendly, tight-knit team within a much larger organization whose purpose is to gather, organize, and produce value for the organization from a treasure trove of data from a variety of other departments across the organization.



Responsibilities

Contribute to data ingestion and pipelines to form a large data lake and leverage that data to produce value in our data warehouse
Develop a deep understanding of the value of consumer data and how it can be used to form a profile that can be segmented to optimize marketing campaigns
Optimize the companies data assets to answer a variety of questions from the business
Understand data systems and when and where various data components should live for optimal performance of queries to the system (RDBMS vs Compute/Storage Query Engines vs Flat Files, etc)
Understand how best to store and organize data to balance cost/value
Requirements

Understanding of multi-channel marketing essential (Email Deliverability, Open tracking, Click tracking, online tracking, google ads audiences, facebook ads audiences, display ad networks, SMS messaging)
Understanding of techniques to limit data exposure (MD5, SHA256 and their limitations)
5+ years of experience in high scale data engineering.
Strong SQL skills
Deep knowledge of Spark and Python
ML library knowledge a plus
Comfort in AWS and other cloud platforms (IAM, EC2, S3)
Understanding of data warehousing and familiarity with data modeling concepts.
Familiarity with ETL jobs, observability, and monitoring systems
Experience implementing and optimizing data pipelines.
Strong attention to detail and problem-solving skills.
Experience in digital marketing and advertising industries is essential