Job Title: Lead Data Engineer

Company Name: RE Partners

Job Details: $100k-$250k/yrRemoteFull,Time

Job Url: https://hiring.cafe/viewjob/31zbngy24t200wkd

Job Description: Posted 1w agoLead Data Engineer @ RE PartnersView All JobsWebsiteUnited States$100k-$250k/yrRemoteFull TimeResponsibilities:Designing, Building, CollaboratingRequirements Summary:Experience in data warehousing/engineering with Spark/Hadoop/Hive; programming in Python/Scala/Java; strong DB knowledge; built large-scale data products; solid system design and distributed computing (Hadoop, Spark); AWS infrastructure (EMR, S3, Lambda, Redshift); data quality and governance; collaborative and self-motivated.Technical Tools Mentioned:Spark, Hadoop, Hive, Python, Scala, Java, AWS EMR, S3, Lambda, Redshift
Lead Data Engineer What You’ll DoDesign and build Spark data ETL pipelines on AWS data platform. Collaborate with cross functional teams such as data scientists, fraud, marketing and other business stakeholders to understand their data needs and deliver reliable solutions.Optimize data infrastructure - Design and maintain robust data infrastructure by using modern data platform architecture. Ensure data quality and reliability. Innovate and follow best practices. Ensure operational excellence of the data platform, including monitoring, incident response, performance optimization, and continuous improvement.Who We’re Looking For (“Must Haves”)Professional experience working in data warehousing, data architecture, and/or data engineering environments, especially using spark, hadoop, hive etc with solid understanding of streaming pipelines.Proficiency in at least one high-level programming language (Scala, Java, Python or equivalent)Good understanding of databasesYou have built large-scale data products and understand the tradeoffs made when building these featuresYou have a deep understanding of system design, data structures, and algorithmsYou have an excellent knowledge of distributed computing frameworks such as Hadoop MapReduce, SparkYou have a strong knowledge of following AWS infrastructure - EMR, S3, Lambda, Redshift etcYou have strong understanding of data quality, governanceYou are a team player, self-driven, highly motivated individual who loves to learn new thingsJoin Our Global Team: We invite you to apply for the position at RE Partners. Join us in shaping the future of business technology consulting and transforming the way organizations thrive in a digital world.  As a diverse, woman-owned global business, we pride ourselves on keeping talent happy – our 7% attrition rate speaks volumes. Bring your talented friends along and earn a referral bonusEqual Opportunity Employer: We are an equal opportunity employer and welcome applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or veteran status.In accordance with the New York City Salary Transparency Law, the base salary range for this position is $100,000.00 – $250,000.00 annually. This range represents the good-faith minimum and maximum salary the Company believes it would pay for this role at the time of this posting.Actual compensation will be determined based on factors such as experience, skills, qualifications, geographic location, internal equity, and business needs. This position may also be eligible for additional compensation, including bonuses, commissions, and/or benefits, as applicable.