Must be located in the SF Bay Area or your application will not be considered
Our client is a venture-backed SaaS startup that recently secured Series A funding. They're solving a multi-billion dollar problem of data quality for the entire marketing industry.
Their platform enables major brands and publishers to optimize consumer data quality, improving marketing ROI. In a fast-paced and collaborative environment, they are committed to excellence and innovation.
Key Responsibilities :
- Design and maintain scalable data pipelines using Spark and AWS EMR for processing terabytes of consumer data
- Write, test, and optimize custom Scala code for ETL workflows
- Deploy and manage ETL processes in AWS cloud environments using Airflow
- Automate delivery of structured data to enterprise clients via Snowflake and Databricks
- Collaborate with the Data Science team to optimize data infrastructure
- Contribute to data modeling efforts using SQL for efficient large-scale data management
- Create monitoring tools and KPIs using Tableau to ensure data pipeline health
- Maintain comprehensive documentation for internal teams and external clients
Tech Stack : AWS (EMR, EC2, S3, Athena, Sagemaker), Spark, DBT, Snowflake, Databricks, Airflow, Terraform, Github, Tableau
Programming Languages : Scala, Python, SQL, and Bash
Requirements
- 5-7 years of relevant work experience (3-5 years considered)
- Strong SQL and Scala skills
- Experience with cloud computing tools (e.g., Spark, AWS EMR, Snowflake, Databricks)
- Proficiency in data modeling and distributed data processing
- Excellent communication skills, including explaining complex concepts to non-technical stakeholders
An ideal candidate will :
- Thrives in a fast-paced startup, embracing high-impact responsibilities with minimal oversight
- Strong communicator, adept at explaining complex data concepts to diverse stakeholders
- Passionate about solving data quality challenges in marketing, with relevant industry experience
- Committed to long-term growth, excited by potential for ownership and future team leadership
Benefits
Compensation :
- Salary range : $160,000 - $180,000
- Stock options package
- Full health benefits and 401k
Work Environment :
- Hybrid model : 3 days in office, 2 days remote, on average
- Small, high-impact team with plans for growth
- Report directly to the Head of Data Science
Lead Software Engineer (Data)- GoLang- REMOTE
Our growing data teams are looking for a savvy Lead Data Engineer to join and help build and evolve the next generation of Audience & Identity data platform that handles data at scale and uses state-of-the-art technologies to unlock the datas business value. If youre excited to work with a tight...
Lead Data Engineer, Data and Systems
The ideal candidate will have deep expertise in data engineering, data technologies, and cloud platforms, with a strong understanding of how to align data engineering practices with business and AI/ML needs. We are seeking a Lead Data Engineer to join our team and drive the development and optimizat...
Lead Data Engineer (Machine Learning)
We’re looking for a Lead Data Engineer to help us design, build, and operate the data platform required to scale our business at the forefront of machine learning in healthcare. Collaborate closely with machine learning scientists, data scientists, product managers engineers, and commercial leaders ...
Lead Data Engineer
As the first Lead Data Engineer at Candid Health, you will report to the Head of Engineering and will help to build out a world-class Data Team. At Candid Health, we’re searching for our founding Lead Data Engineer to design, build, and support our next generation of data infrastructure. You will ar...
Lead Data Warehouse Engineer
As the Lead Data Warehouse Engineer, you'll be responsible for leading our data warehouse engineering efforts and driving the design, development, and maintenance of our data warehousing solutions. Lead a team of data warehouse engineers, providing guidance, mentorship, and technical leadership in d...
Lead Software Engineer Prog - Data Scientist
Lead Software Engineer Prog - Data Scientist -. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. Extracts a...
Lead Big Data Engineer
As the Lead Big Data Engineer, you'll be at the forefront of our big data engineering efforts, leading a team of talented engineers to design, build, and maintain our big data infrastructure and pipelines. Lead a team of big data engineers, providing guidance, mentorship, and technical leadership in...
Principal Engineer, Central Data Lake Lead
As a Lead for our Central Data Lake, you will:. Build and scale data infrastructure that powers batch and real-time data processing of billions of records daily. SQL/NoSQL databases, distributed file systems and data platform infrastructure. Autodesk's Platform Services and Emerging Technology (PSET...
Lead Real-Time Data Engineer
As the Lead Real-Time Data Engineer, you'll lead our initiatives in designing, building, and optimizing real-time data infrastructure. If you're a seasoned engineer with expertise in real-time data technologies and a proven track record of leadership in delivering successful projects, we invite you ...
Lead Engineer, Data Platform
Reporting to the Engineering Manager, Data Platform, you will work closely with other team members like data architects and business analysts to understand what the business is trying to achieve, move data from source to target, and design optimal data models. Design and build frameworks for various...