About this role
- Architect, design, and drive implementation for next-generation GenAI-based Data-Platform-As-a-Service at Udemy.
- Lead data platform initiatives towards Udemy's comprehensive data quality and governance, data catalog and lineage, data privacy, data observability, monitoring and alerting, and disaster recovery
What you'll be doing
- Contribute to building, enhancing, and maintaining a robust, scalable, cost-optimized, secure, highly available, real-time framework for data ingestion, data transformation, data contracts, and AI / ML model execution using Databricks and AWS stack.
- Be a thought leader to contribute to building a 2-year technical vision for Udemy Data & AI Platform.
- Drive significant cross-functional initiatives with global teams to successful completion.
What you’ll have
- 15+ years of experience in building distributed systems using Java, Scala, and Python
- 10+ years of experience managing big data platforms using Kafka, Spark, AWS services (S3, EMR, RDS, Redshift, etc), Databricks, Snowflake, Airflow, Kubernetes, Docker
- Extensive experience in cloud data privacy tools in the area of authentication (AWS IAM / OKTA), encryption (AWS KMS / Safenet), authorization (Apache Ranger / Privacera)
- Extensive experience in DataOps, AI / MLOps, and exposure to LLMOps
We understand that not everyone will match each of the above qualifications. However, we also realize that everyone has unique experiences that can add value to our company.
Even if you think your background might not perfectly align, we'd love to hear from you!
Research Data Analyst 3
The responsibilities of the Research Data Anlyst 3 will include developing data collection instruments, collecting and organizing quantitative and qualitative data, training project staff to collect quantitative and qualitative data, and data management in Research Electronic Data Capture (REDCap) o...
Principal Software Engineer, Video Players
We are considering applicants for the location(s) of San Francisco, CA; Culver City, CA; or remote (US West Coast preferred). As a Principal Software Engineer on our video player team, you will lead the design, development, and optimization of our next-generation video player library. You will be an...
Senior Software Engineer, Map Data
We are seeking a Software Engineer to join our Map Data team, responsible for constructing and maintaining Lyftmap. We are looking for an engineer with proven expertise in system architecture, microservices, and big-data processing and experience in building scalable solutions in the cloud environme...
Staff Software Engineer, Data Platform
CHAOS has a mission-focused culture, dedicated to solving the toughest technical challenges. CHAOS is seeking a highly skilled and motivated Software Engineer to join our team supporting our product engineering. Build and maintain our data infrastructure, real-time data processing, data transportati...
Software Engineer, Data Enablement Platform
Build, improve and maintain Brex’s data platform and infrastructure: data warehouse & analytics (Snowflake), data streaming (Kafka), replication (CDC) and materialization (Flink), data jobs orchestration (Airflow), data observability, access & governance. The Engineering team includes Data, ...
Data Engineer
Dice is the leading career destination for tech experts at every stage of their careers. Design, model, and implement data warehousing activities to deliver the data foundation that drives impact through informed decision making. Individual pay is determined by skills, qualifications, experience, an...
Principal Data Scientist - Infrastructure Data Science
Work closely with internal teams such as Cloud FinOps, Capacity Planning, and Product Engineering to translate business needs into data-driven solutions that improve infrastructure scaling and operational performance. We are seeking an innovative and driven Data Scientist with a strong focus on AI-d...
ML Engineer || San Francisco, CA -Hybrid once a week onsite || W2 Only || 10+ Years Of Exp
Sound knowledge to understand Architectural Patterns, best practices and Non-Functional Requirements</li> <li>Overall, 8-10 years of experience in heavy volume data processing, data platform, data lake, big data, data warehouse, or equivalent. Role: ML Engineer</b></div> <...
Data Platform Engineer
As the Data Platform Engineer, you will be responsible for architecting their next-generation data processing applications and reporting systems. They are headquartered in San Francisco, but have offices in NYC and Cambridge, MA as well. They have some of the foundational elements in place for a mod...
Principal Data Scientist - Service Enablement Analytics
Foster a world-class Data Science culture by leading training on technical concepts, driving continuous learning and mentoring Data Scientists on the team. Atlassian is looking for a Principal Data Scientist to be the wizard who will uncover valuable insights from customer friction which will help t...