About this role
- Architect, design, and drive implementation for next-generation GenAI-based Data-Platform-As-a-Service at Udemy.
- Lead data platform initiatives towards Udemy's comprehensive data quality and governance, data catalog and lineage, data privacy, data observability, monitoring and alerting, and disaster recovery
What you'll be doing
- Contribute to building, enhancing, and maintaining a robust, scalable, cost-optimized, secure, highly available, real-time framework for data ingestion, data transformation, data contracts, and AI / ML model execution using Databricks and AWS stack.
- Be a thought leader to contribute to building a 2-year technical vision for Udemy Data & AI Platform.
- Drive significant cross-functional initiatives with global teams to successful completion.
What you’ll have
- 15+ years of experience in building distributed systems using Java, Scala, and Python
- 10+ years of experience managing big data platforms using Kafka, Spark, AWS services (S3, EMR, RDS, Redshift, etc), Databricks, Snowflake, Airflow, Kubernetes, Docker
- Extensive experience in cloud data privacy tools in the area of authentication (AWS IAM / OKTA), encryption (AWS KMS / Safenet), authorization (Apache Ranger / Privacera)
- Extensive experience in DataOps, AI / MLOps, and exposure to LLMOps
We understand that not everyone will match each of the above qualifications. However, we also realize that everyone has unique experiences that can add value to our company.
Even if you think your background might not perfectly align, we'd love to hear from you!
Senior Software Engineer (Backend) - Data Services Platform
The Data Services Platform (DSP) team is building a common substrate for Cloudera's next-gen Data Services for GenAI Inferencing, Machine Learning, Data Engineering, Data Warehousing, Data Flow, Data Lake etc. These Cloudera Data Services, whether hosted by Cloudera or the customer, enable the lates...
Software Engineer (Data & AI)
Create informative visualizations and dashboards that effectively communicate data-driven insights to both technical and non-technical stakeholders. Work closely with software engineering, product, and research teams to integrate AI solutions into larger software systems and applications. Software E...
Staff Software Engineer (Data)
Staff Software Engineer (Data)Category Data, Analytics & StrategyLocation San Francisco, California, United States of AmericaJob ID R023150widget RegularCraft:Data, Analytics & StrategyJob Description:Your Role Within the Kingdom Embrace the pivotal role of a Staff Software Engineer within our Data ...
Senior or Staff Software Engineer, Data Platform
As a Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people. The Data Platform team coll...
Software Engineer, ML Data/Analytics, Data Governance
As we scale up with more researchers and engineers joining OpenAI, we seek a pragmatic and passionate engineer with a strong focus on the experience for both engineers and scientists that work in our large data sets. You will find yourself at home if you are comfortable with work such as scaling Kub...
Principal Data Scientist, WM4A (Work Management For All)
The Data Science team partners closely with Product Managers/Engineers/Researchers/Data Engineers/Marketers/Privacy and Executive teams across Atlassian to drive and influence. The team is responsible for using a variety of analysis and data-science techniques to understand how Atlassian’s customers...
Principal SAP Data Lead
Oversee data quality and cleanup processes, identifying and addressing data defects across master and transactional data objects and ensures data integrity. The actual salary paid to an individual will be based on multiple factors, including, but not limited to, specific skills, education, licenses ...
Senior Site Reliability Engineer - Data Infrastructure
Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data — globally, nearly instantly and less expensively than legacy settlement systems. Is this the next step in your career Find out if you are the right can...
Senior Data Warehouse Engineer
As a Senior Data Warehouse Engineer, you'll play a critical role in designing, building, and maintaining our data warehousing solutions. You'll work on challenging projects, from data modeling and ETL processes to performance optimization and data governance, to support the needs of our data-driven ...
Principal Embedded Software Engineer
As Principal Embedded Software Engineer, you will be a recognized expert in software development with broad expertise and experience in complete lifecycle management of embedded software designs, specifically in the areas of new software development, software maintenance, resolving significant techn...