Search jobs > San Rafael, CA > Ai ml engineer

Senior Data Engineer AI&ML

Karkidi
San Rafael, California, US
Full-time

We are looking for an experienced Senior Data Engineer to join our growing Global Delivery Team within the Enterprise Customer Success Organization.

You will improve our data and data pipeline architecture and optimize data flow and collection for the associated teams.

You are an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

The Data Engineer will support software developers, data analysts, and data scientists on data projects and will ensure data delivery architecture is consistent throughout ongoing projects.

Apply below after reading through all the details and supporting information regarding this job opportunity.

You will report to Senior Manager.

We support a hybrid working schedule.

Responsibilities

  • Create data pipeline architecture
  • Assemble complex data sets that meet functional / non-functional requirements
  • Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
  • Build the infrastructure required for extraction, transformation, and loading of data from several data sources using SQL and AWS 'big data' technologies
  • Build analytics tools that use the data pipeline to provide applicable insights into employee experience, operational efficiency, and other main performance metrics
  • Work with team members to assist with data-related technical issues and support associated data infrastructure needs
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Keep up to date with the latest and greatest in feature sets and capabilities from public cloud providers (such as AWS and Azure) and find ways to apply them back to help their team
  • Work with data scientists and analysts to work toward greater functionality in our data systems

Minimum Qualifications

  • 5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
  • Experience with scripting languages such as Python and Scala
  • Experience with big data tools such as PySpark
  • Experience with relational SQL databases
  • Experience with AWS cloud services used often for data engineering including S3, EC2, Glue, Lambda, RDS, or Redshift
  • Experience working with APIs to pull and push data
  • Advanced working SQL experience with relational databases and query authoring (SQL)
  • Experience optimizing 'big data' data pipelines, architectures, and data sets
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

Preferred Qualifications

  • Experience working with AWS CloudFormation templates
  • Experience working with NoSQL databases, including Postgres and AWS DynamoDB
  • Familiarity with Agile and SCRUM methodologies
  • Experience working with PowerBI to develop dashboards
  • Analytical skills related to working with unstructured datasets
  • Successful history of processing value from large, disconnected datasets
  • Experience working with agile, globally distributed teams

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies.

We help innovators turn their ideas into reality, transforming not only how things are made but what can be made.

We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all.

Ready to shape the world and your future? Join us!

Salary Transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location.

In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

Diversity & Belonging

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here : Diversity and Belonging.

J-18808-Ljbffr

8 days ago
Related jobs
Promoted
VirtualVocations
Oakland, California

A company is looking for a Senior Data Engineer to develop scalable data pipelines and solutions. AWS, Azure, Google Cloud Platform)Solid understanding of SQL/NoSQL databases and ETL processesAbility to obtain a U. ...

Promoted
AI Engineer
CA, United States

LLC is the driving force behind the AI Engineer Summit and the AI Engineer World’s Fair, premier global events that shape the future of AI Engineering. Lead the strategy, planning, and execution of large-scale, global events, including AI Engineer Summit, AI Engineer World’s Fair, and AI Engineer Eu...

Promoted
Unreal Gigs
San Francisco, California

As a Senior Full-Stack Engineer, you'll be integral to our team, responsible for developing the infrastructure that supports our groundbreaking AI initiatives. Architect, build, and maintain scalable multi-tiered systems to handle complex data workflows and integration pipelines. Our mission is to d...

Promoted
Zendar
Berkeley, California

Zendar has pioneered software-defined radar technology which fuses data streams from multiple sensors to build a more accurate scene and utilizes artificial intelligence models that interpret RF spectrum to understand the environment. Zendar is headquartered in Berkeley, CA and has additional engine...

Promoted
OneSchema AI Inc.
San Francisco, California

We’re looking for a full-time Senior Software Engineer. At every company, there's someone whose most painful job is wrangling CSV files in Excel. Our product is an embeddable spreadsheet that makes data cleansing and import as simple as a few clicks. We see an incredible opportunity to be the de-fac...

Promoted
Scale AI, Inc.
San Francisco, California

For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. Our Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF (Rei...

Promoted
Uiflow
San Francisco, California

Senior Software Engineer - AI Features. As a Full Stack Engineer with a focus on AI features, you will play a pivotal role in expanding our platform's capabilities by integrating cutting-edge AI technologies. Prior experience working with AI technologies, ideally having built AI-powered features bey...

Promoted
Tatari
San Francisco, California

Data Pipeline Development: Developing and maintaining robust and efficient data pipelines to ingest, transform, and deliver data from various sources to data storage and analytical systems. Data Modeling and Architecture: Designing and implementing data models and database schemas that support effic...

Databricks
San Francisco, California

As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...

Hireio, Inc.
San Francisco, California

The Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have t...