Principal Data Engineer
Primary Location(s) : San Jose, CA or Boston, MA
Secondary Locations(s) : Dallas, TX or Austin, TX
Responsibilities
As a Principal Data Engineer, you be responsible for the design and development of data pipelines, automation, and visualization tools to enable modern AI and analytics solutions.
Guide the expansion of our data products and solutions by advising and influencing business leaders and senior stakeholders with data-driven insights.
Partner with the data platform and infrastructure teams to architect and connect high quality, resilient data feeds from across the enterprise.
Work with AI / ML and software engineers to train and tune AI models and enable fast experimentation and deployment with large datasets.
Lead the execution of large scale, complex data and analytics efforts, as well as mentor complex projects using a wide breadth of data science and analytical techniques.
Develop in-depth subject matter-expertise in understanding key strategic data sources and data lineage within the organization.
Scope key business challenges, identify the right data and provide direction to data analysts, data analytics product managers, data scientists, data engineers and business stakeholders.
Communicate the value of data clearly by articulating both the high-level concept and detailed user stories for feature enhancements and convince teams to adopt data-driven improvements.
Drive innovation by creating new frameworks, standards, prototypes, and automation projects in relevant areas.
Qualifications
10+ years of experience in software engineering, including 7+ years working with data engineering technologies.
5+ years leading technical teams and managing complex data engineering projects and pipelines.
Degree in Computer Science, Electrical Engineering, Computer Engineering, or a related field.
Broad expertise and experience with distributed systems, streaming systems, and data engineering tools, such as Kubernetes, Kafka, Airflow, Dagster, etc.
Deep knowledge of Python, SQL, database design, and master data strategies.
Experience defining, architecting, and rolling out data products, including ownership of data products through their entire lifecycle.
Experience mentoring and leading junior technical staff, incorporating modern software development tools and practices.
A confident peer influencer with strong communication skills who quickly establishes credibility and is capable of leading cross-functional technical teams
Job Req Type : ExperiencedRequired Travel : NoShift Type : 1st Shift / Days
Principal Software Engineer, Data Platform - Remote
Query Manager is a part of Clari's Data Platform team, and is the interface that allows application and API developers to easily and efficiently retrieve data across hundreds of databases and billions of rows of data that comprise our ever-evolving Data Platform. Learn and contribute to all aspects ...
Principal Data Engineer
As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. Strong proficiency in data engineering technologies, such as ETL frameworks, big data processing, and ...
Principal Data Engineer
A company is looking for a Principal Data & Integration Engineer for a fully remote position. ...
Principal Data Engineer
As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable efficient data processing, storage, and retrieval. Strong proficiency in data engineering technologies, such as ETL frameworks, big data processing, and ...
Principal, Data Ops Engineer
Work closely with architects, developers, data science and data engineers to gather system requirements. Experience with Google DataProc, DataFlow, DataPrep, BigQuery. Create scripts, templates and orchestration for automatic provisioning and monitoring of GCP Cloud resources, supporting Corelogic S...
Principal Data Engineer
Scope key business challenges, identify the right data and provide direction to data analysts, data analytics product managers, data scientists, data engineers and business stakeholders. As a Principal Data Engineer, you be responsible for the design and development of data pipelines, automation, an...
Principal Software Engineer – Data Platforms
Position Summary* Principal Software Engineer – Data Platforms (Data, PubTech Data, Insights & Analytics) In this role, you will lead the architecture and development of data infrastructure and services. Data Architecture: Design and develop large-scale data systems, including databases, data wa...
Principal Cogito Data Engineer
The Principal Data Engineer in the area of Data Analytics & Delivery is a pivotal role in the Enterprise Data Engineering & Analytics Department in operationalizing critical data and analytics for MD Anderson's digital business initiatives. The Principal Data Engineer partners with other Enterprise ...
Principal Associate, Data Loss Prevention (DLP) Engineer
Center 3 (19075), United States of America, McLean, VirginiaPrincipal Associate, Data Loss Prevention (DLP) Engineer. Capital One is hiring a technical Cyber Security professional to join the Data Loss Prevention (DLP) team and work with the line of business stakeholders building DLP system policies...
Principal Data Engineer, CarOffer
Your leadership will be instrumental in shaping the future of our data engineering department, setting strategic direction, and mentoring a team of talented engineers to achieve excellence. Define and enforce best practices and standards for data engineering, ensuring the reliability, scalability, a...