Search jobs > Miami, FL > Lead data engineer

Lead Data Engineer

Miami Marlins
Miami, FL, United States
Full-time

We seek a Lead Data Engineer with a passion for baseball and technology to lead the development of timely and reliable data pipelines.

Your work will deliver the data that informs the decisions that build a sustainable winning team in Miami.

Key Responsibilities :

Serve as the tech lead for the Marlins’ Data Engineering team.

Lead the design, development, documentation, and maintenance of schemas and ETL pipelines for internal databases and data warehouses that scale and adapt to future use cases.

Break down complex data engineering projects into actionable work plans including proposed task assignments with clear design specifications.

Implement and test collection, mapping, and storage procedures for secure access to internal and external data sources.

Assess, provision, monitor, and maintain the appropriate infrastructure and tooling to automate and execute data engineering workflows.

Develop algorithms for quality assurance and imputation to prepare data for exploratory analysis and quantitative modeling.

Coordinate with data providers around planned changes to data feeds.

Research, design, test, and implement generalizable software architectures for data ingestion, processing, and integration and guide organizational adoption and strategies for infrastructure maintenance and data-related cost savings.

Define and encourage team-wide adoption of data engineering standards.

Effectively communicate complex technical concepts to both internal and external audiences.

Assist with recruiting and outreach for the engineering team, including building a diverse network of future candidates, and provide guidance and technical mentorship for junior engineers.

Fulfill other related duties and responsibilities, including rotating platform support.

Qualifications :

Significant experience in back-end software design and development.

Experience with ETL architecture and development in a cloud-based environment.

Fluency in SQL and an understanding of database and data warehousing technologies.

Proficiency with Python (preferred), Scala, and / or other data-oriented programming languages.

Experience with automated data quality validation across large data sets.

Familiarity working with virtual machines in a cloud environment.

Strong software engineering and problem-solving skills.

Expertise developing complex databases and data warehouses (e.g. BigQuery, RedShift, Snowflake) for large-scale, cloud-based analytics systems.

Experience with task orchestration and workflow automation tools such as Airflow.

Proficient in designing, deploying, and managing containerized applications with tools such as Docker and Kubernetes.

Ability to successfully coach junior engineers to grow in their own careers.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, age, disability, gender identity, marital or veteran status, or any other protected class.

30+ days ago
Related jobs
Miami Marlins
Miami, Florida

We seek a Lead Data Engineer with a passion for baseball and technology to lead the development of timely and reliable data pipelines. Serve as the tech lead for the Marlins’ Data Engineering team. Lead the design, development, documentation, and maintenance of schemas and ETL pipelines for internal...

Prudential Financial
FL, US

As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services. Experience in building scalable and stronger data pipelines to support data integra...

Royal Caribbean Group
Miami, Florida

Develops in depth knowledge of department data, processes, and jobs across databases. Bachelor’s degree from four-year college or university required (in Computer Science, Information Systems, Data Science, Data Analytics, or related field). Strong proficiency working with databases, on-premise/clou...

Danaher
Miami, Florida
Remote

Develop and maintain appropriate Information Security technical documentation as well as reviews and updates of existing policies and procedures, ensuring compliance with all audit requirements , change control procedures and data security. Experience in working with data classification and protecti...

Restaurant Brands International Inc
Miami, Florida

As a manager of the Data Engineering team, you will bring extensive experience to lead and mentor a team of junior data engineers. Team Leadership Lead and mentor a team of junior data engineers, providing guidance, support, and technical expertise. Data Engineering Strategy Contribute to the develo...

Promoted
Verizon
Miami, Florida

What You'll Be Doing:Data Science:. Analytics & Data Enablement:. Guide the build and enhancement of the Customer Data Platform with a 360-degree view of customer and prospect profiles, interactions & demographics. Advanced proficiency in SQL, Python (/R), and data visualization tools (Table...

Promoted
QTS Data Centers
Miami, Florida

The Machine Learning Engineer II will develop ML based software applications that drive operational outcomes for internal teams as well as customers. Additionally, this role will identify ML software issues and recognize/implement additional features for existing software and leverage experience wit...

Promoted
Digital Technologies, LLC
Miami, Florida

The main function of the Data Scientist is to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets. Experience manipulating large data sets in SQL or equivalent, and drawing actionable insights from data. This position will focus on marketplaces...

Promoted
Miami Marlins and loanDepot park
Miami, Florida

We seek a Machine Learning Engineer with a passion for baseball and technology to implement, automate, and optimize our data scientists’ quantitative models. Optimize, automate, and validate quantitative models built using statistics, machine learning, optimization, and simulation. Academic, industr...

Promoted
Citadel Enterprise Americas LLC
Miami, Florida

As a ML/Research Engineer at Citadel Securities, you will work closely with researchers to design and build the next generation library for deep learning within the firm. Experience building distributed deep learning libraries or scaling large distributed deep learning workflows using PyTorch (or si...