Lead Data Engineer Level 3

Job Description

Insight Global is looking for a Lead Data Engineer to support one of our largest clients in the retail industry. They will be responsible for designing and modeling data engineering pipelines that support enterprise reporting analytic needs.

They will engineer efficient, adaptable, scalable data pipelines for moving data from different sources into their Cloud Lakehouse.

They will understand and analyze business requirements and translate into well architected solutions that demonstrate the modern BI & Analytics platform.

In addition, they will be a part of data modernization projects providing direction on matters of overall design and technical direction, acts as the primary driver toward establishing guidelines and approaches.

Other responsibilities include driving timely and proactive issue identification, escalation, and resolutions, and collaborating effectively within Data Tech teams, BI teams to design and build optimized data flows from source to Data visualization.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.

We are an equal opportunity / affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and / or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy : .

Required Skills & Experience

• 12 + years in-depth, data engineering experience and execution of data pipelines, data ops, scripting, and SQL queries
• Strong Soft Skills Leading Teams, driving initiatives, and great communication.
• 5+ years proven data modeling skills - must have demonstrable experience designing models for data warehousing and modern analytics use-cases (, from operational data store to semantic models)
• Expert in Python for data analytics, visualization, machine learning, and models
• 2-3 years' experience in modern data architecture that supports advanced analytics including Snowflake, Azure, etc. Experience with Snowflake and other Cloud Data Warehousing / Data Lake preferred.
• Expert in engineering data pipelines using various data technologies ETL / ELT, big data technologies (Hive, Spark) on large-scale data sets demonstrated through years of experience.
• Hands on data warehouse design, development, and data modeling best practices for modern data architectures
• Highly skilled in data orchestration with experience in tools like Ctrl-M, Apache Airflow.
• Hands on DevOps / Data Ops experience required CI / CD, Terraform

Nice to Have Skills & Experience

• Knowledge / working experience in reporting tools such as MicroStrategy, Power BI
• Experience with Streamsets, DBT preferred
• Retail Domain experience

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.

Employees in this role are also entitled to paid sick leave and / or other paid time off as provided by applicable law.