Talent.com
Lead Data Engineer (AWS, Azure, GCP)

Lead Data Engineer (AWS, Azure, GCP)

CapTech ConsultingPhiladelphia, PA, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

Company Description

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

Job Description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You’ll Do)

  • Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
  • Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
  • Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
  • Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
  • Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Qualifications

  • Experience building / operating highly available distributed systems of data extraction, ingestion, and processing large data sets
  • 5+ years of experience delivering data engineering solutions on cloud platform
  • 5+ years of experience implementing modern designs using at least one cloud-based solution / platform (AWS, Azure, GCP)
  • Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
  • Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
  • 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
  • Expertise with SQL, database design / structure and data structure (star, snowflake schemas, de / normalized designs)
  • 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
  • Familiarity with one or more DevOps tools (git, Jenkins, CI / CD, Jira)
  • Fundamental understanding of big data, open source, and data streaming concepts
  • Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
  • Experience providing technical leadership and mentoring other engineers in data engineering space
  • Cloud certification on any platform a plus
  • Additional Information

    We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions.  You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.  Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs.

  • Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health –A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
  • Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care
  • Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
  • Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities.
  • 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness
  • CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness — each foundational to our core values.  We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our Diversity, Inclusion and Belonging efforts, click HERE.  As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and / or to receive other benefits and privileges of employment, please contact Laura Massa directly via email lmassa@captechconsulting.com.

    At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

    #LI-LM1

    serp_jobs.job_alerts.create_a_job

    Azure Data Engineer • Philadelphia, PA, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions. Key Responsibilities Maintain and operate legacy ETL processes a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Azure Cloud Engineer

    Senior Azure Cloud Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a Hybrid Cloud Engineer Senior.Key Responsibilities Design, implement, and maintain Azure infrastructure using Infrastructure as Code (IaC) Architect and configure virtu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    BI Lead Data Analytics Engineer

    BI Lead Data Analytics Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a BI Lead - Data Analytics Engineer.Key Responsibilities Architect and build a centralized data lake to unify various data types Develop pipelines for advanced multi-tou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Cloud Architect (AWS / Azure)

    Cloud Architect (AWS / Azure)

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Architect (AWS / Azure) to design and implement cloud solutions and provide migration strategies. Key Responsibilities Translate customer and business processes into...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Team Lead

    Data Team Lead

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Head of Data to lead its data team and manage data infrastructure.Key Responsibilities Lead a data team while contributing hands-on technical expertise Manage the enti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Azure IaaS Customer Engineer

    Azure IaaS Customer Engineer

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an Azure IaaS & Hybrid Infrastructure Customer Engineer.Key Responsibilities Deliver workshops and training on Azure IaaS migration, Arc management, and PowerShell automa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer Contractor

    Data Engineer Contractor

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (Python / Databricks) Contractor.Key Responsibilities Design, develop, and deploy enhancements to existing Python-based batch ETL scripts Utilize Databrick...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Java Big Data Engineer

    Java Big Data Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a Java / Big Data Engineer.Key Responsibilities Develop and manage API services on AWS using Java, Scala, or Kotlin Implement and optimize AWS services including Pyspark, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    DevSecOps Engineer (AWS)

    DevSecOps Engineer (AWS)

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a DevSecOps Engineer (AWS) to design and develop solutions for complex application and integration challenges in a cloud environment. Key Responsibilities Design and devel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingPhiladelphia, PA, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for an AWS Cloud Engineer.Key Responsibilities Innovate, develop, maintain, and optimize infrastructure within the AWS Cloud ecosystem Provision and manage infrastructure us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer.Key Responsibilities : Ensure accurate data flow from creation to presentation layers Enhance the Data Engineering stack through containerization, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Data Discovery Engineer

    Senior Data Discovery Engineer

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Engineer - Data Discovery.Key Responsibilities Design, architect, and deploy data discovery and inventory platform Administer tools and processes to implement P...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Analytics Engineer.Key Responsibilities Design and maintain data models and transformation logic for analytics and reporting Own the semantic layer, managing sh...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer (AI Platforms)

    Data Engineer (AI Platforms)

    VirtualVocationsHamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (AI Platforms) to contribute to building and optimizing data solutions for AI applications. Key Responsibilities Design, build, and optimize scalable data ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior AWS DevOps Engineer

    Senior AWS DevOps Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior AWS DevOps Engineer.Key Responsibilities Collaborate with development teams to design, implement, and optimize cloud solutions on AWS Automate infrastructure pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30