Talent.com
serp_jobs.error_messages.no_longer_accepting
Lead Data Engineer (AWS, Azure, GCP) (Philadelphia)

Lead Data Engineer (AWS, Azure, GCP) (Philadelphia)

CapTech ConsultingPhiladelphia, PA, US
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.part_time
job_description.job_card.job_description

Lead Data Engineer (AWS, Azure, GCP)

CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client's cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You'll Do)

  • Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
  • Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
  • Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
  • Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
  • Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Qualifications

  • Experience building / operating highly available distributed systems of data extraction, ingestion, and processing large data sets
  • 5+ years of experience delivering data engineering solutions on cloud platform
  • 5+ years of experience implementing modern designs using at least one cloud-based solution / platform (AWS, Azure, GCP)
  • Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
  • Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
  • 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
  • Expertise with SQL, database design / structure and data structure (star, snowflake schemas, de / normalized designs)
  • 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
  • Familiarity with one or more DevOps tools (git, Jenkins, CI / CD, Jira)
  • Fundamental understanding of big data, open source, and data streaming concepts
  • Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
  • Experience providing technical leadership and mentoring other engineers in data engineering space
  • Cloud certification on any platform a plus
  • Additional Information

    We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions. You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way. Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we've launched extended benefits to help meet our employees' needs.

  • Learning & Development Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life's ups and downs
  • Carrot Fertility Inclusive fertility and family-forming coverage for all paths to parenthood including adoption, surrogacy, fertility treatments, pregnancy, and more and opportunities for employer-sponsored funds to help pay for care
  • Fringe A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
  • Philanthropic Partnerships Opportunities to engage in partnerships and pro-bono projects that support our communities.
  • 401(k) Matching Generous matching and no vesting period to help you continue to build financial wellness
  • CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness each foundational to our core values. We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our Diversity, Inclusion and Belonging efforts, click HERE. As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and / or to receive other benefits and privileges of employment, please contact Laura Massa directly via email lmassa@captechconsulting.com.

    At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

    serp_jobs.job_alerts.create_a_job

    Azure Data Engineer • Philadelphia, PA, US

    Job_description.internal_linking.related_jobs
    Lead Databricks Data Engineer

    Lead Databricks Data Engineer

    eTeam IncPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will lever...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    MSR Technology GroupConshohocken, PA, US
    serp_jobs.job_card.full_time +1
    Full-Time | Competitive Salary + Full Benefits | Room for Advancement.Hybrid (Philadelphia, PA or Dallas, TX).We’re hiring a Data Engineer to join our Strategic Analytics team—a collabo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Cloud Engineer (AWS)

    Cloud Engineer (AWS)

    CGSPhiladelphia, Pennsylvania, United States, 19102
    serp_jobs.job_card.full_time
    Employment Type : Full-Time, Experienced.Department : Information technology.We are seeking a Cloud Engineer (AWS) who will be responsible for supporting the development of all required documentation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Cloud Engineer

    Cloud Engineer

    MondoFort Washington, PA, US
    serp_jobs.job_card.temporary
    Apply now : Cloud Engineer, location is Hybrid (Fort Washington, PA).The start date is ASAP for this 6–12 months C2H position. Hybrid (3 days / week onsite in Fort Washington, PA).W2 ONLY (no c2c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr. Azure Engineer

    Sr. Azure Engineer

    WEIDENHAMMER SYSTEMS CORPORATIONBlue Bell, Pennsylvania, United States, 19422
    serp_jobs.job_card.full_time
    Azure Solutions Engineer is responsible for designing, creating, and supporting the Azure relationship used in our hosting services operation. The engineer will be focused on improving the stability...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Engineer - IRIS.TV

    Data Engineer - IRIS.TV

    ViantPhiladelphia, Pennsylvania, United States, 19102
    serp_jobs.job_card.full_time
    Viant is looking for a highly motivated Data Engineer,.Clojure to work closely with our engineering team.Our engineering team is headquartered in Los Angeles and geographically distributed around t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    AWS Cloud Engineer

    AWS Cloud Engineer

    eTeam IncPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Position based in either Philadelphia, PA, or Washington, DC.AWS Cloud Engineer to build and deploy highly scalable, reliable, and secure cloud environments for customers using innovative automatio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    CGSPhiladelphia, Pennsylvania, United States, 19102
    serp_jobs.job_card.full_time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Azure HPC Platform Engineer

    Azure HPC Platform Engineer

    Together We TalentCollegeville, PA, us
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Collegeville, PA (Onsite) | Contract | Mid–Senior Level.Design, deploy, and manage high-performance computing (HPC) environments on Microsoft Azure for enterprise-scale scientific and technical wor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    MO3-613-Senior Azure Cloud Engineer 11694-1

    MO3-613-Senior Azure Cloud Engineer 11694-1

    FHRTrenton, NJ, US
    serp_jobs.job_card.full_time
    Our direct client has an opening for.Senior Azure Cloud Engineer 11694-1.This position is up to 12 months, with the option of extension, in. Please send rates and a resume.DEA needs an Architect or ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    AWS Cloud Operations Lead / Manager

    AWS Cloud Operations Lead / Manager

    Innova SolutionsPhiladelphia,Pennsylvania,United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    A client of Innova Solutions is immediately hiring for a.AWS Cloud Operations Lead / Manager.Position Type : Contract-Full Time. Location : Philadelphia, PA 19103 (Hybrid – 3 Days in a Week).AWS Cloud O...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    Axalta Coating SystemsUSA, Pennsylvania, Philadelphia
    serp_jobs.job_card.full_time
    We are seeking an Azure Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and managing the infrastructure and tools that allow for efficient processing...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    AWS Cloud Developer

    AWS Cloud Developer

    Inherent TechnologiesWest Point, PA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Position : AWS Cloud Developer Location : West Point, PA • • •Day 1 Onsite • • • Duration : 1 Years serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.new
    Technical Lead - PostgreSQL

    Technical Lead - PostgreSQL

    smart folks incPennington, NJ, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title Technical Lead - PostgreSQL Location - : PENNINGTON , NJ (3 Day...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Two95 International Inc.Philadelphia, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Senior Azure Data Engineer.Location : Philadelphia, PA (Hybrid Work).Azure Data Engineering : Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, Dev...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Robert HalfWayne, PA, US
    serp_jobs.job_card.permanent
    We are looking for a skilled Data Engineer to join our team in Wayne, Pennsylvania.In this role, you will design, develop, and optimize data pipelines and platforms to support business operations a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Manager, Data and Analytics

    Manager, Data and Analytics

    Digitas HealthPhiladelphia, PA, US
    serp_jobs.job_card.temporary
    Digitas Health is the Agency of Now : the first global connected-health agency, purpose-built for marketing today.Digitas Health specializes in helping health brands navigate a complex and shifting ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer-1

    Data Engineer-1

    eTeam IncPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are seeking a skilled and experienced Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical team member, you will lever...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior AWS Cloud Architect

    Senior AWS Cloud Architect

    eTeam IncPhiladelphia, Pennsylvania, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Position based in either Philadelphia, PA, or Washington, DC.As a Senior AWS Cloud Architect you will be responsible for designing, building, and deploying highly scalable, reliable, and secure clo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Scientist / Data Engineer

    Data Scientist / Data Engineer

    Bristol-Myers SquibbPrinceton, NJ, United States
    serp_jobs.job_card.full_time
    Those aren't words that are usually associated with a job.But working at Bristol Myers Squibb is anything but usual.Here, uniquely interesting work happens every day, in every department.From optim...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours