Talent.com
Data Engineer

Data Engineer

HonorVet TechnologiesAppleton, WI, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Title : Data Engineer

Location : Appleton, WI

Job Description

  • Must have : PySpark, Python Databricks

Job Description :

We are building out an Enterprise Data Platform (EDP) entirely on the cloud, utilizing Databricks on AWS. The project involves two teams focused on data ingestion, with a framework already established using Python and Spark for processing. The platform leverages DBT for data modeling. Our goal is to enhance data transformation capabilities while maintaining high standards for testing and data quality.

Key Responsibilities :

  • Lead Data Ingestion : Oversee and guide the data ingestion process, ensuring efficient and accurate data integration.
  • Mentorship : Mentor junior engineers, promoting engineering excellence and improving delivery processes.
  • Data Expertise : Utilize extensive knowledge of various data structures (Oracle, DB2, Mainframe, MongoDB, DynamoDB) to optimize data ingestion and transformation.
  • Data Profiling : Analyze structured, unstructured, and semi-structured data to determine the best methods for profiling and ingestion.
  • Ownership : Take full ownership of data sources and datasets, determining the best methods for ingestion and understanding the data thoroughly.
  • Collaboration : Work closely with staff engineers and other team members to schedule and conduct interviews, ensuring a collaborative and proactive work environment.

    • Required Skills and Experience :

  • Technical Proficiency : Strong experience with Databricks, AWS, Python, Spark, and DBT.
  • Cloud Migration : Proven track record in cloud migration projects, particularly moving on-premises systems to the cloud.
  • Data Modeling : Expertise in data modeling and transformation, with a focus on the Medallion architecture.
  • Leadership : Demonstrated ability to lead teams, mentor junior engineers, and drive engineering excellence.
  • Data Structures : In-depth knowledge of various data structures, including Oracle, DB2, Mainframe, MongoDB, and DynamoDB.
  • Data Profiling : Experience with profiling structured, unstructured, and semi-structured data to optimize ingestion processes.
  • Soft Skills : Accountable, collaborative, and proactive, with strong communication and interpersonal skills.

    • Interview Process :

  • Round 1 : Technical interview with staff engineers.
    • serp_jobs.job_alerts.create_a_job

    Data Engineer • Appleton, WI, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Staff / Lead Data Engineer

    Staff / Lead Data Engineer

    Manpower Group Inc.Appleton, WI, United States
    serp_jobs.job_card.full_time
    As Staff Engineer you will work independently and with your peers to translate customer needs into technical solutions.You will do this through leveraging internal resources as well as prior indust...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Shipping & Warehouse Area Manager

    Shipping & Warehouse Area Manager

    Forward March Inc.Chilton, WI, US
    serp_jobs.job_card.full_time
    Shipping / Receiving Area Manager.Responsible for facility inventory accuracy, maintaining RMA inbounds and the damage / hold area, organizing and conducting yearly physical inventory, and improving cu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Drive with Uber : Earn at least $1225 when you complete 109 trips, guaranteed

    Drive with Uber : Earn at least $1225 when you complete 109 trips, guaranteed

    UberGreen Valley, WI, United States
    serp_jobs.job_card.full_time +1
    Earn at least $1225 driving with Uber when you complete your first 109 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Sr Data Solutions Engineer

    Sr Data Solutions Engineer

    Nicolet National BankGreen Bay, WI, United States
    serp_jobs.job_card.full_time
    At Nicolet National Bank, our culture is based on the principles of community banking, putting the needs of our customers at the forefront of our decision-making. Our Core Values drive everything we...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff / Lead Data Engineer

    Staff / Lead Data Engineer

    ExperisAppleton, WI, United States
    serp_jobs.job_card.full_time
    As Staff Engineer you will work independently and with your peers to translate customer needs into technical solutions.You will do this through leveraging internal resources as well as prior indust...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Solution Engineer - IGEN

    Solution Engineer - IGEN

    U.S. VentureGrand Chute, WI, United States
    serp_jobs.job_card.permanent
    IGEN is seeking a Solution Engineer (SE) with a SaaS background.The Solutions Engineer is a client-focused technical professional helping clients connect significant business outcomes to the Comply...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Quick Earnings : Earn At Least $1225 For Your First 109 Trips, Guaranteed.

    Quick Earnings : Earn At Least $1225 For Your First 109 Trips, Guaranteed.

    UberPulaski, WI, United States
    serp_jobs.job_card.full_time +1
    Earn at least $1225 driving with Uber when you complete your first 109 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Pipe Design Engineer

    Senior Pipe Design Engineer

    Insight GlobalAbrams, WI, United States
    serp_jobs.job_card.full_time
    Insight Global is seeking a 3D Pipe Checker to join one of our clients in Marinette, WI.This is a 100% on-site role and relocation assistance is available. Work hours are Monday-Friday 7am-3pm.Desi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Supplier Data Quality Specialist

    Supplier Data Quality Specialist

    Treehouse FoodsGreen Bay Willowbrook, WI, United States of America
    serp_jobs.job_card.full_time
    Supplier Data Quality Specialist.TreeHouse Foods (NYSE : THS) is a leading manufacturer of private label packaged foods and beverages, operating a network of over 20 production facilities and severa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
    • serp_jobs.job_card.promoted
    Data Solutions Engineer

    Data Solutions Engineer

    Nicolet National BankGreen Bay, WI, United States
    serp_jobs.job_card.full_time
    At Nicolet National Bank, our culture is based on the principles of community banking, putting the needs of our customers at the forefront of our decision-making. Our Core Values drive everything we...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Analytics Consultant - Private Wealth

    Data Analytics Consultant - Private Wealth

    Associated Bank - CorpGreen Bay, WI, United States
    serp_jobs.job_card.full_time
    At Associated Bank we strive to create an inclusive culture where different perspectives are valued and recognized as strengths critical to our success. If you thrive in an environment where your gr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Earn At Least $1225 For Your First 109 Trips, Guaranteed.

    Earn At Least $1225 For Your First 109 Trips, Guaranteed.

    UberSeymour, WI, United States
    serp_jobs.job_card.full_time +1
    Earn at least $1225 driving with Uber when you complete your first 109 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Drive with Uber - Earn at least $1225 in your first 109 trips with Uber.

    Drive with Uber - Earn at least $1225 in your first 109 trips with Uber.

    UberSeymour, WI, United States
    serp_jobs.job_card.full_time +1
    Earn at least $1225 driving with Uber when you complete your first 109 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Trilliant Food & NutritionLittle Chute, WI, United States
    serp_jobs.job_card.full_time
    Trilliant Food & Nutrition is a leading, vertically integrated manufacturer of premium coffees and powdered beverages, proudly headquartered in Little Chute, Wisconsin. With a legacy rooted in quali...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Cloud Engineer (Breakthrough)

    Senior Cloud Engineer (Breakthrough)

    U.S. VentureGreen Bay, WI, United States
    serp_jobs.job_card.permanent
    At Breakthrough, we empower our clients with data, technology, and market knowledge to reduce costs, create efficient networks, and decarbonize transportation. As a strategic partner to our clients,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Remote Commercial Banking Analyst - AI Trainer

    Remote Commercial Banking Analyst - AI Trainer

    Data AnnotationOshkosh, Wisconsin
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel CT Tech - $2,184 to $2,363 per week in Shawano, WI

    Travel CT Tech - $2,184 to $2,363 per week in Shawano, WI

    AlliedTravelCareersShawano, WI, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Host Healthcare to find a qualified CT Tech in Shawano, Wisconsin, 54166!.Host Healthcare is an award-winning travel healthcare company with an immediate opening...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Flexible $ : Earn At Least $1225 For Your First 109 Trips, Guaranteed.

    Flexible $ : Earn At Least $1225 For Your First 109 Trips, Guaranteed.

    UberShawano, WI, United States
    serp_jobs.job_card.full_time +1
    Earn at least $1225 driving with Uber when you complete your first 109 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days