Talent.com
Data Engineer

Data Engineer

ForhyreCarolina, NC, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

    • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
    • serp_jobs.job_alerts.create_a_job

    Data Engineer • Carolina, NC, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Argus Array Data Production Engineer

    Argus Array Data Production Engineer

    InsideHigherEdChapel Hill, North Carolina, United States
    serp_jobs.job_card.full_time +2
    Argus Array Data Production Engineer.A global higher education leader in innovative teaching, research and public service, the. University of North Carolina at Chapel Hill.Known for its beautiful ca...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    NA Digital & Data Analytics Manager

    NA Digital & Data Analytics Manager

    Syngenta Crop ProtectionGreensboro, NC, US
    serp_jobs.job_card.full_time
    As a world market leader in crop protection, we help farmers to counter these threats and ensure enough safe, nutritious, affordable food for all – while minimizing the use of land and other ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    AWS Data Architect

    AWS Data Architect

    Random BitNC, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    AWS Data Architect / Engineer Company Overview Random Bit is a system modernization partner that specializes in enterprise architecture, solution architecture, data architecture, cl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    Freelance GenAI Developer - Prompt Engineering & Data Workflows

    Freelance GenAI Developer - Prompt Engineering & Data Workflows

    MindriftNC, US
    serp_jobs.filters.remote
    serp_jobs.job_card.part_time
    serp_jobs.filters_job_card.quick_apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Mindrift is looking for passionate freelance contributors to join ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Strata Solar Services LLCDurham, NC, US
    serp_jobs.job_card.full_time
    Essential Duties and Responsibilities : .Design, build, and maintain scalable ETL / ELT pipelines to process large datasets efficiently. Leverage Python for scripting and orchestration tasks.Develop and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sales Engineer - NC

    Sales Engineer - NC

    Spirax SarcoUSA, North Carolina, Greensboro
    serp_jobs.job_card.full_time
    Here at Spirax Sarco we offer the industry's most extensive range of products with services, coupled with practical industry application expertise. In short, we build solutions that set the benchmar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel MRI Technologist

    Travel MRI Technologist

    LanceSoftEden, NC, US
    serp_jobs.job_card.permanent
    LanceSoft is seeking a travel MRI Technologist for a travel job in Eden, North Carolina.Job Description & Requirements.F3AF. Why LanceSoft? .We’re proud to be recognized by St...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Validation Engineer – Cleaning & Utilities

    Validation Engineer – Cleaning & Utilities

    Stark Pharma Solutions IncNC, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Position : Validation Engineer Cleaning & Utilities Location : North Carolinaserp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Freelance AI Red Team Engineer

    Freelance AI Red Team Engineer

    MindriftNC, US
    serp_jobs.filters.remote
    serp_jobs.job_card.part_time
    serp_jobs.filters_job_card.quick_apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Analyst

    Data Analyst

    OpenkyberNC, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Note : The job is a remote job and is open to candidates in USA.Morph Enterprise is focused on building energy efficiency and clean energy programs, and they are seeking an Energy Data Analyst to pe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    RN Leader Wanted : No Nights. No Weekends. Total Autonomy.

    RN Leader Wanted : No Nights. No Weekends. Total Autonomy.

    Southern Health PartnersProspect Hill, NC, US
    serp_jobs.job_card.full_time
    Take the Lead in Patient Care — FT RN Medical Team Administrator.Hour Day Shifts | 7 : 00 AM – 7 : 30 PM |.Leadership Role | Sign-On + Retention Bonuses | Low Burnout | Real Impact.Step Into a Role Whe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    Data Engineer

    Data Engineer

    Eagle Eye TechnologiesNC, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Role : Data Engineer serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.new
    Sr. Data Engineer

    Sr. Data Engineer

    Eagle Eye TechnologiesNC, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Engineer Location : Kansas City, Kansas <...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    BI Data Engineer

    BI Data Engineer

    CredibleDurham, NC, US
    serp_jobs.job_card.full_time
    We are a marketplace where users can compare personalized, prequalified rates and quotes from multiple lenders and carriers, for student loans, mortgages, personal loans, and insurance.We're ch...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer (Hybrid)

    Senior Data Engineer (Hybrid)

    Serigor Inc.Durham, NC, US
    serp_jobs.job_card.full_time
    The client is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer

    Data Engineer

    Tanu Infotech IncDurham, NC, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Role : Data Engineer Location : Durham NC(Hybrid) Mandatory : Experience in Clinical Data is a plus.Python, SQL, Snowflak...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Analytics Engineer

    Analytics Engineer

    OpenkyberNC, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Title : Application Programmer Location : Charlotte, NC Employment Type : Contract Compensation Pay Range : $45.Per Hr Description Seeking a skilled Embedded Analytics Developer.Integrate visualizations...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Data Developer

    AI Data Developer

    CREODurham, NC, US
    serp_jobs.job_card.full_time
    The Data Developer designs and constructs sophisticated data architectures to support advanced AI and analytics solutions, ensuring effective integration, storage, management, and utilization of st...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30