Search jobs > Charlotte, NC > Data engineer

Data Engineer

Truist
Charlotte, NC
Full-time
Part-time

ESSENTIAL DUTIES AND RESPONSIBILITIES

Following is a summary of the essential functions for this job. Other duties may be performed, both major and minor, which are not mentioned below.

Specific activities may change from time to time.

  • Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
  • Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse.
  • Developing data models and maintaining data architecture to support data analytics and business intelligence reporting.
  • Ensuring data quality and consistency through data cleaning, transformation, and integration processes.
  • Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance.
  • Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions.
  • Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information.
  • Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
  • Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
  • Keeping abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities.
  • Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
  • Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging.

1. Works with teammates to solve problems and engineer innovative software solutions.

2. Supports systems integration testing (SIT) and user acceptance testing (UAT) for large, complex, cross-functional application initiatives by providing insight to testing teams in order to ensure the appropriate depth of test coverage.

3. Communicates changes in software architecture and resolves escalated issues.

4. Demonstrate an ability to learn and adopt relevant new technologies, tools, methods and processes to leverage in your solutions.

QUALIFICATIONS

Required Qualifications :

The requirements listed below are representative of the knowledge, skill and / or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

  • As an Azure Data Engineer, master data integration and ETL tools crucial for seamless data processing. Azure Data Factory stands at the forefront, orchestrating data workflows.
  • In-depth knowledge of Azure cloud data solutions, relational databases, ETL / ELT architecture and concepts, data integration concepts and big data concepts
  • Proficiency in languages like Python for data manipulation and SQL for database querying, enabling efficient data processing and analysis
  • A strong grasp of Microsoft Azure, covering a spectrum of services for seamless deployment, scaling, and management of data solutions, leveraging the power of the cloud
  • Participate in cross-functional teams to comprehend project requirements and translate them into technical solutions. Communicate complicated concepts, designs, and progress to both technical and non-technical stakeholders clearly and concisely.
  • Advanced working SQL knowledge and experience working with relational databases
  • Strong analytic skills related to working with unstructured datasets.

1. Bachelor's Degree in Computer Science, CIS, or related field

2. Three to five years of experience in software development or a related field

3. Three to five years of experience in database technologies

4. Three to five years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Preferred Qualifications : :

Any Microsoft Azure Certification

OTHER JOB REQUIREMENTS / WORKING CONDITIONS

SittingFrequently (

25% -

50% of the time)LiftingUp to

25 lbs.Visual / Audio / SpeakingAble to access and interpret client information received from the computer and able to hear and speak with individuals in person and on the phone.

Manual Dexterity / KeyboardingAble to work standard office equipment, including PC keyboard and mouse, copy / fax machines, and printers.

AvailabilityAble to work all hours scheduled, including overtime as directed by manager / supervisor and required by business need.TravelUp to

General Description of Available Benefits for Eligible Employees of Truist Financial Corporation : All regular teammates (not temporary or contingent workers) working 20 hours or more per week are eligible for benefits, though eligibility for specific benefits may be determined by the division of Truist offering the position.

Truist offers medical, dental, vision, life insurance, disability, accidental death and dismemberment, tax-preferred savings accounts, and a 401k plan to teammates.

Teammates also receive no less than 10 days of vacation (prorated based on date of hire and by full-time or part-time status) during their first year of employment, along with 10 sick days (also prorated), and paid holidays.

30+ days ago
Related jobs
Promoted
NTT DATA, Inc.
Charlotte, North Carolina

NTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications, headquartered in Texas. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technolo...

Promoted
LendingTree
Charlotte, North Carolina

Support project teams and business partners by creating and managing multiple database environments and cloud environments. Monitor and troubleshoot databases and tooling. Following SDLC for all database and code changes. Familiarity with various data technologies, including Kafka, Matillion, DBT. ...

Promoted
Intellisoft Technologies
Charlotte, North Carolina

As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. Proven experience (9+ years) in a data engineering role, wit...

Promoted
Wells Fargo
Charlotte, North Carolina

Create and support reusable frameworks, data warehouses and analytics environments for data engineering and leverage common design patterns across traditional and bigdata solutions. Contribute to the data integration work, including developing a data model, maintaining a data warehouse and analytics...

Promoted
Bank of America
Charlotte, North Carolina

Promote an inclusive and healthy working environment and help to resolve organizational impediments/blockersRequired Skills:Experience in landing zones, cloud-native security, monitoring and logging tools, and Well-Architected Data frame Framework principals (Data Mesh)Implementation expertise in Az...

IDEXX
Charlotte, North Carolina

You will design and implement scalable, reliable distributed data processing frameworks and analytical infrastructure using multiple technologies, including data sets or data warehouses, data virtualization and services, and repositories of semi-structured data sets. You will define, design, and imp...

WELLS FARGO BANK
Charlotte, North Carolina

Experience with enterprise data platforms such as Teradata, MapR and Hortonworks. This includes operations, control executives, strategic execution, business continuity and resiliency, data solutions and services, regulatory relations, customer experience, enterprise shared services, supply chain ma...

Strategic Staffing Solutions
Charlotte, North Carolina

Consult on or participate in moderately complex initiatives and deliverables within Database Engineering and contribute to large-scale planning related to Database Engineering deliverables. Data Analytics, databases, data related projects Yes-1-4 – 6 Years. Review and analyze moderately complex Data...

Capgemini
North Carolina, US

Collaborate with data scientists and analysts to understand data requirements and implement solutions Optimize data workflows for performance scalability and reliability. DBT Experience with DBT Data Build Tool for modeling data and creating data transformation pipelines is a plus. Title - Snowflake...

Red Hat, Inc.
Remote US NC
Remote

The Red Hat Ceph team is looking for experienced, enterprise-level engineers with a background in Ceph, OpenShift Data Foundations and/or software-defined storage (SDS) technologies to join us as a Senior Technical Support Engineer in North America. Technical Support Engineer(Ceph/OpenShift Data Fou...