Talent.com
Data Engineer

Data Engineer

ForhyrePhoenix, AZ, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.
  • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • Phoenix, AZ, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer, DEVX.Key Responsibilities Integrate diverse data sources and vendor products for analytical and operational use Automate ETL deployment tasks to enhance...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer with GCP Certification

    Data Engineer with GCP Certification

    VirtualVocationsGilbert, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (Gen AI).Key Responsibilities Install and test Looker and Looker Studio extensions or API plugins Identify and deprecate unused Looker dashboards Enhanc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Engineer

    AI Engineer

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Engineer, Principal.Key Responsibilities Collaborate with data scientists and ML engineers to containerize, deploy, and monitor AI / ML models Design, build, and man...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocationsPhoenix, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions. Key Responsibilities Maintain and operate legacy ETL processes a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer.Key Responsibilities : Ensure accurate data flow from creation to presentation layers Enhance the Data Engineering stack through containerization, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    ETL Implementation Engineer

    ETL Implementation Engineer

    VirtualVocationsGilbert, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for an ETL Implementation Engineer to develop and maintain ETL pipelines and ensure data quality within financial services. Key Responsibilities Design, build, and maintain ro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    TradingHub Engineer

    TradingHub Engineer

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.temporary
    A company is looking for a TradingHub Engineer for a fully remote, 8-month contract position.Key Responsibilities Design, develop, and optimize database systems for data storage, retrieval, and a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Data Discovery Engineer

    Senior Data Discovery Engineer

    VirtualVocationsGilbert, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Engineer - Data Discovery.Key Responsibilities Design, architect, and deploy data discovery and inventory platform Administer tools and processes to implement P...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer IV

    Data Engineer IV

    VirtualVocationsPhoenix, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer IV to develop and optimize data platforms.Key Responsibilities Develop and build interconnected data capabilities and products within the Data Fabric fram...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer Contractor

    Data Engineer Contractor

    VirtualVocationsScottsdale, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (Python / Databricks) Contractor.Key Responsibilities Design, develop, and deploy enhancements to existing Python-based batch ETL scripts Utilize Databrick...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Java Big Data Engineer

    Java Big Data Engineer

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Java / Big Data Engineer.Key Responsibilities Develop and manage API services on AWS using Java, Scala, or Kotlin Implement and optimize AWS services including Pyspark, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    BI Lead Data Analytics Engineer

    BI Lead Data Analytics Engineer

    VirtualVocationsGlendale, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a BI Lead - Data Analytics Engineer.Key Responsibilities Architect and build a centralized data lake to unify various data types Develop pipelines for advanced multi-tou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Analytics Engineer

    Analytics Engineer

    VirtualVocationsGlendale, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for an Analytics Engineer to design and maintain product data pipelines.Key Responsibilities Design, build, and optimize scalable data models using SQL, dbt, and cloud-based ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Warehouse Engineer

    Data Warehouse Engineer

    VirtualVocationsGilbert, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Warehouse Engineer I.Key Responsibilities Perform end-to-end delivery of data interfaces for the Enterprise Data Warehouse Conduct all phases of the development l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsGilbert, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocationsMesa, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Data Engineer to design and maintain data systems that drive analytics and product innovation. Key Responsibilities Lead the design, development, and maintenance o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer with Top Secret Clearance

    Data Engineer with Top Secret Clearance

    VirtualVocationsGlendale, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer to design, develop, and maintain secure data pipelines and analytics infrastructure. Key Responsibilities Design, implement, and maintain data pipelines an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsGlendale, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer (AI Platforms)

    Data Engineer (AI Platforms)

    VirtualVocationsTempe, Arizona, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (AI Platforms) to contribute to building and optimizing data solutions for AI applications. Key Responsibilities Design, build, and optimize scalable data ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30