Data Engineer
Job Description
Job Description
Job Description
Data Engineer
Location : TX - Plano, 75075
Must be US citizen or Green Card Holder.
Responsibilities :
- Extensive experience in designing, configuring, deploying, managing and automating AWS Core Services like S3, IAM, EC2, Route53, SNS, SQS, ELB, CloudWatch, Lambda and VPC.
- Experience in automating cloud deployments using Terraform and Python
- Experience in DevOPS, administering the deployment, management, and monitoring of applications deployed on AWS via CI / CD.
- Maintaining the Jenkins pipeline and Perform code promotions through change management
- Experience in AWS data platform services like Redshift, DynamoDB, Databricks, Glue, MLops and Athena.
- Ensuring the compliance of the data science operations on AWS.
- Monitoring usage, cost, and implement optimizations of a variety of AWS resources.
- Provision DynamoDB tables with encryption and grant access using the IAM policies
- Deploy and manage AWS Serverless application running on API Gateway and LAMBDA
- Deploy Redshift Clusters into VPC with encryption, enable cross region snapshots, configure subnet groups and setup monitoring, and resize the cluster using elastic and classic methods
- Manage Denodo VDBs, address performance issues, support onboarding of new apps and datasets
- Manage Denodo stored procedures, healthchecks, HA setup, and address connectivity issues.
- Provide detailed capacity assessment on a regular basis for Denodo, Redshift, and Databricks.
Required Skills :
- AWS (experience mandatory) : S3, IAM, EC2, Route53, SNS, SQS, ELB, CloudWatch, Lambda and VPC
- Automation (experience mandatory) : Terraform and Python
- Bigdata (Experience with atleast 2) : Denodo, Redshift, DynamoDB, Databricks, Glue, and Athena.
- DevOPS (Mandatory) : GitHub Actions, Python / Shell scripting
Distinguished Data Engineer
Working with cutting-edge technologies: You'll leverage your expertise in big data technologies (like BigQuery, Dataflow, Teradata Utilities, Hadoop, Kafka, Pub-Sub, Graph DB, VectorDB), cloud platforms (like Google cloud platform and OCI), and data modeling techniques to deliver innovative AI & Dat...
Sr. AWS Data Engineer
As a AWS Data Engineer, you will be responsible for leading a team of data engineers in the development and maintenance of scalable data pipelines and implementing solutions in graph databases and machine learning. Proven experience in data engineering and leadership, with a strong portfolio of succ...
Staff Engineer - Business Data Solutions (Claims) (REMOTE)
Developing new and enhancing existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components. Data Engineering experience focused on batch and streaming data pipelines development, Data processing/data transformation using ETL or ELT tools. Experienc...
Software Development Engineer , Data, Analytics and Science (DAAS)
In this role, you will work in a multidisciplinary team of developers, scientists and data engineers and build solutions at the crossroads of engineering and science. You will be developing scalable solutions using data to solve critical data science problems in translation, intelligent routing, tex...
Senior Data Engineer
The Wounded Warrior Project (WWP) Senior Data Engineer is a member of the Web, Data, and Analytics team responsible for data engineering and programming to build systems that collect, manage, and convert raw data into usable information for business analysts. Build required infrastructure for optima...
Senior Data Solutions Consultant Engineer
Data Analytics engineering and solutioning experience – consulting with business stakeholders, leading technical initiatives, conducting requirements analysis with business stakeholders, and technical solutioning with large and diverse data sets in a high-performing, multi-functional team to design ...
Principal Controls Engineer, NA
We are seeking an experienced Principal Controls Engineer to lead the development and continuous improvement of our data center automation platforms. Champion data-driven optimization of data center performance and sustainability. Bachelor’s degree in Controls Engineering, Electrical Engineering, or...
AWS Data Engineer
Experienced in largescale application development testing Cloud On Prem Data warehouse Data Lake Data Science. Extensive Experience in Data migration is a must Teradata to Redshift preferred. Experience in Automating ETL process with Python and Automation around AWS Data Infrastructure. ETL Advanced...
Facilities Chief Engineer - Data Center
A Data Center Critical Environment is defined as a facility which is critical to a business’s operations where there could potentially, be an unacceptable and/or un-sustainable consequence to the stakeholder should a system or procedure fail. Experience working in Data Centers/ Raised Floor Environm...
Data Security Engineer, Cloud
Data Protection Solutions: Proficiency in designing data protection solutions, such as data security posture management (DSPM), data loss prevention (DLP) systems, encryption technologies, and data masking/anonymization techniques. We ask that you have expertise in data security, security engineerin...