Data Engineer ( Visa Independent)
Role : Data Engineer
Location : Phoenix, AZ (Hybrid)
Job description :
- Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times.
- Design, build and test scalable data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested.
- Determine best way to extract application telemetry data, structure it, send to proper tool for reporting Kafka, Splunk .
- Create reports to monitor usage data for billing and SLA tracking.
- Work with business and cross functional teams to gather and document requirements to meet business needs.
- Provide support as required to ensure the availability and performance of ETL ELT jobs.
- Provide technical assistance and cross training to business and internal team members.
- Collaborate with business partners for continuous improvement opportunities.
Basic Qualifications :
- A minimum of 3 years working on a cloud data projects
- A minimum of 2 years hands on experience on GCP Cloud data implementation projects Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.
- A minimum of 3 years of experience with Python with working knowledge on Notebooks
- Must have experience working in an Onshore / Offshore model.
- High School Diploma or GED
Preferred Qualifications :
- A minimum of 8 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics.
- A minimum of 3 years of experience with one of the leading public clouds.
- A minimum of 2 years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading.
- Mandatory Experience 3 years of experience with Python with working knowledge on Notebooks.
- Scala experience
- A minimum of 2 years of experience in Data governance and Metadata Management.
- Ability to work independently, solve problems and update the stake holders.
- Analyze, design, develop and deploy solutions per business requirements.
- Strong understanding of relational and dimensional data modeling.
- Experience in DevOps and CI CD related technologies.
- Excellent written and verbal communication skills
Senior Cloud Security Engineer (Work From Home)
Work closely with Cloud Engineers and Site Reliability Engineers to implement and manage advanced security technologies and tools on public cloud platforms, such as identity and access management (IAM), encryption, key management, and network security controls. Security Engineer or Cloud Engineer, w...
ETL Report Developer - Remote
The Business Intelligence (BI) ETL Report Developer assists and supports the discovery, development, and publication of all Solari data, reports, and dashboards to create actionable business insight which help answer business questions, drive business decisions, and improve operations across the Sol...
Data Engineer - Data and Analytics
At Follett School Solutions, we're not just about data and code - we're about creativity, collaboration, and making a real impact.Join our team and take a deep dive into a world where your ideas are valued, your skills are honed, and your career takes flight.Ready to take your passion for data analy...
Sr DevOps Engineer - Yocto
A company is looking for a Sr DevOps Engineer - Yocto. ...
Python Developer [Job ID 20240712]
Phoenix Cyber is looking for security focused Python programmers to help develop custom plugins and 3rd party integrations for a commercial-off-the-shelf cybersecurity software product. Minimum 5 years of strong Python programming experience. Experience in authoring and developing Python librar...
Python and Kubernetes Software Engineer - Data, AI/ML & Analytics
Python and Kubernetes Specialist Engineers focused on Data, AI/ML and Analytics Solutions. As a software engineer on the team, you'll collaborate on an end-to-end data analytics and mlops solution composed of popular, open-source, machine learning tools, such as Kubeflow, MLFlow, DVC, and Feast....
Back-End C#, SQL Server Software Developer, Onsite Required in Phoenix, AZ
Keywords: Phoenix AZ Jobs, Back-End C#, SQL Server Software Developer, C#, SQL Server, API, React. Back-End C#, SQL Server Software Developer, Onsite Required in Phoenix, AZ. As the Back-End C#, SQL Server Software Developer on the team, you will be working on the design and development of API...
Cloud Engineer, Vice President - Tampa
Individuals in the Cloud Engineering job function (Technology Infrastructure job family) focus on cloud services, such as software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS), and implementing, maintaining, and supporting components defined by the infras...
ETL Developer (remote - local to Arizona)
Need to come from a developer background, NOT an analyst role. ...
Sr. Data Scientist (Computer Vision)
Data Scientist (Computer Vision). Collaborate with engineers and data analysts to understand AI/ML model requirements and data pipelines. Implement data cleaning and transformation techniques to ensure data quality and usability for AI/ML models. Develop and maintain data pipelines to automate data ...