HYBRID* Sr Data Engineer- Big Data / Python / Databricks
Direct Hire 1099 or W2 only.
The client is not offering subcontracting for this position.
This role is onsite in Irving, TX. Hybrid schedule, 2 days a week required onsite.
10824 -HOLD
We are hiring highly enthusiastic Python / Databricks engineers to create, tune, maintain and build reporting for the Big Data platforms that drive their retail business.
This role is key to the Company's continued market dominance, and requires people that are passionate about data and seeking perfection in their development.
KEY DUTIES AND RESPONSIBILITIES :
- Performing systems integration design and development in cloud architecture design (Azure)
- Building sizing and cost models for Cloud Services (Azure)
- Review enhancement requests and recommend best solution to stakeholders as SME.
- Containerizing ingestion processes using Docker and Kubernetes services.
- Understand business requirements to design , build, develop and test data integration pipelines.
- Plan, direct DevOps implementation and system hardware / software updates for better performance, stability.
- Work on the BI dashboards to support retail stores and the Azure AI platform that runs the personalized consumer experiences used by millions each day.
EDUCATION AND EXPERIENCE
EDUCATION : Bachelors / 4 Yr Degree
YEARS OF RELEVANT WORK EXPERIENCE : 7+Years
SPECIFIC KNOWLEDGE AND SKILLS
- 5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix.
- 2+ years experience with Apache Spark and Databricks cloud tool sets (AWS or Azure).
- 1+ years experience with GCP / Azure Cloud Big Data tools (PowerBI / DataLake / Azure Databricks).
- Self-motivated with excellent analytical, problem solving, verbal and communication skills.
- Proficiency in API security frameworks, token management and UAC including OAuth, JWT, etc.
- Basic knowledge of using Devops, Github, JIRA tools and ability to work in agile environment.
- Bachelors degree - Computer Science or equivalent.
- Open Source Development experience is a bonus
Senior Lead Data Engineer -Java/Python/AWS
As a Senior Lead Data Engineer - Java/Python/AWS at JPMorgan Chase within the Consumer and Community Banking, Data Technology team, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics in a secure, stable, and scalable wa...
Sr Data Scientist (With Big Query, Google SQL)
Job Title: Sr Data Scientist (With Big Query, Google SQL). Big Query Data Transfer Service, Partitioning of tables and export data. Senior data analytics resource with strong experience in Big Query. Performance tuning of existing queries, mapping external data sources. ...
Data Engineer
Experience driving end to end ETL data pipelines, from ingestion of data to consumption by business intelligence, analytics and other data consumer teams. Big data pipeline engineering and optimization. Participate in the overall strategic direction of the data engineering technology stack. Stay abr...
Lead Data Integration Engineer
Data warehouse ETL Data Engineer - Snowflake and Python:. Looking for a strong data engineer with hands-on experience in developing large scale Data engineering pipelines for financial services and preferably for risk management. Minimum 4 years of experience in developing complex data pipelines loa...
Cloud Data Engineer
Interdisciplinary Collaboration: Work in close partnership with solution architects, senior data engineers, data analysts, and cloud engineering teams to align solutions with the overarching architectural vision and business objectives. Data Pipeline Construction: Skills in building and maintaining ...
Senior Data Engineer
The Intersect Group is seeking an experienced Data Engineer for our direct banking client, where you will handle the development of all aspects of data processing, including data warehouse architecture/modeling and ETL processing. Conduct data profiling, cleansing and validation activities to ensure...
Senior Azure Data Engineer
As the Senior Data Engineer, you’ll be primarily responsible for leading projects to automate manual processes and produce data driven insights for the team and other stakeholders across the organization, managing Data Consumption and Data Governance areas of DNA, and actively contribute to both dat...
Sr. Data Management Consultant
You will experience a variety of client projects including performing assessments, devising and implementing data quality, data catalog, and master data solutions, and assisting in the delivery of comprehensive Data Governance and Data Management projects. Assess data quality, remediate data quality...
Senior Civil Engineer - Data Center
As a Senior Civil Engineer on our Data Center Civil Team, you will be a part of the firm’s largest and most complex projects. Olsson currently has one opportunity for a Senior Engineer to support our Data Center Site Design group. We are Olsson, a team-based, purpose-driven engineering and design fi...
Data Engineer
Show proficiency in data analysis and the ability to generate actionable insights. Trident Consulting is an award-winning IT/engineering staffing company founded in and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract a...