Cloud Data Engineer (Snowflake/Databricks)

Deloitte
Lake Mary, FL
Full-time

Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel?

If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical Delivery Center.

Our US Delivery Centers have been growing since 2014 with significant, continued growth on the horizon. Interested? Read more about our opportunity below ...

Work you'll do / Responsibilities

  • Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management.
  • Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements.
  • Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution.
  • Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming.
  • Develop data pipelines / APIs using Python, SQL, potentially Spark and AWS, Azure or GCP Methods.
  • Use an analytical, data-driven approach to drive a deep understanding of fast changing business.
  • Build large-scale batch and real-time data pipelines with data processing frameworks in AWS, Azure or GCP cloud platform.
  • Moving data from on-prem to cloud and cloud data conversions.

The Team

Artificial Intelligence & Data Engineering :

In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment.

The Artificial Intelligence & Data Engineering team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making.

Together with the Strategy practice, our Strategy & Analytics portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets.

Artificial Intelligence & Data Engineering will work with our clients to :

Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms.

Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions.

Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements.

Qualifications

Required

  • 3+ years of experience in data engineering with an emphasis on data analytics and reporting.
  • 3+ years of experience with at least one of the following cloud platforms : Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), others.
  • 3+ years of experience in SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc.).
  • 3+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines.
  • 3+ years of experience with one or more of the follow scripting languages : Python, SQL, Kafka and / or other.
  • 3+ years of experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift / Spectrum, Lambda, Glue, Athena, API gateway, etc.
  • Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline, or equivalent experience
  • Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
  • Ability to travel 10%, on average, based on the work you do and the clients and industries / sectors you serve. This may include overnight travel.
  • Must be able to obtain the required level of security clearance for this role
  • Must live in a commutable distance (approximately 100-mile radius) to one of the following Delivery locations : Atlanta, GA;

Charlotte, NC; Dallas, TX; Gilbert, AZ; Houston, TX; Lake Mary, FL; Mechanicsburg, PA; Philadelphia, PA with the ability to commute to assigned location for the day, without the need for overnight accommodations

Expectation to co-locate in your designated Delivery location up to 30% of the time based on business needs. This may include a maximum of 10% overnight client / project travel

Preferred

  • AWS, Azure and / or Google Cloud Platform Certification.
  • Master's degree or higher.
  • Expertise in one or more programming languages, preferably Scala, PySpark and / or Python.
  • Experience working with either a Map Reduce or an MPP system on any size / scale.
  • Experience working with agile development methodologies such as Sprint and Scrum.
  • Must be able to obtain the required level of security clearance for this role

Information for applicants with a need for accommodation : https : / / www2.deloitte.com / us / en / pages / careers / articles / join-deloitte-assistance-for-disabled-applicants.html

Recruiting tips

From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte.

Check out recruiting tips from Deloitte recruiters.

Benefits

At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits.

Learn more about what working at Deloitte can mean for you.

Our people and culture

Our diverse, equitable, and inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively.

It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our client most complex challenges.

This makes Deloitte one of the most rewarding places to work. Learn more about our inclusive culture.

Our purpose

Deloitte's purpose is to make an impact that matters for our clients, our people, and in our communities. We are creating trust and confidence in a more equitable society.

At Deloitte, purpose is synonymous with how we work every day. It defines who we are. We are focusing our collective efforts to advance sustainability, equity, and trust that come to life through our core commitments.

Learn more about Deloitte's purpose, commitments, and impact.

Professional development

From entry-level employees to senior leaders, we believe there's always room to learn. We offer opportunities to build new skills, take on leadership opportunities and connect and grow through mentorship.

From on-the-job learning experiences to formal development programs, our professionals have a variety of opportunities to continue to grow throughout their career.

30+ days ago
Related jobs
Promoted
Mastech Digital
FL, United States

The ideal candidate will have strong expertise in Snowflake for data warehousing, extensive experience working with large-scale healthcare data, and familiarity with AWS services. This role will involve designing, developing, and optimizing healthcare data pipelines and architectures on Snowflake, e...

Promoted
Deloitte
Lake Mary, Florida

SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc. Moving data from on-prem to cloud and cloud data conversions. The Artificial Intelligence & D...

Highmark Health
FL, Working at Home, Florida

This role within the 'Data Engineering & Self-Service Products' team involves architecting and engineering analytic data solutions, including designing and developing data marts in Databricks using PySpark or Spark SQL, building interactive Power BI dashboards to visualize KPIs and trends, and creat...

Promoted
Deloitte
Lake Mary, Florida

SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc. Moving data from on-prem to cloud and cloud data conversions. The Artificial Intelligence & D...

Promoted
Deloitte
Lake Mary, Florida

SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc. Moving data from on-prem to cloud and cloud data conversions. The Artificial Intelligence & D...

Promoted
Verizon
Lake Mary, Florida

Analyzing historical operations data and market information to predict future outcomes, working at times with large and disparate data sets. Experience with data warehousing tools such as Teradata or Oracle SQL. Performing statistical, data mining, and machine learning analysis on complex business p...

Promoted
Convey Health Solutions
FL, United States

Data Analyst will leverage technical expertise and industry knowledge to enhance analytic insights and features in Pareto Intelligence’s risk adjustment solutions. Design and build extract-transform-load (ETL) workflow in SQL, Python and/or Pyspark to build datasets that will be used to develop anal...

Promoted
TalentoHC
FL, United States

The Senior Data Engineer will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Data Engineer to join their Data Engineering Team. The ideal candid...

Promoted
Elsdon Group
FL, United States

Have experience with Data Modelling, Data integration, Data Quality Management. Elsdon Technology are proud to be partnered with a company who are looking to make 2 hires over the coming weeks for a mid and lead engineer. ...

Promoted
Deloitte
Lake Mary, Florida

SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc. The Artificial Intelligence & Data Engineering team leverages the power of data, analytics, r...