Search jobs > Philadelphia, PA > Lead data engineer

Lead Databricks Data Engineer

BCforward
USA, Pennsylvania, Philadelphia
$54,34-$57,64 an hour
Permanent
Full-time
Temporary

Lead Databricks Data Engineer

BCforward is currently seeking a highly motivated Lead Databricks Data Engineer for an opportunity in Philadelphia, PA

Position Title : Lead Databricks Data Engineer

Location : Philadelphia, PA

Anticipated Start Date : 11th - November - 2024

Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date.

Expected Duration : 6+ months contract to permanent

Job Type : FULL TIME (>

40 HRS WEEKLY), CONTRACT , Onsite

Pay Range : $54.34 / hr - $57.64 / hr

Please note that actual compensation may vary within this range due to factors such as location, experience, and job responsibilities, and does not encompass additional non-standard compensation (e.

g., benefits, paid time off, per diem, etc.).

Job Description :

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform.

As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions.

This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities :

Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.

Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.

Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.

Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.

Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.

Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.

Implement secure and scalable data capture and ingestion workflows.

Support data preparation, exploration, and visualization to facilitate data-driven decision-making.

Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.

Qualifications :

5+ years of experience in designing and delivering secure cloud solutions.

3+ years of experience with Databricks

2+ years of experience with Agile Methodology

Strong problem-solving, analytical, and communication skills.

Benefits :

BCforward offers all eligible employees a comprehensive benefits package including, but not limited to major medical, HSA, dental, vision, employer-provided group life, voluntary life insurance, short-term disability, long-term disability, and 401k.

About BCforward :

Founded in 1998 on the idea that industry leaders needed a professional service, and workforce management expert, to fuel the development and execution of core business and technology strategies, BCforward is a Black-owned firm providing unique solutions supporting value capture and digital product delivery needs for organizations around the world.

Headquartered in Indianapolis, IN with an Offshore Development Center in Hyderabad, India, BCforward's 6,000 consultants support more than 225 clients globally.

BCforward champions the power of human potential to help companies transform, accelerate, and scale. Guided by our core values of People-Centric, Optimism, Excellence, Diversity, and Accountability, our professionals have helped our clients achieve their strategic goals for more than 25 years.

Our strong culture and clear values have enabled BCforward to become a market leader and best in class place to work.

BCforward is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against based on disability.

To learn more about how BCforward collects and uses personal information as part of the recruiting process, view our Privacy Notice and CCPA Addendum.

As part of the recruitment process, we may ask for you to disclose and provide us with various categories of personal information, including identifiers, professional information, commercial information, education information, and other related information.

BCforward will only use this information to complete the recruitment process.

This posting is not an offer of employment. All applicants applying for positions in the United States must be legally authorized to work in the United States.

The submission of intentionally false or fraudulent information in response to this posting may render the applicant ineligible for the position.

Any subsequent offer of employment will be considered employment at-will regardless of the anticipated assignment duration.

Interested candidates please send resume in Word format Please reference job code 230594 when responding to this ad.

Get job alerts by email. Sign up now! Join Our Talent Network!

Job Snapshot

Employee Type

Contractor

Location

Philadelphia, PA (Onsite)

Job Type

Information Technology

Experience

Not Specified

Date Posted

10 / 22 / 2024

14 hours ago
Related jobs
Promoted
Softcrylic
Philadelphia, Pennsylvania

We are looking for a highly skilled Technical Lead - Data Engineering with a strong background in building and optimizing data pipelines and transformation processes using Azure Databricks, Python, and Spark. Lead Data Engineer - Azure Databricks & ADF. Lead the design, development, and optimization...

Promoted
Capital One
Boothwyn, Pennsylvania

Delaware Avenue (18052), United States of America, Wilmington, DelawareLead Data Engineer (Bank Tech)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital On...

Promoted
CBase Inc
Philadelphia, Pennsylvania
Remote

You will be the Revenue Management domain Data Engineering subject matter expert (SME) to be consulted by Data & Analytics, Data Governance, as well as other EM engineers, and Leadership, on the use of Data Assets to meet business needs. Actively leads, coaches, mentors, and teaches other engineers;...

Promoted
Capital One
Boothwyn, Pennsylvania

Delaware Avenue (18052), United States of America, Wilmington, DelawareLead Data Engineer (Bank Tech)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital On...

Promoted
Deloitte
Philadelphia, Pennsylvania

The Artificial Intelligence & Data Engineering team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. SQL, data transformations, statistical analysis, and t...

Promoted
Capital One
Philadelphia, Pennsylvania

Sr Lead Data Platform Engineer, Shopping (Remote-Eligible). As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL data...

Promoted
Deloitte
Philadelphia, Pennsylvania

The Artificial Intelligence & Data Engineering team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. SQL, data transformations, statistical analysis, and t...

Promoted
Capital One
Philadelphia, Pennsylvania
Remote

What You’ll Do: Collaborate with and across Agile teams to design, develop, itdetest, implement, and support technical solutions in full-stack development tools and technologies Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Util...

eTeam Inc
Philadelphia, Pennsylvania

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalabili...

Brown Brothers Harriman
Philadelphia, Pennsylvania

Data movement technology pillar to architect, engineer and support the products and solutions that service our Managed File Transfer and Fax operation. Responsible for developing, reviewing, and implementing comprehensive data migration strategies, ensuring the seamless transfer of data between syst...