Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data.
Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform, including structured and unstructured data from various document formats.
Collaborate closely with cross-functional teams to gather requirements, understand data needs, and translate them into technical solutions.
Implement DataOps principles and best practices to ensure robust data operations and efficient data delivery.
Design and implement data CI / CD pipelines to enable automated and efficient data integration, transformation, and deployment processes.
Monitor and troubleshoot data pipelines, proactively identifying and resolving issues related to data ingestion, transformation, and loading.
Conduct data validation and testing to ensure the accuracy, consistency, and compliance of data.
Stay up-to-date with emerging technologies and best practices in data engineering.
Document data workflows, processes, and technical specifications to facilitate knowledge sharing and ensure data governance.
Required Experience :
Bachelors degree in computer science, Engineering, or a related field.
8 + year experience in data engineering, ELT development, and data modeling.
4-7 years of experience in Python.
Proficiency in using Apache Airflow and Spark for data transformation, data integration, and data management.
Experience implementing workflow orchestration using tools like Apache Airflow, SSIS or similar platforms.
Demonstrated experience in developing custom connectors for data ingestion from various sources.
Strong understanding of SQL and database concepts, with the ability to write efficient queries and optimize performance.
Experience implementing DataOps principles and practices, including data CI / CD pipelines.
Excellent problem-solving and troubleshooting skills, with a strong attention to detail.
Effective communication and collaboration abilities, with a proven track record of working in cross-functional teams.
Familiarity with data visualization tools Apache Superset and dashboard development.
Understanding of distributed systems and working with large-scale datasets.
Familiarity with data governance frameworks and practices.
Knowledge of data streaming and real-time data processing technologies (e.g., Apache Kafka).
Strong understanding of software development principles and practices, including version control (e.g., Git) and code review processes.
Experience with Agile development methodologies and working in cross-functional Agile teams.
Ability to adapt quickly to changing priorities and work effectively in a fast-paced environment.
Excellent analytical and problem-solving skills, with a keen attention to detail.
Strong written and verbal communication skills, with the ability to effectively communicate complex technical concepts to both technical and non-technical stakeholders.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Other
Industries
IT Services and IT Consulting
J-18808-Ljbffr
serp_jobs.job_alerts.create_a_job
Senior Data Engineer • Las Vegas, NV, US
Job_description.internal_linking.related_jobs
serp_jobs.job_card.promoted
Service Engineer
SupermicroLas Vegas, NV, United States
serp_jobs.job_card.full_time
Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.job_card.promoted
Online Survey Taker. Earn up to $25 per survey. - Remote
Earn HausMoapa Town, NV, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Junior Account Executive
BDM ManagementSpring Valley, NV, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Leadership isn’t something you wait for; it’s something you step into.As a Junior Account Executive supporting Verizon campaigns, you’ll receive full-scale mentorship and hands-on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Drywall Senior Project Manager : $150K-$200K
GpacEnterprise, Nevada, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
JOB DESCRIPTION : $150K-$200K.SEEKING COMMERCIAL DRYWALL PROJECT MANAGERS & ESTIMATORS.GPAC : #1 Commercial Drywall Recruiting Firm in North America : WORK FOR A LEADING CONTRACTOR.I am worki...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
serp_jobs.job_card.promoted
serp_jobs.job_card.new
Clinical Quality Analyst Coding (Enterprise)
OptumEnterprise, NV, US
serp_jobs.job_card.part_time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
serp_jobs.job_card.promoted
serp_jobs.job_card.new
Clinical Quality Analyst Coding (Blue Diamond)
OptumBlue Diamond, NV, US
serp_jobs.job_card.part_time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
serp_jobs.job_card.promoted
Fuel Dispatcher / Computer Operator (DCO)
Versar, Inc.Spring Valley, NV, US
serp_jobs.job_card.part_time
Headquartered in Washington, DC, Versar Global Solutions provides full mission lifecycle solutions for challenges faced by our government and commercial Customers in the natural, built, and digital...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
serp_jobs.job_card.promoted
serp_jobs.job_card.new
Clinical Quality Analyst Coding (Spring Valley)
OptumSpring Valley, NV, US
serp_jobs.job_card.part_time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
serp_jobs.job_card.promoted
serp_jobs.job_card.new
Clinical Quality Analyst Coding (Summerlin South)
OptumSummerlin South, NV, US
serp_jobs.job_card.part_time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Verizon Sales Agent
BDM ManagementSpring Valley, NV, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Step into a career where communication meets strategy.As a Verizon Sales Agent, you’ll be part of a high-performing team delivering tailored solutions to customers.
This role is perfect for dr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
serp_jobs.job_card.promoted
Lead Software Engineer - Data Platform
RelativityLas Vegas, NV, United States
serp_jobs.job_card.full_time
Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.job_card.promoted
Senior Kubernetes Platform Engineer
TensorWaveLas Vegas, NV, US
serp_jobs.job_card.full_time
At TensorWave, we're leading the charge in AI compute, building a versatile cloud platform that's driving the next generation of AI innovation.
We're focused on creating a foundation tha...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.job_card.promoted
Senior Software Engineer - Data Platform
RelativityLas Vegas, NV, United States
serp_jobs.job_card.full_time
Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.job_card.promoted
Survey Taker : Earn up to $25 per survey (Remote)
Earn HausSpring Valley, NV, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.
You will help influence brand decisions on se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.job_card.promoted
Senior Accountant
CalPortlandSummerlin, NV, United States
serp_jobs.job_card.full_time
The Senior Accountant supports a variety of mid-level accounting duties, which include both day-to-day activities and long term projects.
At CalPortland, we’re proud to offer a comprehensive, compet...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
serp_jobs.job_card.promoted
Looking for the ultimate side hustle?
Survey AuthorityEnterprise, NV, United States
serp_jobs.job_card.full_time
Earn cash by matching with real companies that pay you for your opinions.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
serp_jobs.job_card.promoted
Remote Medical Scribe
Scribe-XEnterprise, NV, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Scribe-X offers unparalleled clinical experience and preparation for medical school.Receive extensive paid training that will help you master EMR systems and patient documentation procedures.Develo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.job_card.promoted
serp_jobs.job_card.new
Clinical Quality Analyst Coding (Sloan)
OptumSloan, NV, US
serp_jobs.job_card.part_time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
serp_jobs.job_card.promoted
Independent Operator - Store Manager (Enterprise)
Grocery OutletEnterprise, NV, US
serp_jobs.job_card.full_time +1
Grocery Outlet is a rapidly growing, family-oriented retailer dedicated to providing customers with high-quality, deeply discounted products.
With commitment to our communities and a strong network ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
serp_jobs.job_card.promoted
Entry Level Options Trader Job in Enterprise, NV | Full Time
Maverick TradingEnterprise, NV, USA
serp_jobs.job_card.full_time
Entry Level Options Trader Job at Maverick Trading.Maverick Trading, a 26-year old proprietary trading firm is looking to hire experienced and entry-level equity and equity and option traders.We ar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30