Overview
MUST HAVE TOP SECRET CLEARANCE (MANDATORY)
MUST BE US CITIZEN (MANDATORY)
HYBRID WORK - 25-50% ONSITE ( WORK LOCATION - CHANTILLY, VA)
Soft Tech Consulting is looking for an experienced Data Engineer (Python) to join our team and help us work across multi-layered environments (i.
e. varying security levels) to support data ingestion, enrichment, storage and retrieval tasks within current Cyber Security applications and help design new cutting-edge data analysis capabilities.
Responsibilities
- Creating Unit tests for their code
- Supporting on research, design, development and implementation of custom, cloud and enterprise data services
- Developing high quality, testable and reusable code for Data Pipeline tasks
- Working in an Agile development environment to address customer needs
- Ensuring data provenance, auditability and security for data at rest and in transit
- Building highly scalable and highly available data solutions deployed within Government Cloud Providers, such as AWS, Azure, and / or GCP, and / or hybrid environments
- Troubleshooting and optimizing data infrastructure
- Assisting working with other teams for cloud and on-premises data migrations.
Qualifications
- Bachelor's degree in computer science, computer engineering, or related field.
- Must have experience with creating unit tests for their code.
- Strong Software Engineering knowledge and experience (Python / .Net preferred).
- Possess strong problem-solving skills, including the ability to analyze and recommend requirements.
- Strong communication skills, including the ability to communicate cloud standards and security best practices to technical and non-technical audiences.
- Ability to collaborate on projects and work independently when required.
- Experience working with Data Pipelines (Batch / Streaming).
- Experience working with Data Analysis tools (Spark, Jupyter Notebooks).
- Experience working with messaging frameworks (Kafka).
- Experience working with Docker and utilizing CI / CD automation pipelines.
Data Engineer, Python, PySpark
Locations: Plano, TX/McLean, VA /Richmond, VA....
Senior Data Engineer (Python, SQL, Spark)
Be part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasets. Senior Data Engineer (Python, SQL, Spark). We are seeking Data Engineers who are passionate about marryi...
Lead Data Engineer (Python, AWS, Kafka)
West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Python, AWS, Kafka)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capit...
Lead Data Engineer (Python, AWS, Kafka)
Lead Data Engineer (Python, AWS, Kafka). Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake. As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront ...
Lead Data Engineer (Python, Spark, AWS)
Lead Data Engineer (Python, Spark, AWS). Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront ...
Python Developer/Data Engineer
Design skills with experience in object-oriented methodologies, design patterns, microservices, streaming technologies, database design, and data modeling. Bachelor’s Degree in Computer Science, Engineering or a related field and 7+ years of software/application development experience with Python. M...
Lead Data Engineer (Python, AWS, Kafka)
West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Python, AWS, Kafka). Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake. As a Capital One Lead...
Data Engineer (Python)
Soft Tech Consulting is looking for an experienced Data Engineer (Python) to join our team and help us work across multi-layered environments (i. Ensuring data provenance, auditability and security for data at rest and in transit. Strong Software Engineering knowledge and experience (Python /. Cyber...
Data Engineer (Spark/Scala/Python)
Java, Scala, Python/PySpark, SQL or Go<br /> 3+ years of experience with AWS, specifically EMR<br /> 3+ years of experience in open source frameworks<br /> Experience building high-volume data interactions and observability/monitoring tools will be a huge plus </p> <div>...
Data Engineer (Python/PySpark/AWS)
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Responsibilities: Data Architecture and Design: Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions. Python an...