Job Description
Job Description
Apply now : Big Data Engineer, a hybrid position local to Atlanta, GA. The start date is ASAP for this long-term contract position.
Job Title : Big Data Engineer
Location : Hybrid to Atlanta, GA
Duration : 6+ Months to extend
Rate : $90-100 Per Hour W2
Start Date : ASAP
Responsibilities :
- Architecture and Design
- Code Development
- Production Support
- Mentoring of junior team members
- Automation
Requirements :
- Bachelor's in computer science or closely related discipline.
- High level of experience with Spark Steaming
- 4+ years of focused experience in Big Data space.
- Highly experienced with Scala and either Python or Java
- Experience building data processing pipelines at scale on AWS.
- Experience in AWS components like EMR, EC2, ECS and Redshift
- Deep understanding of the concepts involved with managing resources in AWS.
- Experience working with different file formats like Avro , Json , Parquet
Nice to Haves :
- Experience in Rest based microservice architecture
- Ability to lead new and complex projects having multiple dependencies from design phase all the way to production. This may involve facilitating across multiple teams.
- Nice to have experience in Airflow and Jenkins or other CI / CD.
- Nice to have experience on different monitoring, alerting, dashboarding tools like Datadog and PagerDuty.
- Nice to have dev ops experience with focus on cloud formation and terraform
- Other skills needed to perform the job (ex : presentation skills, negotiation skills, etc.).
Big Data Engineer (Various Levels)
Our client is currently seeking an experienced Data Engineer – Big Data individual for their Midtown office in Atlanta, GA. Big Data’ data ingestion pipelines, architectures, and data sets. The successful candidate must have Big Data engineering experience and must demonstrate an affinity for workin...
Big Data Engineer - Spark/Databricks
Our transportation client is looking for a Big Data Engineer - Spark/Databricks to join their team. Requirements of the Big Data Engineer - Spark/Databricks:. Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Cat...
Big Data Engineer
A Fortune-300 client of Insight Global in the transportation industry is looking for an experience Big Data Engineer to join their smart, highly skilled team with a passion for technology, where they will work on their state-of-the-art Big Data Platforms. They will be working alongside 6 other Data ...
Senior / Lead Big Data DevOps Engineer
Are you an experienced engineer with skills in Azure and Databricks? Our client world's leading data, insights and consulting company are looking for a highly qualified Senior or Lead Big Data DevOps to support enterprise data platform deployment on Azure environments. Strong knowledge of Azure Big ...
Big Data Engineer
A Fortune-300 client of Insight Global in the transportation industry is looking for an experience Big Data Engineer to join their smart, highly skilled team with a passion for technology, where they will work on their state-of-the-art Big Data Platforms. They will be working alongside 6 other Data ...
Big Data Engineer
Hands-on experience building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures and data sets. Interpreting and delivering impactful strategic plans for improving data integration, data quality, and data delivery in support of business initiatives and roadmaps. Seeking an ex...
Big Data Engineer (Various Levels)
Synergis' client is seeking an experienced Data Engineer – Big Data. Big Data’ data ingestion pipelines, architectures, and data sets. The successful candidate must have Big Data engineering experience and must demonstrate an affinity for working with others to create successful solutions. The ...
Big Data Engineer Jr- Mid
Hands-on experience building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures and data sets. Interpreting and delivering impactful strategic plans for improving data integration, data quality, and data delivery in support of business initiatives and roadmaps. Seeking an ex...
Lead / Senior DevOps Engineer (Big Data)
Are you a DevOps engineer who can easily navigate the world of Big Data? If so, we have an excellent opportunity for you. Lead / Senior DevOps Engineer (Big Data). Exposure to Big Data systems Hadoop ecosystem, Cassandra, Spark. Release / Deployment / Application Engineering experience. ...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...