Job Description
Job Description
Big Data / Hadoop Engineer - (Ideal candidate will be a Sr. java Developer currently working in Big Data and AWS cloud platform)
Responsibilities :
- Work with big data analytics engineers to develop automated testing systems.
- Develop testing software that will generate and validate test data for big data systems.
- Develop testing software that will investigate the performance and scalability of big data systems.
- Work with product managers and development leads to create testing strategies.
- Create test plans and test cases for assigned components.
- Execute and automate test cases, and perform bug tracking and management.
- Contribute in building a flexible and scalable data testing automation solution.
- Help create and implement quality processes and requirements.
- Identify and communicate risks about our releases.
Required skills needed for this role :
- Minimum 3+ years of hand on experience with big data or analytics systems.
- Strong SQL / Analytical SQL expertise
- Develop and update scripts written in Bash and Python.
- Experience developing software or test automation in Java.
- Amazon Web Services (EC2, EMR, S3 & Cloud Formation).
- Working knowledge of bug tracking tools (e.g., Atlassian Jira).
- Experience testing big data storage systems and tools such as EMR, Spark, Hive.
- Knowledge of Spark and related applications (Kafka, Spark SQL).
- Experience testing scalable, distributed big data systems.
GCP Data Engineer with Big Query
We are looking for a talented Data Engineer/Architect with deep expertise in Google Cloud Platform (GCP) and BigQuery to join our team. The ideal candidate will have a solid background in data engineering, with experience in legacy ETL processes, Talend, and SQL. Design, develop, and implement data ...
Hadoop/Big Data Developer
In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple fact...
Lead/Sr. Big Data Engineer
Big Data EngineerLocation: Irving, TX (Hybrid – 2-3 days/week)Duration: 12+ MonthsUSC/GC/H1B onlyC2C/1099 onlyThis role can play the hand-on dev role along with tech lead skillsRequired Skills:Big data expert with 9+ years experience in Hadoop Big data ecosystemSpark - Batch Streaming (Python, Scala...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Big Data Engineer
Big Data Engineer Responsibilities:. Big Data Engineer Requirements:. Previous experience as a big data engineer. Meeting with managers to determine the company’s Big Data needs. ...
Big Data Engineer - Java/Scala
Minimum 3+ years of experience with programming languages like Java, Scala, PythonHands on development experience in Hadoop Spark and Kafka,Experience with cloud solutions like AWS, AzureExperience with NoSql and traditional databases like Cassandra, MongoDB, MSSQLExperience with enterprise applicat...
Cloud Big Data Engineer
Looking for Cloud Big Data Engineer in Carrollton, TX area and should work with Amazon Web Services (AWS) using EC2 for computing and S3 as storage. Test all applications and transport data to target Warehouse tables, schedule and run extraction and load process by using Informatica Workflow Ma...
Senior-Big Data Software Engineer
REQUIREMENTS: Requires a Bachelor’s degree, or foreign equivalent degree, in Electronic Engineering or Computer Engineering and 5 years of progressive, post-baccalaureate in the job offered or 5 years of progressive, post-baccalaureate in a related occupation utilizing ChatGPT; utilizing CICD/ansibl...
Lead / Sr. Big Data Engineer
Big data expert with 9+ years experience in Hadoop Big data ecosystem. Have experience as a Tech Lead for data engineering projects. Experience in developing both batch and real-time streaming data pipelines. ...
Big Data Engineer II, DP&I - D&A - Revenue
We are accomplishing this vision by bringing to bear Big Data technologies like Elastic Map Reduce (EMR) in addition to data warehouse technologies like Spectrum to build a data platform capable of scaling with the ever-increasing volume of data produced by AWS services. Demonstrate efficiency in ha...