Astra DAO is seeking a multi-talented Senior Big Data Engineer to facilitate the operations of our Data Scientists and Engineering team.
The Senior Big Data Engineer will be responsible to employ various tools and techniques to construct frameworks that prepare information using SQL, Python, R, Java and C++.
The Senior Big Data Engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field.
During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.
Responsibilities
- Liaising with coworkers and clients to elucidate the requirements for each task.
- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
- Reformulating existing frameworks to optimize their functioning.
- Testing such structures to ensure that they are fit for use.
- Building a data pipeline from different data sources using different data types like API, CSV, JSON, etc.
- Preparing raw data for manipulation by Data Scientists.
- Implementing proper data validation and data reconciliation methodologies.
- Ensuring that your work remains backed up and readily accessible to relevant coworkers.
- Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field.
- A Master's degree in a relevant field is an added advantage.
- 3+ years of Python, Java or any programming language development experience
- 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
- 3+ years of experience with schema design and dimensional data modeling
- Expert proficiency in SQL, NoSQL, Python, C++, Java, R.
- Expert with building Data Lake, Data Warehouse or suitable equivalent.
- Expert in AWS Cloud.
- Excellent analytical and problem-solving skills.
- A knack for independence and group work.
- Capacity to successfully manage a pipeline of duties with minimal supervision.
About Astra DAO
Astra DAO is an automated crypto asset allocator, built on Ethereum to provide advanced investment strategies to retail participants.
The innovative model creates a win-win incentive for index investors, creators, and token holders.
Astra DAO simplifies passive investing for retail participants by providing an array of Crypto Indices. Astra DAO aims to help crypto investors compete with quantitative investment funds by finding winning investments and trades.
PI249693948
Senior Software Engineer - Data Platform
Key Responsibilities:Lead end-to-end development of data tooling and frameworksEnsure collaboration with leadership and senior engineersCoach and mentor the next generation of technical leadersRequired Qualifications:5+ years of experience as a Software EngineerExperience defining architecture and s...
Crypto Data Scientist / Machine Learning Engineer (Hanoi-Remote)
As a machine learning engineer, you should demonstrate solid data science knowledge and experience. Master's degree in computational linguistics, data science, data analytics, or similar will be advantageous. Extensive knowledge of ML frameworks, libraries, data structures, data modeling, and softwa...
Senior Software Engineer, Layout Router - Remote USA
BS or MS in Computer Engineering, or Electrical Engineering. ...
Crypto Data Scientist / Machine Learning Engineer (Indonesia-Remote)
As a machine learning engineer, you should demonstrate solid data science knowledge and experience. Master's degree in computational linguistics, data science, data analytics, or similar will be advantageous. Extensive knowledge of ML frameworks, libraries, data structures, data modeling, and softwa...
Senior Electrical Engineer- Mission Critical Data Center Program Lead
Senior Electrical Engineer- Mission Critical Data Center Program Lead. Our mission is to engineer and commission “green buildings and data center campuses that work. Strong background in electrical engineering and designing data centers including ancillary power [EM1] distribution systems including ...
Crypto Data Scientist / Machine Learning Engineer (Albania-Remote)
As a machine learning engineer, you should demonstrate solid data science knowledge and experience. Master's degree in computational linguistics, data science, data analytics, or similar will be advantageous. Extensive knowledge of ML frameworks, libraries, data structures, data modeling, and softwa...
Senior Structural Project Engineer - Chicago or Remote
As a Senior Project Engineer you will translate your customers’ needs for their warehouse systems into an engineering designs, create bills of material, supervise layouts and drawings, and collaborate with the manufacturing team. Senior Structural Project Engineer. You will provide engineering suppo...
Alerts Java Senior Software Engineer - High Throughput Stream Processing (Remote)
Alerts Java Senior Software Engineer - High Throughput Stream Processing (Remote). Alerts Java Senior Software Engineer - High Throughput Stream Processing (Remote). Senior Software Engineer Req ID FY|R&D|#9 Location(s) Atlanta, Georgia, USA; Austin, Texas, USA; Baltimore, Maryland, USA; Chicago, Il...
Senior Cluster Engineer - Remote / Telecommute
Candidate can learn from data what the needs of our scientists/engineers will and can produce a cluster growth plan to fulfill these needs. Candidate can effectively communicate with a variety of stakeholders, including presenting plans to higher management and having technical discussions with engi...
System Engineer - Systems Engineer - Hybrid Cloud & Data Protection (Remote; occasional on-site required) - JOBID426
Proven experience in systems engineering, with a focus on hybrid cloud platforms, automated storage systems, and data protection technologies. We are seeking a Systems Engineer who will be responsible for designing, implementing, and maintaining IT infrastructure, focusing on HPE GreenLake, VLM, and...