Astra DAO is seeking a multi-talented Senior Big Data Engineer to facilitate the operations of our Data Scientists and Engineering team.
The Senior Big Data Engineer will be responsible to employ various tools and techniques to construct frameworks that prepare information using SQL, Python, R, Java and C++.
The Senior Big Data Engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field.
During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.
Responsibilities
- Liaising with coworkers and clients to elucidate the requirements for each task.
- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
- Reformulating existing frameworks to optimize their functioning.
- Testing such structures to ensure that they are fit for use.
- Building a data pipeline from different data sources using different data types like API, CSV, JSON, etc.
- Preparing raw data for manipulation by Data Scientists.
- Implementing proper data validation and data reconciliation methodologies.
- Ensuring that your work remains backed up and readily accessible to relevant coworkers.
- Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field.
- A Master's degree in a relevant field is an added advantage.
- 3+ years of Python, Java or any programming language development experience
- 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
- 3+ years of experience with schema design and dimensional data modeling
- Expert proficiency in SQL, NoSQL, Python, C++, Java, R.
- Expert with building Data Lake, Data Warehouse or suitable equivalent.
- Expert in AWS Cloud.
- Excellent analytical and problem-solving skills.
- A knack for independence and group work.
- Capacity to successfully manage a pipeline of duties with minimal supervision.
About Astra DAO
Astra DAO is an automated crypto asset allocator, built on Ethereum to provide advanced investment strategies to retail participants.
The innovative model creates a win-win incentive for index investors, creators, and token holders.
Astra DAO simplifies passive investing for retail participants by providing an array of Crypto Indices. Astra DAO aims to help crypto investors compete with quantitative investment funds by finding winning investments and trades.
PI249095849
Senior Principal Data Engineer
A company is looking for a Senior Principal Data Engineer - MarTech to lead the development of a modern marketing technology stack. ...
Crypto Senior UI/UX Engineer (Jakarta-Remote)
Token Metrics is looking for a dynamic Senior UI/UX Engineer who will be responsible for the UI and UX design of our various digital assets. The Senior UI/UX Engineer should have a passion for delivering adaptive and creative solutions to UI/UX design problems by staying up to date with best practic...
Senior Software Engineer ML Data Pipeline
A company is looking for a Senior Software Engineer, ML Data Pipeline. Key Responsibilities:Collaborate with perception experts and roboticists to scale solutions for L3 driving systemsArchitect and implement state-of-the-art solutions in machine learning domainsDevelop cloud services for data manag...
Tech Lead - Crypto & AI (Vietnam- Remote - Astra)
In this role, you will be responsible for leading technical initiatives, mentoring developers, and contributing to the architecture and development of our cutting-edge cryptocurrency analytics platform. Stay up-to-date with emerging technologies and industry trends in the cryptocurrency and blockcha...
Senior Infrastructure Security Engineer Data Protection
A company is looking for a Senior Infrastructure Security Engineer - Data Protection. ...
Senior Software Engineer – Hardware Engineering (Network Automation) REMOTE
Senior Software Engineer – Hardware Engineering (Network Automation). GEICO is seeking a Senior Software Engineer with a deep focus on network engineering and automation on Open-source network systems, cloud, and legacy vendor systems. As a Senior Software Engineer, you will:. As an integral part of...
Senior Software Engineer (Remote)
Software Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production applications. Software Engineers may be involved in product and tool selection, config...
Senior Staff Software Engineer - Cloud Networking (REMOTE)
Staff Engineer you will be at the forefront of our Data Center Hybrid Cloud architecture, responsible for design, development and troubleshooting of high quality SDN solutions for next-gen network HW including Switch, SmartNIC, Load balancer and Firewall building a cohesive, robust system. Collabora...
Crypto Chief of Staff (Vietnam-Remote)
Token Metrics helps crypto investors build profitable portfolios using artificial intelligence-based crypto indices, rankings, and price predictions. Proficiency in crypto concepts, excellent communication skills, and strong project management abilities are essential. Lead the development and execut...
*Remote* Senior Environmental Engineer or Geologist
An innovative, employee-owned environmental engineering company is seeking top talent for its federal remediation projects. Candidates will benefit from the flexibility of a fully remote work schedule and a collaborative, empowering work environment. This includes methods such as air-sparge, soil va...