Astra DAO is seeking a multi-talented Senior Big Data Engineer to facilitate the operations of our Data Scientists and Engineering team.
The Senior Big Data Engineer will be responsible to employ various tools and techniques to construct frameworks that prepare information using SQL, Python, R, Java and C++.
The Senior Big Data Engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field.
During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.
Responsibilities
- Liaising with coworkers and clients to elucidate the requirements for each task.
- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
- Reformulating existing frameworks to optimize their functioning.
- Testing such structures to ensure that they are fit for use.
- Building a data pipeline from different data sources using different data types like API, CSV, JSON, etc.
- Preparing raw data for manipulation by Data Scientists.
- Implementing proper data validation and data reconciliation methodologies.
- Ensuring that your work remains backed up and readily accessible to relevant coworkers.
- Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field.
- A Master's degree in a relevant field is an added advantage.
- 3+ years of Python, Java or any programming language development experience
- 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
- 3+ years of experience with schema design and dimensional data modeling
- Expert proficiency in SQL, NoSQL, Python, C++, Java, R.
- Expert with building Data Lake, Data Warehouse or suitable equivalent.
- Expert in AWS Cloud.
- Excellent analytical and problem-solving skills.
- A knack for independence and group work.
- Capacity to successfully manage a pipeline of duties with minimal supervision.
About Astra DAO
Astra DAO is an automated crypto asset allocator, built on Ethereum to provide advanced investment strategies to retail participants.
The innovative model creates a win-win incentive for index investors, creators, and token holders.
Astra DAO simplifies passive investing for retail participants by providing an array of Crypto Indices. Astra DAO aims to help crypto investors compete with quantitative investment funds by finding winning investments and trades.
PI249693901
Senior Data Sciencist/Algorithm engineer - Optical Metrology Systems
Enabling the movement towards advanced chip design, KLA's Global Products Group (GPG), which is responsible for creating all of KLA's metrology and inspection products, is looking for the best and the brightest research scientist, software engineers, application development engineers, and senior pro...
Senior Software Engineer Crypto Core
A company is looking for a Senior Software Engineer in Crypto Core. ...
Crypto Data Scientist / Machine Learning Engineer (Albania-Remote)
As a machine learning engineer, you should demonstrate solid data science knowledge and experience. Master's degree in computational linguistics, data science, data analytics, or similar will be advantageous. Extensive knowledge of ML frameworks, libraries, data structures, data modeling, and softwa...
Senior Data Engineer - Contract
Key Responsibilities:Data Architecture DesignETL ManagementData Security and ComplianceRequired Qualifications:Production experience on Cloud Providers (AWS, Azure)Data Modeling and Warehousing Tools and TechniquesDatabase Management and SQL (MS SQL, MySQL)ETL Tools and TechniquesData Security and C...
Crypto Senior UI/UX Engineer (Philippines-Remote)
Token Metrics is looking for a dynamic Senior UI/UX Engineer who will be responsible for the UI and UX design of our various digital assets. The Senior UI/UX Engineer should have a passion for delivering adaptive and creative solutions to UI/UX design problems by staying up to date with best practic...
Senior Software Engineer, Layout Router - Remote USA
BS or MS in Computer Engineering, or Electrical Engineering. ...
Crypto QA Engineer (Mumbai-Remote)
We are seeking a dedicated Crypto QA Engineer who is deeply immersed in the crypto ecosystem and passionate about ensuring the reliability and security of our products. Demonstrated experience as a QA Engineer, preferably within the SaaS or crypto space, with a strong focus on web applications and A...
Senior Water/Wastewater Engineer (remote allowed)
Regularly seek out guidance and implement feedback received from senior engineering staff. Brown and Caldwell is currently seeking a self-motivated water and wastewater treatment engineer specializing in process mechanical design to join our Denver, Boise, Salt Lake City, Dallas, Portland or Seattle...
Senior Electrical Engineer- Mission Critical Data Center Program Lead
Senior Electrical Engineer- Mission Critical Data Center Program Lead. Our mission is to engineer and commission “green buildings and data center campuses that work. Strong background in electrical engineering and designing data centers including ancillary power [EM1] distribution systems including ...
Senior Full Stack Engineer - IMS (REMOTE)
The Senior Full Stack Engineer acts as a senior member of a group of passionate engineers to help us create software and services for the Discogs product. The Senior Full Stack Software Engineer for the IMS team will be responsible for building a robust inventory management system using modern React...