Position : AWS Data Engineer
Job Location : Portland, OR (Onsite)
Responsibilities :
The primary tasks, functions and deliverables of the role)
- Design and build reusable components, frameworks, and libraries at scale to support analytics products
- Design and implement product features in collaboration with business and Technology stakeholders
- Identify and solve issues concerning data management to improve data quality
- Clean, prepare and optimize data for ingestion and consumption
- Collaborate on the implementation of new data management projects and re-structure of the current data architecture
- Implement automated workflows and routines using workflow scheduling tools
- Build continuous integration, test-driven development and production deployment frameworks
- Analyze and profile data for designing scalable solutions
- Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues
Professional Experience :
- Strong understanding of data structures and algorithms
- Strong understanding of solution and technical design
- Has a strong problem solving and analytical mindset.
- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
- Able to quickly pick up new programming languages, technologies, and frameworks
- Experience building cloud scalable, real time and high-performance data lake solutions
- Fair understanding of developing complex data solutions
- Experience working on end-to-end solution design
- Willing to learn new skills and technologies
- Has a passion for data solutions
Required and Preferred Skill Sets :
- Hands on experience in Databricks and AWS - EMR Hive, Pyspark , S3, Athena.
- Familiarity with Spark Structured Streaming.
- Minimum 4 years' experience working experience with Hadoop stack dealing huge volumes of data in a scalable fashion
- 10+ years of hands-on experience with SQL, ETL, data transformation and analytics functions.
- 8+ years of hands-on Python experience including Batch scripting, data manipulation, distributable packages
- 4+ years' experience working with batch orchestration tools such as Apache Airflow or equivalent, preferable Airflow
- 4+ years working with code versioning tools such as GitHub or Bitbucket; expert level understanding of repo design and best practices
- Familiarity with deployment automation tools such as Jenkins
- 8+ years of hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality;
hand on experience with API development
4+ years designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts;
some experience with Snowflake
- Familiarity with Tableau or Cognos use cases
- Familiarity with Agile; working experience preferred
AWS Data Engineer
ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development. Identify and solve issues concerning data management to improve data quality. Collaborate on the implementation of new data management projects and re-structure of the current data arc...
Senior Cloud Security Engineer - GCP
The Senior Cloud Security Engineer - GCP helps architect, deploy, and operate the security cloud infrastructure that aligns with business needs. Along with security leadership, the Senior Cloud Security Engineer - GCP will consistently assess the threat landscape and adapt quickly to protect the bus...
SAP Automation Technology Architect - 61263261
Our strong credentials include Global SAP Certified Provider of SAP BTP Operations, Global SAP Certified Provider of SAP Cloud and Infrastructure Operations, Global SAP Certified Provider of DevOps, Global SAP Certified Provider of SAP S/4HANA Solutions Operations, Global SAP Certified Provider of S...
Entry-Level Data Analyst (Remote)
D Aceto Services LLC is seeking a motivated and detail-oriented Entry-Level Data Analyst to join our team. Help maintain data integrity and accuracy within databases. In this remote position, you will work closely with various departments to analyze data, generate insights, and support decision-maki...
Data Scientist
Experience with Excel, database software, and data processing tools like Alteryx or similar platforms is essential. Your expertise will guide school districts in planning for the future, and you'll play a key role in advancing demographic research and data analytics across the country. Develop s...
Azure Cloud Engineer
Experience as an Azure Cloud Engineer or similar role. Implement and manage cloud infrastructure on Microsoft Azure. Automate deployment, monitoring, and management of cloud resources. Troubleshoot and resolve issues related to cloud infrastructure. ...
GCP Data Engineer
Google Cloud Platform (GCP) Data Engineer will be responsible for architecting transformation and modernization of enterprise data solutions on GCP integrating native GCP services and 3rd party data technologies. As a Data Engineer, work with implementation teams from concept to operations, providin...
Data Engineer-Digital : Python
As a Data Engineer focusing on Data Quality for Asia Pacific and Latin America, you will use your technical expertise to validate and ensure data accuracy across a variety of systems. You are a data engineer or data quality guru with software engineering chops. You are familiar with Spark, Python, H...
Data Science Analyst II
ERR_DATA_EXPECTED:"(expected {0})",ERR_DATA_FORMAT:"{0} is invalid {1}",ERR_DATA_OUT_OF_RANGE:"{0} out of range ({1} - {2})",ERR_DATA_REQUIRED:"{0} is required {1}",ERR_DATA_TOO_LONG:"{0} is too long ({1} characters exceeds the maximum of {2})",JOBREQ_RTE_FIELD_KEY:"Field Key",JOBREQ_RTE_FIELD_LABEL...
AWS Full Stack Cloud Developer
AWS Certified Solutions Architect or AWS Certified Developer certification is a plus. Title: AWS Full Stack Cloud Developer. We are seeking an experienced and skilled AWS Full Stack Cloud Developer to join our team. Monitor and troubleshoot application performance, security, and availability using A...