Role AWS Databricks Architect
Location : O'Fallon, MO (Onsite Day -1)
Yrs. of experience : 10+ Yrs.
Mode of employment : Full-Time
Job Description :
Candidates are required to have these mandatory skills :
Strong hands on in PySpark and Apache Spark.
Experience in Native Spark Migration to Databricks.
Experience in Hadoop Migration to Databricks.
Experience in Building Data Governance Solutions like Unity Catalog, StarBust etc
Build Very Strong Orchestration Layer in Databricks / ADF . Workflows.
Build CICD for Databricks in Azure Devops.
Process near Real time Data thru Auto Loader, DLT Pipelines.
Implement Security Layer in Delta Lake.
Implement Massive Parallel Processing Layers in Spark SQL and PySpark.
Implement Cost effective Infrastructure in Databricks.
Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems. etc into Pyspark.
Ability to Build Solutions as Cloud Agnostic.
Proven experience in designing and implementing complex data solutions aligned with business objectives.
Expertise in data modelling, integration, security, and governance
Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies.
Prior experience with establishing best practices for business optimizations.
Experience with relational and non-relational data stores (Hadoop, SQL, Mongo DB), ETL or ELT tools (SSIS, Informatica, Matillion, DBT), DevOps, Data Lake and Data Fabric concepts
In-depth experience with data governance, data integration and related technologies.
Proficiency in a variety of database technologies, both relational and non-relational.
Knowledge of cloud-based data solutions (e.g., AWS, Azure).
Excellent collaboration and communication skills
Fulltime/ AWS Databricks Architect
Job Title: AWS Databricks Architect. Ability to run Databricks with AWS glue catalog. Ability to run ETL jobs in Databricks. Monitoring of Databricks jobs. ...
AWS Databricks Architect
Role – AWS Databricks Architect. Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies. Experience in Native Spark Migration to Databricks. Experience in Hadoop Migration to D...
Fulltime/ AWS – Databricks Architect
Job Title: AWS Databricks Architect. Ability to run Databricks with AWS glue catalog. Ability to run ETL jobs in Databricks. Monitoring of Databricks jobs. ...
AWS Databricks Architect
Job Title: AWS Databricks Architect. Architect and manage comprehensive data solutions on AWS, using Databricks for data engineering, machine learning, and advanced analytics. Proven experience in AWS architecture and Databricks. Optimize performance, scalability, and cost-efficiency of data storage...
Databricks Platform Architect - AWS Infrastructure
Databricks Platform Architect - AWS Infrastructure. AWS environment deployment for Databricks including – Unity catalog setup, manage, enable for workspace Serverless enablement and other features. Expertise in creating platform and deploying multiple environments in AWS, for Databricks. Should be a...
Azure DevOps Engineer- Onsite
Strong experience in Azure Devops and Github. ...
Senior Data Engineer, Global Data & Analytics - Genmab
We are looking for a hands-on, dedicated, and Experienced Data Engineer with deep technical expertise in Databricks, Snowflake & AWS to join our Global Data & Analytics team. Expert knowledge of data architectures to enable Data Lakes, Data Warehouses and Data Mart implementations. The ideal candida...
TA3-9H Network Engineer (Mid) - Data Center Experience
Softek International, on behalf of the DHS Homeland Security Enterprise Network (HSEN) Engineering Support Services Contract, is seeking a Network Engineer (with prior data center experience) to support ongoing WAN engineering and operations, to include on-site data center activities at the DHS faci...
IT Data Architect Senior
The Data Architect, Senior articulates the overall architectural vision, conceptualizes, and experiments with alternative architectural approaches with respect to strategic design and development of data architecture across IT and the organization. Develop data frameworks and scalable approaches to ...
Infrastructure and DevOps Engineer
Magna-Power Electronics, a Flemington, New Jersey based electronics manufacturer, is seeking a Infrastructure and DevOps Engineer to join its dedicated world class team. The DevOps Software Engineer will play a critical role in managing and enhancing the company's software infrastructure. B...