Data Engineer
Job Summary :
Our client is seeking a Data Engineer who is highly enthusiastic and has experience in Python and Databricks. They will create, tune, maintain, and build reporting Big Data platforms that drive business.
Duties :
- Perform systems integration design and development in cloud architecture design
- Build sizing and cost models for Cloud Services
- Review enhancement requests and recommend best solution to stakeholders as SME
- Containerizing ingestion processes using docker and Kubernetes services
- Understand business requirements to design , build, develop and test data integration pipelines
- Plan, direct DevOps implementation and system hardware and software updates for better performance, stability
- Work on the BI dashboards to support retail stores and the Azure AI platform that runs the personalized consumer experiences used by millions each day
Desired Skills / Experience :
- Bachelor’s Degree in Computer Science or equivalent
- 5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix
- 2+ years experience with Apache Spark and Databricks cloud tool sets (AWS or Azure)
- 1+ years experience with GCP and Azure Cloud Big Data tools (PowerBI / DataLake / Azure Databricks)
- Self-motivated with excellent analytical, problem solving, verbal and communication skills
- Proficiency in API security frameworks, token management and UAC including OAuth, JWT, etc.
- Basic knowledge of using Devops, Github, JIRA tools and ability to work in agile environment
Benefits :
- Medical, Dental, & Vision Insurance Plans
- 401K offered
Senior Test Data Engineer
Understand different data technologies, databases, interaction across data systems, mainframe interaction vs distributed. Strong understanding data management, data flow and databases. Understand the end to end data flow and provides the data integrated solutions for the customers. Understands and c...
Senior Data Engineer
Build design, develop, test, deploy, maintain and enhance full-stack data engineering solutions Provide technical leadership to the Data Warehouse and Shutterfly teams who use Shutterfly’s Enterprise Data Warehouse With your technical expertise own and manage project priorities, deadlines and de...
Data Engineer III or IV
Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or Electrical Engineering with 4-6 years of experience as a professional software engineer/developer; or 6-8 years of experience as a professional software engineer/developer. The Data Engineer III or IV at Word on Fi...
Data Engineer
Data Science and other internal customers, integrate data from a variety of sources and ensure adherence to data quality and accessibility standards. Job Title: Data Engineer (GCP). Understanding of Client-ops, Client modelling, proven track record to wrangle data for exploratory data analysis. Unde...
AWS Data Engineer
CGI has an immediate need for a AWS Data Engineer to join our team in Reston, VA, Plano, TX or Lafayette, LA. Working with Architecture team for design and implementation of Big & Fast Data Infrastructure on AWS cloud. Guide other teams to design, develop, and deploy data sets and tools that support...
Snowflake/SAP Data Engineer
Experience with DBMS, Data Warehouses, designing and implementing complex data transformations to build real-time data pipelines and provide the business users with the most accurate, actionable data to make decisions. Experience designing highly scalable ETL processes with complex data transformati...
Senior Data Engineer - PCCI
Requirements: Employer will accept a minimum of Bachelor’s Degree (or foreign equivalent) in Computer Science, Computer Engineering, or Data Engineering with 36 months of experience in database administration, data engineering, or closely related occupation. Interested in a career with both meaning ...
Data Engineer
Build near real time data pipeline with Apache Spark, Pyspark & Python to extract data from NoSQL DBs and Load it into Cassandra Data Enterprise Graph. Build real time data pipeline with Apache Flink, Apache Kafka and Python to extract data from Relational and NoSQL DBs and Load it into Cassandra Da...
Data Center Engineer
Technical/Functional Skills: .PC Assembly and testing, System board testingand assembly .Assemble and configure reference & validationplatforms.Integrate assets(CPU, DIMMS, IO Cards) in new platforms andperform integration check.Manageand maintain testing systems, which includes replacing components...
Data Engineer - Dallas
Stay updated with emerging trends, technologies, and best practices in data engineering, data modeling, and backend Java engineering. Minimum five years of hands-on experience as a Data Engineer, working on complex data projects and implementing data modeling solutions. Develop, maintain, and optimi...