Job Description
Job Description
Overview :
The Data Engineer (Python) plays a crucial role in collecting, storing, processing, and analyzing large sets of data. They work closely with the data science and analytics teams to build and maintain scalable data pipelines, and create efficient methods for analytics and reporting.
The position is essential in ensuring that the organization can make data-driven decisions and derive valuable insights from the data.
Key Responsibilities :
- Design and develop robust data pipelines using Python for extracting, transforming, and loading (ETL) data from various sources.
- Collaborate with data scientists to understand data requirements and implement efficient solutions for data processing and analysis.
- Implement data modeling and database design, ensuring data integrity and performance.
- Optimize and maintain existing data pipelines and processes to ensure scalability and reliability.
- Work with large-scale, complex data sets to solve challenging business problems.
- Build and maintain data warehouses and data lakes to store and organize data for analysis and reporting purposes.
- Develop and implement data quality standards and best practices.
- Automate and streamline data processes, improving efficiency and reliability.
- Conduct performance tuning and troubleshooting of data-related issues.
- Stay up-to-date with the latest technologies and trends in data engineering and analytics.
Required Qualifications :
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer with strong proficiency in Python.
- Expertise in SQL and database technologies for data manipulation and querying.
- Solid understanding of data modeling, ETL development, and data warehousing concepts.
- Experience with big data technologies such as Hadoop, Spark, or Kafka.
- Ability to design and implement scalable, high-performance data solutions.
- Strong analytical and problem-solving skills for dealing with complex data challenges.
- Excellent communication and collaboration skills to work effectively in cross-functional teams.
- Understanding of data security and privacy concerns in handling sensitive data.
- Proficiency in agile development methodologies and version control systems.
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Experience with data visualization tools and techniques is a plus.
- Ability to work in a fast-paced, dynamic environment with a focus on delivering results.
- Certifications in data engineering or related fields are desirable.
Windows/Cloud DevOps Engineer (remote)
This is remote position is open to any qualified applicant in the United States.Practice - CIS - Cloud, Infrastructure, and Security Services.About Cloud Infrastructure & Security Services:.Cognizant's Cloud, Infrastructure, and Security Services Practice (CIS), is all about accepting digital transf...
Entry-Level Digitial Technology Consulting Analyst
Analyzing data to develop metrics and trends to enhance knowledge and capture value of data. NTT DATA is a Global Top 10 innovator of business and technology services. At NTT DATA, we thrive on the individuality of our people. We are currently seeking entry level Analysts and Consultants to join us ...
DevOps CI/CD Lead Engineer, VP
DevOps CI/CD Lead Engineer, VP. Partner with Application development, Engineering, and other DevOps team to understand the solution and drive the adoption strategy. Primarily involved in DevOps Automation & Tools adoption activities including Jira, Bit Bucket, Jenkins, Artifactory, Git, RLM, Harness...
Healthcare SQL Developer
A company is looking for a Healthcare SQL Developer - Oracle to develop complex data sources and pipelines. ...
Software Engineer (Senior Developer/Business Analyst)
We are seeking a Software Engineer (Senior Developer/ Business Analyst) to become an integral part of our team! You will be responsible for creating and modifying computer application software or specialized utility programs. Involve in all the phases of Software Development Life...
Remote Work From Home Online - Paid Research Panelist - Data Entry Clerk Welcome
Remote Work From Home Online Paid Research Panelist PartTime Data Entry Clerk Welcome. Data entry clerk experience is not compulsory. This is an excellent opportunity to supplement your income if you are a data entry clerk or anyone seeking a flexible parttime remote work from home job. ...
Ecommerce Data Analyst
Revision Skincare is seeking a detail-oriented and analytical eCommerce Data Analyst to join our team. As an integral member of our eCommerce department, you will be responsible for analyzing data from our direct-to-consumer website and Amazon platform to provide valuable insights and drive strategi...
Remote Customer Service
A Data Entry Clerk, is responsible for inputting data and making changes to existing data figures in digital databases. Their duties include inputting data from paper documents into digital spreadsheets, updating order statuses for customers and double-checking their work to make sure they inputted ...
Sr. SAP APO Business Analyst
Experience translating business requirements into a functional design and writing technical requirements document. SAP APO Senior Buisness Analyst to join on a contract to hire basis (headcount approved). ...
Data Engineer
We are currently seeking a Data Engineer to join our team in McKinney, Texas (US-TX), United States (US). Provide technological guidance on Data Lake and Enterprise Data Warehouse design, development, implementation and monitoring. NTT DATA strives to hire exceptional, innovative and passionate indi...