Hello, Role Big Data Engineer Location Phoenix, AZ
We are looking for energetic, high-performing and highly skilled Engineers to help shape our technology and product roadmap.
You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global marketing capabilities.
This team is responsible for Global campaign tracking of new accounts acquisition and bounty payments and leverages transformational technologies, such as SQL, Hadoop, Spark, Pyspark, HDFS, MapReduce, Hive, HBase, Kafka & Java.
Focus : Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and / or internal end user applications.
Develop maintain large data processing pipeline using Pyspark and SQL
Responsibilities
- Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
- Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality
- Primary focus is spent writing code, conducting code reviews and testing in ongoing sprints, or doing proof of concepts / automation tools.
Applies visualization and other techniques to fast track concepts.
Debug basic software components and identify code defects for remediation • Enable the deployment, support, and monitoring of software across test, integration, and production environments
Minimum Qualifications :
This high energy Engineer must have :
- A Bachelor’s degree in computer science, computer engineering, other technical discipline, or equivalent work experience
- 6-9 years of software development experience. Hands-on expertise with application design, software development, and automated testing.
- Strong programming knowledge in SQL, Pyspark, Data processing
- Hands-on experience in Big Data technologies (Spark, Hive, MapReduce and Hbase)
- Understanding and experience with UNIX / Shell / Perl / Python scripting
- Database query optimization and indexing
- Web services design and implementation using REST / SOAP and Java is a plus
- Experience collaborating with the business to drive requirements / Agile story analysis.
- Experience with design and coding across one or more platforms and languages as appropriate
Bonus skills :
- Machine learning / data mining
- Object-oriented design and coding
Sr Data Engineer (Hybrid in PHX, LA and Charlotte)
Perform data analysis, data profiling, and data cleansing to ensure data quality and accuracy, data validation, quality checks, and troubleshooting to identify and resolve data-related issues. Expertise with coding and implementing data pipelines in cloud-based data infrastructure in batch and strea...
Sr Data Engineer - DataOps
Data Engineer - DataOps in New York, NY or US-Remote. ...
Big Data Engineer with Hive, Spark, and Scala - Contract W2
Minimum 7 years of experience as a Big Data Engineer or Scala Developer, with a strong focus on big data technologies. Familiarity with data modeling techniques and experience in designing efficient data storage solutions, including relational databases, NoSQL databases, and data lakes. We are seeki...
Big Data Software Engineer
A company is looking for a Software Engineer (Big Data) for a remote full-time experienced position. Key Responsibilities:Understanding code flow and interaction with componentsAnalyzing incidents, providing resolutions, and participating in status callsBuilding web applications, APIs, and algorithm...
Big Data Engineer
Hands-on expertise with application design and software development in Big Data across one or more platforms, languages, and p/ Spark/ HIVE/ NoSQL & SQL Databases). Have had prior experience of architecting data abstraction layers using some NoSQL/in-memory database . Data modeling and data architec...
Sr Data Platform Engineer - Federal
A company is looking for a Sr Systems Engineer, Data Platform - Federal. ...
Engineer - Java, Python, Big Data, NoSQL - Machine Learning
Consumer Services and Enterprise Digital & Data Technology Team brings together foundational strategic technology capabilities in digital experience engineering (Mobile and Web), AI/ML, marketing technology, enterprise communications, travel and lifestyle, and automation, grounded in our data techno...
Big Data Engineer - DB2/Oracle/Python
Builds relationships with diverse groups and leads meetings to gather and document data and information to measure and improve the effectiveness of information security activities performed within the company. Leads or prepares materials (reports, presentations, spreadsheets, etc) to enable informed...
Sr. Data Engineer
Data Engineer here at Valenz, you’ll be responsible for designing, developing, and maintaining data pipelines and architectures that support our data-driven healthcare initiatives! You will collaborate closely with our team of data scientists, analysts, healthcare professionals, and other stak...
Big Data Engineer
Demonstrated experience with data engineering and familiarity with graph database management. Develop and maintain automated data pipelines, ensuring data accuracy and efficient processing using Airflow DAG. Integrate various internal and external data sources (including SharePoint, One Drive, One N...