Primary Skills : Big Data, Data Processing, Java, Dataflow, GKE
Duration : 6+ Months
Location : Santa Clara, CA
Contract Type : W2
Pay Range : $75 - $82 per hour on W2
JOB SUMMARY :
We are seeking a Principal Big Data Engineer to leverage your expertise in handling vast datasets and crafting innovative data processing architectures.
In this pivotal role, you'll spearhead the development of our data ingestion and processing platform, ensuring scalability and efficiency.
Your contributions will be crucial in architecting solutions that meet our dynamic project requirements, involving close collaboration with R&D and data scientists to overcome challenges and enhance our data capabilities.
JOB RESPONSIBILITIES :
Lead the architecture, design, and development of our data ingestion and processing platform.
Adapt and innovate with big-data frameworks and tools to meet project-specific use-cases.
Communicate effectively with research and development teams, identifying and solving bottlenecks.
Design scalable data processing and storage architectures to support the evolving needs of the business.
Develop tools for efficient data ingestion from diverse sources.
JOB REQUIREMENTS :
We are seeking a candidate with 7 to 12+ years of proven experience in designing and implementing solutions within large data environments.
The ideal candidate should have 5+ years of hands-on experience with large-scale data processing tools such as Dataflow, GKE, BigQuery (BQ), Apache Beam, and strong proficiency in Java programming.
3+ years of experience working with both Java and Python.
A solid understanding of Google Cloud Platform (GCP) with strong experience in utilizing its services.
Excellent problem-solving skills, with a focus on quality execution and effective collaboration in a team environment.
A Bachelor's degree is required for this role.
ABOUT AKRAYA
Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment.
Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in IT Staffing
As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space.
We don't just connect you with great jobs, we connect you with a workplace that inspires!
Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!
Principal Data Engineer
A company is looking for a Principal Data Engineer to lead data engineering efforts and collaborate with cross-functional teams. ...
Software Senior Principal Engineer (Data Domain Next Gen Filesystems))
As part of the project responsibilities, you may also be developing test automation and automation framework modules and work collaboratively across Dell divisions to coordinate feature integration and product delivery We can’t wait for you to discover this for yourself as a Senior/Principal Softwar...
Principal Data Pipeline Engineer
A company is looking for a Principal Engineer - Data Pipeline to develop and maintain infrastructure for telemetry data collection at scale. Prometheus, Open Telemetry)Knowledge of big data pipeline technologies (e. Kafka, Spark, Hadoop)BS in Computer Science, Software Engineering, Machine Learning,...
Principal Machine Learning Engineer (URL Filtering Data Science)
As a member of the Internet Security Research Team specifically Advanced URL Filtering Data Science, you will work closely with data scientists, security researchers, and other engineers on implementing different projects to detect and defend against various emerging threats in the areas of Web Secu...
Big Data Infrastructure Engineer
The Big Data Team here at Zoom will allow you to work with other Big Data Engineers to ensure data ingestion and transformation occur smoothly. We are looking for a Big Data Infrastructure Engineer with automation skills to design and implement smooth function of data pipeline. Big Data Infrastructu...
Big Data Software Engineer
On behalf of our client, Procom Services is searching for a Big Data Software Engineer for a contract opportunity in Sunnyvale, CA. Big Data Software Engineer Job Details. Big Data Software Engineer Mandatory Skills. Big Data Software Engineer Assignment Length. ...
Big Data Hadoop Engineer
Strong project experience in Big Data, Cloudera Distribution7. Hands-onexperience in Big Data, Cloudera Distribution 7. Cloud Migration and Amazon EMR/Databricks/Cloudera CDP. Strongproject experience with Amazon EMR/Databricks/Cloudera CDP is must. ...
Data Engineer V: 24-02859
The ideal candidate will collaborate with cross-functional teams to define data requirements and develop robust data pipelines using Python for importing data into Snowflake. Extract data from REST APIs and manage data ingestion to cloud data warehouses. Primary Skills: Python (Expert), SQL (Ad...
Sr Principal Software Engineer (Data Plane, Networking, SASE)
As part of the Network Security dataplane team, you are responsible for developing and innovating solutions for Palo Alto Networks next-generation Firewalls and Prisma Access Cloud. Specifically in the areas of network security, high throughput networking, next generation cluster and data plane arch...
Principal Software Engineer-Observability Data Platform (US Remote) - 30144
Splunk is looking for an enthusiastic and innovative Principal Software Engineer to join our Observability Data Platform organization. As applications and systems become more sophisticated and user experience is at high stake, observability - the ability to monitor and understand the systems and how...