Our mission is to service with Integrity as both an employer of choice to our associates and a strategic partner to our clients.
IRI’s vision is to become an industry-leading staffing services organization by maintaining ethical business practices, a passion for customer service, a commitment to quality, and our continued efforts to exceed expectations.
Job Description
Job Title : Big Data Platform Staff Engineer
Make sure to apply with all the requested information, as laid out in the job overview below.
Duration : 6 Months
Location : Santa Clara, CA
Job Description : As a core developer, you will be part of the team that focuses on the next generation Clients’ Big Data Platform.
Your primary responsibility includes developing big data tools that facilitate various consumers (users or programs), in terms of optimizing or automating the system.
In particular, you will be developing tools for handling big data metadata, extracting metadata and importing them into Clients’ big data platform, and synchronizing metadata across several metastores.
You will also be developing algorithms to analyze query workload and generate recommendations (advisors) on optimizing the various system components and structures.
You will also perform testing, analyzing, and optimizing the Big Data Platform performance. The position involves strong problem-solving and analytical nature, and excellent verbal and written communication skills.
Requirements :
BS or higher degree in Computer Science or related field.
5+ years of software development experience, including performance analysis.
Strong SQL knowledge (JDBC) in query processing, optimization and execution, query performance, Explain, database tooling.
Spark / SparkSQL is a big plus.
Excellent coding skills in Scala / Java and scripting languages; UI skill a big plus.
Hands-on experience in Big Data Components / Frameworks, such as Hadoop, Spark, HBase, HDFS, Hive, NoSQL databases etc.
Experience in other distributed system components, such as Solr, Elasticsearch, Logstash, Kibana, Kafka, REST API, etc. is a plus.
Key Responsibilities :
Develop tools that extract / import / synchronize metadata.
Develop tools that analyze query workload, derive common workload characteristics, generate recommendations for optimizing the system usage, and measure the benefits (advisors).
Analyze performance and scalability of the system, typically across a variety of software configurations.
Testing (and automated testing) of developed code.
J-18808-Ljbffr
Big Data Platform Staff Engineer
In particular, you will be developing tools for handling big data metadata, extracting metadata and importing them into Clients’ big data platform, and synchronizing metadata across several metastores. Big Data Platform Staff Engineer. As a core developer, you will be part of the team that focuses o...
Senior Engineer Data Platforms
A company is looking for a Senior Engineer, Data Platforms to enhance their data processing infrastructure and analytics capabilities. ...
AIML - Staff Machine Learning Infrastructure Engineer, ML Platform & Technology
Here, you'll do more than join something - you'll add something! As a Staff Engineer on ML Compute Team, you'll join a phenomenal team of hardworking engineers and will be entrusted with a range of responsibilities. We are looking for an experienced software engineer who is excited by the opportunit...
Staff, Data Engineer
Certifications in performance engineering or relevant cloud platforms is a plus. We're a team of 15,000+ software engineers, data scientists and service professionals within Walmart, the world's largest retailer, delivering innovations that improve how our customers shop and empower our 2. Join our ...
Sr. Software Engineer (Data), Ai & Data Platforms
Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day-to-day basis? If so, Apple's Artificial Intelligence and Data Platforms (AiDP) team is seeking an expert Software Engineer to build high quality, scalable and resilient distributed systems t...
Google Cloud Platform Data Engineer - Sunnyvale, CA/Bentonville, AR (Hybrid) - CH
Google Cloud Platform Dataproc, GCS & BIGQuery experience. Role: Google Cloud Platform EngineerLocation: Sunnyvale, CA/Bentonville, AR (Hybrid)Duration: 12+ MonthsRequirements:. Experience building data pipelines in Google Cloud Platform. Google Cloud Platform experience. ...
Software Engineer - Big Data Privacy
We integrate our functionalities deeply into Apache's big data ecosystem (Spark, Hive, Presto), and build world-class data security & privacy framework to support high efficient and seamless data life cycle management. Responsibilities• Build full life-cycle data privacy solutions across various big...
Staff, Data Engineer
Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master’s degree in Computer Science or related field and 4 years' experience in software engineering or related field, We value candidates with a background ...
Software Engineer (AI/ML), Ai & Data Platforms
Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day to day basis? If so, Apple’s AI & Data Platform (AiDP) team is seeking a Software Engineer to work on building and scaling best in class data and reporting apps presenting metrics & performa...
Staff Engineer – Platform as a Service, Messaging
Platform as a Service (PaaS) Messaging Team seeks an experienced Staff Engineer passionate about building highly scalable distributed platforms. Familiarity with big data and streaming data architectures, data warehousing solutions, Hadoop, and ETL pipelines is a plus. Our Staff Engineer collaborate...