Search jobs > Boston, MA > Big data architect

Big Data Architect

ideaVat
Boston, Massachusetts, US
Full-time

Ideavat provides I.T staffing solutions, enabling companies & jobseekers engage successfully.

The experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below.

With over 20 man years of contingent staffing experience, the management & execution team is committed to provide customized staffing solutions to employers / hiring managers, helping them identify key talents.

Emergent technology staffing (UI / UX developers & designers, Mobility & Cloud Engineers, Big Data / Hadoop developers & architects & more) remains our primary focus!

Job Description

The emergence of big data is creating opportunities to develop data platforms that turn big data into big insights with tremendous value.

This role is critical in enabling these capabilities and providing business partners with the tools to make their decision making process more efficient and with greater speed.

This role will develop long-term technology and data strategies and shorter-term development and delivery plans to enable customers to Insight.

The candidate must be extremely results driven, customer focused, technologically savvy, and skilled at working in an agile development environment.

Key Responsibilities :

  • Develop the architecture for our Big Data & Analytics Platform to optimize the ingestion and management of varied sources of high volume data.
  • Define analytic architecture that leverages the Big Data Platform to enable advanced analysis capabilities.
  • Participate in the end to end delivery of business use-cases including data architecture to deliver results.
  • Design and build efficient yet cost-effective Big Data applications to help business partners answer their business questions.
  • Deliver as part of an agile team the ongoing platform architecture, build and maintenance.
  • Architect the data security, compliance and privacy methodology.
  • Provide leadership to data management and governance methodologies for the team.
  • Evaluate and present proposed architectures to enable platform with highest level of performance, garner leadership support and enable implementation.
  • Stay up to date on the relevant technologies, plug into user groups, understand trends and opportunities.

Required Demonstrable Skills :

  • Deep expertise is working with data all kinds, clean, dirty, unstructured, semi-structured.
  • Have hands-on experience with Cloudera Hadoop Administration (e.g. configuration management, monitoring, debugging, and performance tuning).
  • Strong experience with large cloud-compute infrastructure solutions such as Amazon Web Services, Google, Azure.
  • Experience managing the full lifecycle of a Hadoop Solution.
  • Experience creating the requirements analysis, the platform selection, design of the technical architecture, design of the application design and development, testing, and deployment of the proposed solution.
  • Experience with the major big data solutions like Hadoop, MapReduce, Hive, HBASE, MongoDB, Cassandra, Spark, Impala, Oozie, Mahout, Flume, ZooKeeper, Sqoop, etc.
  • Firm understanding of major programming / scripting languages like Java, Python, R, etc.
  • Extensive knowledge of UNIX / Linux.
  • Strong knowledge of SQL.
  • Experience in working with ETL tools such as Informatica, Talend and / or Pentaho.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and / or knowledge on NoSQL platforms.
  • Experience in Hadoop Platform Security and Hadoop Data Governance topics.
  • Experience in technical computing (optimization, statistics and machine learning).
  • Experience with analytics visualization software such as Tableau.

Qualifications :

  • Minimum of BS in Computer Science or similar field.
  • Must have at least 8-10 years’ experience in information management and application development.

Additional Information

All your information will be kept confidential according to EEO guidelines.

J-18808-Ljbffr

1 day ago
Related jobs
Promoted
ideaVat
Boston, Massachusetts

The emergence of big data is creating opportunities to develop data platforms that turn big data into big insights with tremendous value. Develop the architecture for our Big Data & Analytics Platform to optimize the ingestion and management of varied sources of high volume data. Emergent techno...

Schneider Electric
Massachusetts, MA, US

Experience must include at least some experience with the following skills: IoT architecture development; Communicating complex architectural topics to wider groups; Data architecture, including modeling, governance, metadata management, and data management; Architecting with different data types (m...

Promoted
Capital One
Bedford, Massachusetts

Ave (22130), United States of America, New York, New YorkSenior Software Engineer, DevOpsDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll b...

Promoted
PwC
Lynn, Massachusetts

Use multiple sources of information including broader stakeholder views to develop solutions and recommendations. ...

Promoted
Verizon
Boston, Massachusetts

Directing the gathering of data, assessing data validity and synthesizing data into large analytics datasets to support project goals. Analyzing structured and unstructured data using data mining/statistical/machine learning/deep learning tools, Data visualization, Digital/Web analytics tools and te...

Promoted
Global Partners LP
Waltham, Massachusetts

Lead the adoption of DataOps practices, fostering collaboration between data engineering, data science, and operations teams to streamline the entire data lifecycle. Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent experience in Data Engi...

Promoted
Clean Harbors
Norwell, Massachusetts

Develop and implement data integration processes, frequently using Azure Data Factory, to extract, transform, and load (ETL) data from various sources into Azure data warehouses or data lakes. This role involves working with various data storage options offered by Microsoft Azure, developing, and im...

Promoted
The Jones Payne Group Inc
Boston, Massachusetts

Project Architect | Project Manager. As Project Manager, you will play a pivotal role in the development of projects from concept through construction. Serve as Project Manager for projects throughout the country. We are a firm that works in both the public and private sectors, focusing on projects ...

Promoted
Jerry
Boston, Massachusetts

We are looking for a Data Scientist to help elevate our ability to scale customer demand by driving deep insights to inform our customer acquisition strategy. Reporting to our VP, Data Science and Analytics and partnering closely with our marketing, product, and business leaders, you will run analys...

Promoted
Pramand LLC
Bedford, Massachusetts

The Clinical Project Manager (CPM) leads the planning, coordination, and oversight of scheduled clinical activities. We self-fund our projects through preclinical development and work with financial partners for clinical development and commercialization. Maintain detailed daily coordination and sup...