Data Engineer - Senior

Job Description

Job Description

Halvik Corp delivers a wide range of services to 13 executive agencies and 15 independent agencies. Halvik is a highly successful WOB business with more than 50 prime contracts and 500+ professionals delivering Digital Services, Advanced Analytics, Artificial Intelligence / Machine Learning, Cyber Security and Cutting Edge Technology across the US Government. Be a part of something special!

The Contractor shall analyze requirements and design, code, test, debug, and document data pipelines. The Contractor shall have the ability take multiple data schemas to define a common data architecture to support multiple use cases. Their technical skills generally include multiple programming languages and a deep knowledge of SQL database design and NoSQL concepts. The data engineer role requires a more in-depth knowledge in programming for integrating complex models and using advanced software library frameworks to distribute large, clustered data sets. Data engineers collect and arrange data in a form that is useful for analytics. Data Engineers should be familiar with both streaming and batch models of data movement, aware of the trade-offs between the two, and able to apply that knowledge to solve for business and operational problems.

Responsibilities :

• Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources.
• Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and / or big data infrastructure.
• Create, document, and maintain optimal data pipeline architecture.
• Create, document, and maintain APIs; integrate with existing APIs where applicable.
• Create, document, and maintain data dictionaries, database and schema metadata for all data efforts.
• Build and maintain the infrastructure to support data movement Extraction, Transformation, and Loading (ETL), Extraction, Loading, and Transformation (ELT), Extraction, Loading, Transformation, and Loading (ELTL), as well as other data movement paradigms - of data from a wide variety of data sources.
• Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs, for data ingestion and integration.
• Configure and manage data analytic frameworks and pipelines using databases and tools such as (but not limited to) NoSQL, SQL, NiFi, Kafka, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Flink, Hadoop, Kafka, Hive, and others.
• Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms.
• Administrate cloud computing and CI / CD pipelines to include Azure, Google, and Amazon Web Service (AWS).
• Coordinate with stakeholders, including product, data and design teams to assist with data-related technical issues and support their data infrastructure needs

Qualifications :

Halvik offers a competitive full benefits package including :

Company-supported medical, dental, vision, life, STD, and LTD insurance

Benefits include 11 federal holidays and PTO.

401(k) with company matching

Flexible Spending Accounts for commuter, medical, and dependent care expenses

Tuition Assistance

Charitable Contribution matching

Halvik's pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

Halvik Corp is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status.

Halvik's pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.