Search jobs > Saint Paul, MN > Permanent > Senior data engineer

Senior Data Engineer (Database Administrator 2)

Metropolitan Council
Saint Paul, MN, United States
$89K-$144.4K a year
Full-time

WHO WE ARE

This position is eligible for a hybrid (both remote and onsite) telework arrangement. Candidate's permanent residence must be in Minnesota or Wisconsin.

We are the Metropolitan Council, the regional government for the seven-county Twin Cities metropolitan area. We plan 30 years ahead for the future of the metropolitan area and provide regional transportation, wastewater, and housing services.

More information about us on our website.

We are committed to supporting a diverse workforce that reflects the communities we serve.

Information Services is the central IT department supporting all divisions of the Metropolitan Council. Our 140 team members provide technology, practices, and innovative solutions that enable the core services of the Council.

This posting will fill up to two (2) vacancies.

How your work would contribute to our organization and the Twin Cities region :

The Senior Data Engineer designs, develops, and maintains data solutions. This includes databases, data platforms, data lakes, data warehouses, and data marts as well as data movement (data pipelines / ETL / ELT - extracting, transforming, and loading data).

They collaborate with technology and business units to create solutions that make data available to systems and / or data consumers, such as developers, data scientists, business analysts, or line-of-business users.

They may also integrate data including analytics and data science outputs into existing business processes or systems.

The Senior Data Engineer ensures the security, performance, and availability of these data solutions. They administer data tools and identify and resolve data quality issues.

The ideal candidate for the position has a high degree of expertise in data platform and database technologies, data modeling, structured and unstructured data, and strong programming skills.

They have strong communication skills, with experience working on small to large and highly complex initiatives. The ideal candidate has a proven track record of developing successful data strategies, and is a strong teammate, who can effectively listen, lead and mentor others.

Benefits : Great work / life balance, insurance starting on day one, MN State Retirement Program pension, in-house clinic, salary continuance for injury or illness, 13 paid holidays per year plus generous annual leave, employee development, free Metro Transit rides, and much more!

Full Salary Range : $42.79 - $69.41 hourly / $89,003 - $144,373 annually

What you would do in this job

  • Collaborate with technology and business stakeholders to determine data needs.
  • Design, develop, and maintain data solutions for operations, reporting, and analytics, including databases, data platforms, data lakes, data warehouses, and data marts.
  • Develop data solutions using various software methodologies including waterfall and agile.
  • Write and understand complex SQL queries and define best practices.
  • Design, develop, and maintain data integrations between source and target systems.
  • Understand and implement data security and data classifications.
  • Innovate and leverage emerging technologies and participate in strategic planning.
  • Provide ongoing database administration, maintenance, monitoring, and support.
  • Install and configure database software and drivers on servers and clients.
  • Setup monitoring and alerting of data solutions.
  • Script, automate, configure, and monitor data processes.
  • Maintain backups, continuity of operations, high availability, and disaster recovery.
  • Monitor data security, encryption, authentication, authorization, logging, and audits.
  • Complete database performance tuning, patching, and upgrades.
  • Maintain non-production data environments including data refreshes.
  • Manage database compression, capacity, and licenses.
  • Troubleshoot database, data integration, or application issues related to data.
  • Build and maintain modern cloud data platforms for reporting and analytics.
  • Partner with business intelligence and analytics developers on reporting and visualizations.
  • May integrate with a variety of internal and external data sources such as APIs, Web Services, and Integration Platform as a Service.
  • May work with data streaming and messaging services to move data between systems.
  • May lead a technical team.

What education and experience are required for this job (minimum qualifications)

Any of the following combinations of education (in Computer Science / Engineering, Information Technology, or related) and directly related experience :

  • Master's degree and three (3) years of experience.
  • Bachelor's degree and five (5) years of experience.
  • Associate's degree and seven (7) years of experience.
  • High school diploma / GED and nine (9) years of experience.

Knowledge, Skills, and Abilities Required :

  • Gathering, understanding, and analyzing stakeholder requirements, needs, and objectives.
  • Data development methodologies, best practices, standards, and procedures.
  • Experience writing and tuning complex SQL queries and defining SQL best practices.
  • Installation and configuration of database software and drivers on servers and clients.
  • Data modeling, database normalization, and denormalization techniques.
  • Designing, developing, and maintaining data solutions for operations, reporting, and analytics (databases, data platforms, data lakes, data warehouses, and data marts).
  • Database administration and security, maintenance, monitoring, and support (SQL Server, Oracle and Sybase ASE).
  • Designing, developing, and maintaining data integrations (data pipelines / ETL / ELT - extracting, transforming, and loading data) using various types of data sources and targets.
  • Programming language knowledge with at least one scripting language.
  • ITIL, Incident, Service and Change Management, including SLAs and metrics.

What additional skills and experience would be helpful in this job (desired qualifications) :

  • Experience developing data solutions for the cloud.
  • Modern cloud data platform experience.
  • Experience with APIs, Web Services, and Integration Platform as a Service.
  • Data streaming and messaging experience.
  • Reporting and data visualization experience.
  • Experience leading a technical team.
  • Experience working and collaborating with individuals from diverse backgrounds.

What you can expect from us :

  • We offer the opportunity to make a difference and positively influence the Twin Cities metropolitan area.
  • We encourage our employees to develop their skills through on-site training and tuition reimbursement.
  • We provide a competitive salary, excellent benefits and a good work / life balance.

More about why you should join us!

Additional information

Union / Grade : AFSCME / Pay Grade I

FLSA Status : Exempt

Safety Sensitive : No

Work Environment :

Work is performed in a standard office setting. Requires travel between primary work site to other sites.

The responsibilities listed are typical of the positions included in the job classification; however, not all duties are necessarily performed by each specific position.

Reasonable accommodation may be made to enable individuals with disabilities to perform the essential duties of the position.

Regular attendance is an essential responsibility.

Security Policy :

This position involves direct access to Criminal Justice Information (CJI) as defined by the FBI CJIS (Criminal Justice Information Services) Security Policy.

In accordance with section 5.12.1.1 of the FBI CJIS Security Policy, final candidates if applicable must be willing to submit to a state of residence and national fingerprint-based record check.

If the result of the record check reveals criminal convictions, the nature and circumstances of those convictions will be reviewed by the Metropolitan Transit Police Department and / or the Minnesota Bureau of Criminal Apprehension to determine if access to Criminal Justice Information would be permissible.

If it is determined that access to Criminal Justice Information would not be permissible, the candidate will no longer be eligible for this position.

If you are new to the Metropolitan Council , you must pass a drug test (safety sensitive positions only), and a background check which verifies education, employment, and criminal history.

A driving record check and / or physical may be conducted if applicable to the job. If you have a criminal conviction, you do not automatically fail.

The Metropolitan Council considers felony, gross misdemeanor and misdemeanor convictions on a case-by-case basis, based on whether they are related to the job and whether the candidate has demonstrated adequate rehabilitation.

If you are already an employee of the Metropolitan Council , you must pass a drug test (if moving from a non-safety sensitive position to a safety sensitive position) and criminal background check if the job you're applying for is safety sensitive, is a supervisory or management job, is in the Finance, Information Services, Audit, or Human Resources departments, or has access to financial records, files / databases, cash, vouchers or transit fare cards.

A driving record check and / or physical may be conducted if applicable to the position.

IMPORTANT : If you make a false statement or withhold information, you may be barred from job consideration.

The Metropolitan Council is an Equal Opportunity, Affirmative Action, and veteran-friendly employer. The Council is committed to a workforce that reflects the diversity of the region and strongly encourages persons of color, members of the LGBTQ community, individuals with disabilities, women, and veterans to apply.

If you have a disability that requires accommodation during the selection process, please email [email protected]

14 days ago
Related jobs
Promoted
Olsson Associates Inc.
Minneapolis, Minnesota

Senior Electrical Engineer - Data Center. We are Olsson, a team-based, purpose-driven engineering and design firm. As an Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. You will serve as an electrical engineer on p...

Target
Minneapolis, Minnesota

Senior Data Engineer- Roundel Data Solutions (Cyclone). As a Senior Engineer, you serve as a specialist in the engineering team that supports the product. We are a core data platform team focused on the curation and optimization of data resources used by the Marketing teams at Target. Embed data qua...

Promoted
Olsson Associates Inc.
Minneapolis, Minnesota
Remote

Senior Electrical Engineer - Arc Flash - Data Center (Remote). As a Senior Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. We are Olsson, a team-based, purpose-driven engineering and design firm. You will serve as ...

Cognizant
Stillwater, Minnesota
Remote

Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence. Spearheads data engineering initiatives targeting moderately to complex data and analytics challenges, delivering impactful outcomes through comp...

Olsson
Minneapolis, Minnesota

We are Olsson, a team-based, purpose-driven engineering and design firm. As an Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. You will serve as an electrical engineer on projects, design calculations, write techni...

Abbott
Saint Paul, Minnesota

You’ll work collaboratively with other IT operational and software engineering teams to deploy and operate our systems/platforms and support client utilization. Maintain accurate current state application architecture diagrams, documentation, and other data sources in a consistent and replicable man...

BDO
Minneapolis, Minnesota

Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...

Travelers
Saint Paul, Minnesota

Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Senior Associate Data Engineer you will help guide growth an...

GEICO
Minneapolis, Minnesota
Remote

Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Senior Staff Engineer – Finan...

Olsson
Minneapolis, Minnesota
Remote

As a Senior Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. We are Olsson, a team-based, purpose-driven engineering and design firm. You will serve as an electrical engineer on projects, design calculations, write ...