Search jobs > Indianapolis, IN > Senior data engineer

Senior Data Engineer

Acxiom
Indianapolis, IN, United States
Full-time

At Acxiom, our vision is to transform data into value for everyone. Our data products and analytical services enable marketers to recognize, better understand, and then deliver highly applicable messages to consumers across any available channel.

Our solutions enable true people-based marketing with identity resolution and rich descriptive and predictive audience segmentation.

We are seeking an experienced Data Engineer with a versatile skill set to undertake data engineering efforts to build the next-generation ML infrastructure for Acxiom’s business.

As part of the Data Science and Analytics Team, the Sr. Data engineer will partner with Data Scientists, work hands-on with Big Data technologies and build scalable data pipelines / infrastructure to support development of health care propensity models.

The Sr. Data engineer’s responsibilities include collaborating with internal and external stakeholders to identify data ingestion, processing, ETL, data warehousing requirements and develop appropriate solutions using modern data engineering stack in cloud.

Success in this role comes from combining a strong data engineering background with product and business acumen to deliver scalable data pipeline and database solutions that can enable & support a high performant, large scale modeling infrastructure at Acxiom.

The Sr. Data Engineer will be a champion of the latest Cloud database technologies & data engineering tools.What you will do : Partner with Cloud Architects, Data scientists to build scalable, next generation data pipelines for health care model development, model management and governance in CloudBe a thought leader and champion for adoption of new cloud-based database technologies and enable migration to new cloud-based modeling stackCollaborate with other data scientists and team leads to define project requirements & build the next generation data source ingestion, ETL, data pipelining, data warehousing solutions in CloudBuild data-engineering solutions by developing strong understanding of business and product data needs.

Develop close partnership with internal stakeholders and partners from Engineering, product, and businessBuild expert knowledge across various data sources Acxiom health data sources, Acxiom proprietary data (demographics, psychographics, lifestyle segments), Survey / Panel data, media content activity (TV, Digital, Mobile), and product purchase or transaction data and develop solutions for seamless ingestion and process of the dataResolves defects / bugs in data pipelines during QA testing, pre-production, production, and post-release.

Contributes to the design and architecture of services across the data landscapeParticipation in development of the integration team, contributing to reviews of methodologies, standards, and processes.

Comprehensive internal documentation of designs and service componentsRequired Skills : 6+ years of data engineering experience with at least 4+ years’ experience working with healthcare data sources and developing large-scale data pipelines in the healthcare vertical.

Experience Designing and implementing Large Scale Snowflake Data Pipelines involving Terabytes of data. Strong expertise in optimizing snowflake SQL queries, resource allocation, and improving query performance.

Knowledge of implementing role-based access controls and data encryption measures, ensuring the security and protection of dataStrong background in data pipelining, warehousing, ETL development solutions for data science and other Big Data applications6+ years working with large-scale terabyte scale data sources.

Ability to work independently, understand & develop complex data solutionsKnowledge of ML algorithms, model development processes, and prior experience creating data solutions to support large-scale modeling efforts.

Experience with distributed, columnar and / or analytic oriented databases or distributed data processing frameworks.Minimum of 3 years of experience with Cloud databases AWS Redshift, Snowflake, Azure SQL database, Google Cloud SQL or similar.

Experience with NoSQL databases such as mongoDB, Cassandra or similar is a plusMinimum of 4 years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, data lake and data warehouse solutionsMinimum of 4 years of hands-on experience in Big Data technologies such as, PySpark, Spark / SparkSQL, Dask or similar distributed compute frameworks.

Knowledge of streaming technologies such as Kafka, Spark Streaming Ingestion API is a plusStrong programming skills using Python, PySpark, Scala, Java or similarExperience with container-based application deployment frameworks (Kubernetes, Docker, ECS / EKS or similar)Experience with Data Visualization tools such as Tableau, Looker or similarOutstanding troubleshooting, attention to detail, and communication skills (verbal / written) in a fast paced setting.

Bachelor’s degree in computer science or relevant discipline or 6-7 years of relevant work experience.Solid communication skills : Demonstrated ability to explain complex technical issues to technical and non- technical audiences.

Strong understanding of the Software design / architecture process.Experience with unit testing and data quality checksWhat will set you apart : Preferred Skills : Snowflake Certification Preferred.

Ability to work in white space and be able to develop solutions independently.Prior experience with Cloud based ETL tools such as AWS Glue, AWS Data pipeline or similarExperience with building real-time and streaming data pipelines a plusExperience with MLOps tools such as Apache MLFlow / KubeFlow is a plusExposure to E2E ML platform such as AWS Sagemaker, Azure ML studio, Google AI / ML, Datarobot, Databricks or similar a plusExperience with ingestion, processing and management of 3rd party dataPrimary Location City / State : Homebased - Conway, ArkansasAdditional Locations (if applicable) : ConwayAcxiom is an affirmative action and equal opportunity employer (AA / EOE / W / M / Vet / Disabled) and does not discriminate in recruiting, hiring, training, promotion or other employment of associates or the awarding of subcontracts because of a person's race, color, sex, age, religion, national origin, protected veteran, military status, physical or mental disability, sexual orientation, gender identity or expression, genetics or other protected status.

Attention California Applicants : Please see our CCPA / CPRA Privacy Act notice here (https : / / / / www.acxiom.com / wp-content / uploads / 2023 / 01 / CCPA-CPRA-Notice-for-Employees-Eff-01012023.

pdf) .Attention Colorado, California, Connecticut, Maryland, Nevada, New York City, Ohio, Rhode Island, and Washington Applicants : This position is not located in the aforementioned locations but applications for remote work may be considered.

For information about this role under state or local equal pay or pay transparency laws, please contact recruit@acxiom.com .

We are leaders in helping brands achieve the number one mantra for every business know your customer. For fifty years, we’ve helped marketers deal with a fast-changing future of growing channels, data and technology.

By understanding the customer, marketers can communicate with relevance everywhere and drive better customer experiences that build a better brand and, in turn, better business.

We’re one of the marketing industry’s most experienced, respected and forward-thinking leaders. For nearly fifty years, we’ve helped the world’s best marketers understand their customers so that they can reach people with relevance rather than randomness.

Our products and solutions form the data foundation that make it possible for marketers to drive better customer experiences and meaningful interactions at scale across every channel.

Our job opportunities will give you the opportunity to showcase your talents, grow your skills, and expose you to cutting-edge technologies, whether you’re an engineer, developer, products guru, systems and security expert, sales and consulting executive, or an intern looking to gain real experience with a company that will make you stand out.

At Acxiom, our values begin with our associates, who are the single most important driver of our success. We’re looking to hire people who share our core values : collaboration, excellence, innovation, a focus on outcomes, and being empowered to make and own decisions that benefit our clients and our company.

Our values represent our brand promise to our clients and to our associates and define our company culture.If you are interested in applying for employment with Acxiom and need special assistance or an accommodation to apply for a posted position, contact our recruiting department at 1-877-314-2049.

We highly recommend you create an account to monitor your resume submissions. Click on the Sign In link above to create an account or sign up at the end of your application.

Interested in Acxiom? Learn about our Equal Opportunities, job postings, and more : About Us ()Follow Us on TwitterFind Us on Facebook ()Careers PageLinkedIn ()Internal applicants need to apply for open positions through their Workday account.

Please log into Workday and use the Find Jobs report to search for and apply for positions posted internally. For questions, please contact the recruiter listed on the job posting.

Attention California Applicants : Please see our CCPA / CPRA Privacy Act notice here () .Attention Colorado, California, Connecticut, Maryland, Nevada, New York City, Ohio, Rhode Island, and Washington Applicants : This position is not located in the aforementioned locations but applications for remote work may be considered.

For information about this role under state or local equal pay or pay transparency laws, please contact recruit@acxiom.com .

Attention Mexico Applicants : Please see our Privacy Policy notice here () .

15 days ago
Related jobs
Promoted
Forte Group
IN, United States

The ideal candidate will play a crucial role in designing and building data pipelines, ensuring data is accessible and useful for data analysis and business intelligence purposes. If you are passionate about data engineering and enjoy creating efficient data structures, we'd love to hear from you. C...

Promoted
Brooksource
Indianapolis, Indiana

The Senior Data Engineer will be part of a team of data and technical professionals responsible for planning, developing, deploying, implementing, and maintaining data solutions and database infrastructures. Ability to build complex business database systems, handling data in motion and at rest, and...

Promoted
BDO USA, LLP
Indianapolis, Indiana

Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...

Promoted
GovCIO
Indianapolis, Indiana
Remote

Data Engineer to provide their hands-on experience building medical data ingestion pipelines and conditioning processes for our Department of Veteran Affairs client. Employing effective data cleansing and integrity strategies to address patient safety issues, incorrect or missing data sets, and data...

Promoted
Acxiom
Indianapolis, Indiana

What you will do:Partner with Cloud Architects, Data scientists to build scalable, next generation data pipelines for health care model development, model management and governance in CloudBe a thought leader and champion for adoption of new cloud-based database technologies and enable migration to ...

Promoted
Oracle
Indianapolis, Indiana

We're looking for a highly skilled experienced engineers to design and build high-scale, cloud-based data processing systems that can handle massive amounts of data with low latency. As part of this team, you will accelerate several architectural efforts - achieve orders of magnitude data processing...

Promoted
Salesforce
Indianapolis, Indiana

We’re looking for an experienced and committed data engineer to build data pipelines and metrics for sales and marketing organization. The candidate will also have strong operational skills to drive efficiency and speed, expertise building repeatable data engineering processes, strong project manage...

Sarnova HC, LLC
Indianapolis, Indiana
Remote

Data Center Engineer Role! Summary: The Senior Data Center Engineer is responsible for effectively provisioning, installing/configuring, operating, and maintaining data center hardware, software, and related systems. Data Center Engineer Role! Summary: The Senior Data Center Engineer is responsible ...

GEICO
Indianapolis, Indiana

Our Senior Engineer is a key member of the engineering staff working across the organization to provide a friction-less experience to our customers and maintain the highest standards of protection and availability. GEICO is seeking an experienced Senior Engineer with a passion for building high-perf...

Milliman
Indianapolis, Indiana

We are seeking a seasoned Senior Data Engineer proficient in Spark and SQL to spearhead the design and enhancement of our data infrastructure. Minimum of 5 years of proven experience as a Data Engineer, with strong command of Databricks/Spark. Develop and uphold scalable data architectures utilizing...