Data Engineer II - Wherescape
Capital Blue Cross · Harrisburg, Pennsylvania, US
Position Description The Data Engineer II designs and maintains scalable cloud-based data pipelines and models to support reliable data products.
Job description
Position Description The Data Engineer II designs and maintains scalable cloud-based data pipelines and models to support reliable data products. This role involves hands-on ELT development, data quality assurance using the Audit, Balance, Control (ABC) framework, and consultative collaboration with analysts and stakeholders. It requires strong SQL and Python skills, experience with cloud data tools and modeling techniques, and a proactive, agile approach to data engineering and governance. Responsibilities and Qualifications: Skills: Knowledge: Experience: - Build, refactor, and maintain pipeline components of data products for a cloud environment. - Own the ingestion, storage, cleansing, profiling, transformation, and presentation of data products. - Analyze large and complex datasets for quality, accuracy, anomalies, and performance. - Own pre-UAT testing for every change using the standard ABC framework. - Consultatively interface with analysts and stakeholders on new data requests, enhancements, recommendations, quality, and awareness items. - Assess project-specific integration restrictions/options and recommend load strategy, storage targets, data access layer model, and sol...