Sr. Data Engineer

Job description

Sr. Data Engineer Pay: Competitive: Shift: Monday - Friday 8am - 5pm JOB SUMMARY: The ideal candidate will possess strong background on Data Engineering development technologies & experience with cloud-based resources. The candidate must possess excellent written and verbal communication skills with the ability to collaborate effectively with domain experts and technical experts in the team. This role will be responsible for both team collaboration as well as project initiative ownership and leadership. This role is for contributing to both technical expertise as well as process leadership. An Azure Databricks Engineer designs, builds, and optimizes scalable data pipelines and lakehouse solutions within the Microsoft Azure ecosystem. Core Responsibilities: - Data Engineering & ETL: Develop and maintain batch/streaming data pipelines using Azure Databricks, Azure Data Factory and PowerBI - Azure Integration: Integrate Databricks with (ADLS), Power-BI, ADO, Key Vault - Performance Optimization: Optimize Spark jobs, cluster configurations, Serverless Policy & Cost Optimization - Data Governance & Security: Implement Unity Catalog for access control, data lineage, and security complian...