Lead Data Engineer - Databricks
AmeriLife · US
Our Company Explore how you can contribute at AmeriLife. For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of ann...
Job description
Our Company Explore how you can contribute at AmeriLife. For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of annuity, life and health insurance solutions for those planning for and living in retirement. Associates get satisfaction from knowing they provide agents, marketers and carrier partners the support needed to succeed in a rapidly evolving industry. Job Summary: The Lead Data Engineer will play a key role in engineering the enterprise data platform on Databricks, building scalable pipelines and transformation frameworks that support enterprise analytics and AI initiatives. Job Description: Key Responsibilities: - Design and build scalable Databricks data pipelines - Develop ETL/ELT pipelines using PySpark - Implement data ingestion and transformation frameworks - Optimize Spark workloads for performance and scalability - Establish engineering standards and mentor engineers - Collaborate with architecture and analytics teams to enable data products Core Technical Skills: - Strong expertise in Python and SQL - Deep experience with Databricks, PySpark, and Spark - Experience building large-scale data pipelines - Strong understanding o...