Senior Data Engineer - PySpark
AmeriLife · US
Our Company Explore how you can contribute at AmeriLife. For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of ann...
Job description
Our Company Explore how you can contribute at AmeriLife. For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of annuity, life and health insurance solutions for those planning for and living in retirement. Associates get satisfaction from knowing they provide agents, marketers and carrier partners the support needed to succeed in a rapidly evolving industry. Job Summary: The Senior Data Engineer will design and develop scalable data pipelines that support analytics, reporting, and AI initiatives across the enterprise data platform. Job Description: Key Responsibilities: - Build and maintain PySpark pipelines in Databricks - Develop scalable data ingestion and transformation workflows - Implement data validation and quality checks - Optimize Spark workloads and processing performance - Work closely with architecture and analytics teams Core Technical Skills: - Strong expertise in Python and SQL - Experience with PySpark, Spark, and Databricks - Experience building ETL/ELT pipelines - Strong understanding of data transformation and performance optimization Additional Expectations: - Strong communication and teamwork skills - Ability to collab...