Data Engineer (PySpark & AWS)

Job description

Who We Are Our client is a world-leading reinsurance and risk management company, delivering comprehensive solutions across insurance, underwriting, and data-driven risk assessment. With a strong focus on innovation and long-term stability, they support clients in addressing complex risks and driving sustainable value in an ever-changing global landscape. We are seeking a highly skilled AWS Data Engineer to enhance our data and analytics environment. The successful candidate will play a pivotal role in designing, developing, and managing data solutions that leverage cloud technologies and big data frameworks. This role will involve creating efficient data pipelines, optimizing data storage solutions, and implementing robust data processing workflows to ensure high-quality data availability for analytics and business intelligence. What you'll be doing: - Build and maintain large-scale ETL pipelines using AWS Glue, Lambda, and Step Functions. - Design and manage data lakes on Amazon S3, implementing robust schema management and lifecycle policies. - Work with Apache Iceberg and Parquet formats to support efficient and scalable data storage. - Develop distributed data processing workf...