Team Leader - Software

Job description

- Design, develop, and optimise data pipelines using Snowflake services - Work extensively with Snowflake Internal and External Stages for secure data loading and unloading. - Develop and manage data ingestion processes using: COPY INTO commands, File formats, Snowpipe if applicable,Data loading from internal stages - Develop complex SQL queries, stored procedures, tasks, streams, and performance tuning - Ensure data quality, integrity, and security across systems - Collaborate with cross functional teams including analysts, BI developers, and stakeholders. - Use Python for data transformation, automation, and scripting tasks. - Implement and manage CI/CD pipelines using GitLab CI/CD for automated deployment of data solutions. - Maintain version control and manage code repositories using GitLab. - Work with orchestration tools. - Monitor, troubleshoot, and optimise data pipeline performance issues.