Data Engineer

Job description

Purpose of Job: The Data Engineer will have the responsibility for the design and maintenance of enterprise data warehouse for various projects, as well as providing on-going support for activities impacting all enterprise databases. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, Azure Synapse, Azure Function App, Logic App, REST APIs, mapping dataflow, and Event Hub. As a key member of our team, you will collaborate with various stakeholders to ensure efficient data flow, storage, and integration, while employing best practices in data engineering. Main Activities: · Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform. · Develop and optimize T-SQL and Python-based data processing scripts and integrate them with Synapse pipelines for ETL tasks and data transformations. · Design and develop mapping dataflow solutions for complex data transformations. · Develop and maintain data storage solutions, ensuring efficient data retrieval and storage on Azure Data Lake and databases. · Implement and maintain API integrations, including REST APIs, for seamless data flow...