Data Engineer
Civeo · Brisbane, Queensland, AU
KEY RESPONSIBILITIES - Design, build and maintain scalable ETL/ELT data pipelines for structured and unstructured data from various data sources. - Develop a...
Job description
KEY RESPONSIBILITIES: Design, build and maintain scalable ETL/ELT data pipelines for structured and unstructured data from various data sources. Develop and maintain central data warehouses, data lakes and other data storage solutions. Work with business stakeholders in Asia-Pacific (Australia) and North America to design, build and maintain data products for business use-cases. Develop and implement advanced analytical solutions including machine learning models and predictive analytics. Integrate data from a variety of internal and external sources to support analytics, reporting and operational processes. Collaborate with Data Architect, Analysts and business stakeholders to understand requirements and translate them into technical solutions. Monitor, troubleshoot and optimise data pipelines for performance and reliability. Ensure data quality, security, integrity and consistency across systems through effective governance practices. Document technical processes, data flow, and design decisions. Support data migrations and modernisations from legacy systems to cloud or modern platforms and other projects. Follow best practices in data engineering, including automation, version c...