SENIOR DATA ENGINEER*
NEW YORKER · Braunschweig, Lower Saxony, DE
THIS IS US The Data Science department uses state-of-the-art machine learning and optimization techniques to continuously improve business processes at NEW Y...
Job description
THIS IS US: The Data Science department uses state-of-the-art machine learning and optimization techniques to continuously improve business processes at NEW YORKER. We work in agile project teams on a variety of use cases, including image recognition, order optimization, pricing, distribution and logistics. We are a very ambitious and international team and are proud of our high standards. THAT'S THE JOB: - Design, implement and optimize effective data processing architectures in Python - Extract, transform, analyze, clean and model data from different sources - Implement and operate maintainable and reliable data pipelines using PySpark and Airflow with a strong focus on data quality - Strive to understand how the data is actually generated and what impact this has on data quality and our use cases through proactive communication with other departments - Operationalize machine learning pipelines together with a team of highly motivated data scientists - Architect and develop continuous integration & deployment processes - Operate and optimize Hadoop (Cloudera) clusters with support of the DevOps and Infrastructure teams - Mentor more junior team members through insightful code rev...