Senior Data Engineer

Job description

ING Hubs Poland is hiring! The expected salary for this position: 13000 - 28000 PLN The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations. We are looking for you if You: - have hands-on experience with Hadoop ecosystem and related tools with strong proficiency in Confluent Kafka for real-time data streaming - have expertise in Java/Scala, Python and Ansible for data engineering and platform development - are experienced in building batch and streaming data pipelines using Apache Nifi and Spark - are proficient in building microservices and event driven architecture - have proven experience in designing and implementing highly available, scalable, and fault-tolerant data platforms - can define and implement the infrastructure required for optimal loading of data from a wide variety of data sources using big data technologies. - have worked in DevOps environment (CI/CD with Azure DevOps, Test Automation, Docker/Kubernetes) - have good understanding of CI/CD concepts and Elastic based monitoring solutions - demonstrate a knowledge of relational database concepts, design and performance tuning. - have kno...