Principal Big Data Software

Job description

JOB LOCATION: 2900 W. Plano Pkwy. Plano, TX 75075 [Hybrid position] DUTIES: Produce batch and real time data pipelines for our network and NLP based use cases for our data scientists and other developers. Develop deep domain expertise and opportunities to expand your role into additional facets of data insights including modeling, extensive cloud-based environment architecting, and software development. Analyze, design, program, debug, and modify software enhancements and/or new products used in distributed, large-scale analytics, and visualization solutions. Work in a highly agile environment. Responsible for the development of high performance and distributed computing tasks using Big Data technologies such as Hadoop, NoSQL, text mining, and other distributed environment technologies in azure and on-prem. Work on Hadoop administration, Apache NiFi support, and Databricks workspace administration. Support the Network Intelligence Data Collect, AI Team, and their business partners. Responsible for automation of infrastructure using CICD/ansible or comparable technologies in Azure cloud. Set up secure vents and core infrastructure components in Azure. Work on UNIX administration. Su...