Data Engineer - AI (Spark, Databricks and Healthcare)
Cotiviti · US
Overview At Cotiviti, we are custodians of data for our clients. Using their technical experience in ETL processes, Data Engineers ensure operational functio...
Job description
Overview At Cotiviti, we are custodians of data for our clients. Using their technical experience in ETL processes, Data Engineers ensure operational functions are occurring as expected. This includes but is not limited to managing data implementations, data integrations, data production, data quality, and data security. Responsibilities: This job description is intended to describe the general nature and level of work being performed and is not to be construed as an exhaustive list of responsibilities, duties and skills required. This job description does not constitute an employment agreement and is subject to change as the needs of Cotiviti and requirements of the job change. - Create, maintain and execute intermediate to advanced Spark scripts for data management and data validation, and data integration. - Create, maintain and execute basic to intermediate SQL scripts for data management and data validation. - Optimize the queries to improve the efficiency of daily tasks. - Perform data analysis and identify any issues. - Work with other groups such as Engineering team, DBA, Cloud ops, etc. to troubleshoot and resolve any environmental or network issues that impact your work....