AI Business Analyst

Job description

Job DetailsJob Location: Allied Benefit Systems - CHICAGO, IL 60606Position Type: Full TimeSalary Range: $120,000.00 - $150,000.00 SalaryJob Category: OperationsPOSITION SUMMARY: The AI Business Analyst will be responsible for evaluating whether Allied’s internal AI solutions are functioning as intended, identifying where they succeed and where they fall short, and translating those findings into clear, actionable feedback for product and engineering teams. ESSENTIAL FUNCTIONS: Evaluate AI capabilities integrated into core systems (e.g., Dynamics CRM, claims adjudication platform, document repositories) to determine whether they are functioning as intended and delivering expected business outcomes Investigate edge cases, anomalies, and failure patterns by reviewing raw data, logs, and system outputs Collaborate with technical product owners and SMEs to document what is and isn’t working, and help translate findings into user stories and product requirements Participate in model and capability reviews, providing business-level validation of AI behavior and identifying gaps in functionality or alignment with intended use Contribute to the development of test scenarios and evaluation...