Senior Product Data Scientist, Google Home Quality and Intelligence

Job description

Minimum qualifications: - Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field. - 8 years of experience using analytics to solve product or business problems, performing statistical analysis, and coding (e.g., Python, R, SQL) or 5 years of experience with a Master's degree. - Experience in causal inference analysis. Preferred qualifications: - Master's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field. - Experience in large language model (LLM) quality assessment and evaluation, including human evals and LLM-as-judge autoraters. About the job: Google Home is transitioning from a reactive tool, driven by voice commands and simple logic, to a proactive, autonomous agent powered by Gemini. The Home Quality and Intelligence Data Science team is seeking a Senior Data Scientist to support this transition. In this role, you will collaborate with a team of executive practitioners to build the evaluation frameworks that quantify "intelligence" and "reliability" in non-deterministic environments. You will interpret how product and engineering choices impact...