Senior Data Scientist, AI

at Baylor Scott & White Health in Boise, Idaho, United States

Job Description

JOB SUMMARY

· The Senior Data Scientist, AI executes data science, machine learning, statistical modeling, generative AI, agentic AI, evaluation, and advanced analytics work required to power BSWH’s priority AI use cases and workflow-enabled solutions.

· This role partners closely with AI Product Managers, Data Product Managers, AI Engineers, Software Engineering, Ontology and Knowledge teams, Quality Engineering, Clinical, Operations, Digital, Journey, Privacy, Security, and Governance stakeholders to translate business and clinical questions into rigorous data science solutions.

· The role develops predictive and statistical models, LLM- and agent-based capabilities, analytical frameworks, evaluation approaches, outcome measures, and reusable AI/data science assets that help AI-enabled products improve customer experience, operational efficiency, clinical workflows, personalization, decision support, and enterprise performance.

· This role is expected to combine strong statistical and machine learning skills with hands-on generative AI and agent engineering capabilities, practical product judgment, healthcare data fluency, and the ability to translate ambiguous problems into deployed solutions that work in real operational workflows.

· The Senior Data Scientist, AI reports to the Vice President, Data Science and may operate as either a senior individual contributor or a small-team technical lead, depending on assigned domain and portfolio needs.

ESSENTIAL FUNCTIONS OF THE ROLE

AI Use Case Data Science Delivery

· Translate AI use-case objectives into data science problem statements, modeling approaches, analytical plans, success metrics, and execution roadmaps.

· Develop predictive models, classification models, segmentation approaches, personalization methods, statistical analyses, causal inference approaches, optimization models, simulations, or other traditional data science methods, and combine them with LLM- and agent-based approaches when appropriate to support AI use cases.

· Partner with product, engineering, data, ontology, and clinical/operational stakeholders to ensure data science work is aligned to real workflow needs and measurable outcomes.

· Rapidly prototype, validate, iterate, and productionalize data science, generative AI, and agentic methods in partnership with engineering and platform teams, with a bias toward delivering working capabilities into real user workflows.

Model Development, Validation & Evaluation

· Build, evaluate, tune, and monitor data science and machine learning models using appropriate statistical, ML, and AI methods.

· Define model success criteria, comparison benchmarks, holdout strategies, validation methodologies, error analysis approaches, and ongoing monitoring expectations.

· Develop evaluation approaches for AI-enabled products, including performance measurement, quality thresholds, subgroup analysis, drift detection, fairness considerations, and operational impact tracking.

· Ensure modeling outputs are interpretable, reliable, well-documented, and appropriate for the risk and decision context of the use case.

Generative AI, Agentic AI & Workflow Solution Delivery

· Design, build, evaluate, and deploy LLM-powered applications and agentic solutions, including retrieval-augmented generation (RAG), tool/function calling, structured outputs, reasoning workflows, and multi-step agent patterns.

· Build and orchestrate agents that combine enterprise data, analytical models, APIs, business rules, knowledge/ontology assets, and software tools to perform useful work across analytics, decision support, and operational workflows.

· Select and apply appropriate agent architecture patterns, including single-agent and multi-agent approaches, routing, planning, delegation, memory/context management, human-in-the-loop controls, and deterministic workflow components where reliability requires them.

· Develop and maintain agent tools, prompts/instructions, context and retrieval strategies, orchestration logic, guardrails, and interfaces that enable LLMs and agents to interact safely and reliably with enterprise systems and workflows.

· Create evaluation suites for LLM and agent behavior, including task success, groundedness, factuality, tool-use correctness, workflow completion, latency, cost, safety, robustness, and regression testing; use evaluation results to iteratively improve deployed capabilities.

· Work directly with product, engineering, clinical, and operational partners to understand real-world processes, rapidly prototype solutions in context, and evolve prototypes into production capabilities that measurably improve analytics or workflow execution.

Healthcare Data, Feature Engineering & Analytical Assets

· Work with enterprise healthcare datasets, including clinical, operational, customer, scheduling, claims, financial, digital, journey, or other data domains required to support AI use cases.

· Partner with Data Product Managers and data engineering teams to define required data elements, feature sets, data quality expectations, latency/freshness requirements, lineage needs, and remediation priorities.

· Create reusable features, cohorts, labels, datasets, metrics, and analytical assets that can support multiple AI use cases and reduce rework across teams.

· Evaluate data quality, missingness, representativeness, bias, leakage, measurement error, and other data limitations that affect model validity and business interpretation.

Experimentation, Measurement & Business Impact

· Design analytical frameworks to measure the value of AI-enabled products, including adoption, user behavior, customer experience, clinical or operational outcomes, efficiency gains, and financial impact.

· Support A/B testing, quasi-experimental design, causal inference, uplift modeling, attribution, cohort analysis, and longitudinal measurement where appropriate.

· Develop dashboards, monitoring views, analytical narratives, and executive-ready insights that help stakeholders understand whether AI use cases are working as intended.

· Partner with product and operational leaders to translate analytical results into prioritization decisions, product improvements, workflow changes, or model refinements.

MLOps, Reuse & Production Partnership

· Partner with AI Engineers, ML engineers, software engineers, and platform teams to move validated statistical/ML models, LLM applications, agents, and orchestration workflows from notebook or prototype into reliable production capabilities.

· Support model and agent documentation, versioning, reproducibility, observability, monitoring, automated validation/evaluation, performance checks, and operational runbooks required for production-grade AI solutions.

· Contribute to reusable data science patterns, libraries, templates, evaluation assets, and standards that improve speed and consistency across AI use-case teams.

· Work with Quality Engineering, Governance, Privacy, Security, and Responsible AI stakeholders to ensure data science methods are safe, auditable, compliant, and fit for purpose.

Cross-Functional Collaboration & Communication

· Communicate complex analytical, statistical, and machine learning concepts clearly to executives, product managers, engineers, clinicians, operational leaders, and other stakeholders.

· Collaborate with clinical and operational subject matter experts to ensure assumptions, data definitions, model outputs, and interpretation are grounded in real-world workflows.

· Mentor peers and contribute to the growth of BSWH’s data science practice through code reviews, methodology reviews, best-practice sharing, and reusable standards.

· Stay current on developments in heal