• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

NIDA IRP

National Institute on Drug Abuse - Intramural Research Program

  National Institute on Drug Abuse | NIH IRP | Treatment Info | Emergency Contacts
  • Home
  • News
    • Featured Paper of the Month
    • Reviews to Read
    • Hot off the Press
    • IRP News
    • Awards
    • Technology Development Initiative Paper of the Month
    • Seminar Series
    • Addiction Grand Rounds
  • About
    • About NIDA IRP
    • Contact Us
    • Directions and Map
    • Careers at NIDA IRP
    • Emergency Contacts
    • Employee Assistance Resources
  • Organization
    • Faculty
    • Office of the Scientific Director
    • Office of the Clinical Director
    • Office of Education and Career Development
    • Administrative Management Branch
    • Molecular Targets and Medications Discovery Branch
    • Cellular and Neurocomputational Systems Branch
    • Molecular Neuropsychiatry Research Branch
    • Neuroimaging Research Branch
    • Behavioral Neuroscience Research Branch
    • Integrative Neuroscience Research Branch
    • Translational Addiction Medicine Branch
    • Core Facilities
    • Community Outreach Group
  • Training Programs
    • Office of Education and Career Development
    • OECD Awards
    • Summer Internship Program
    • Postbaccalaureate Program
    • Graduate Partnership Program
    • Postdoctoral Program
    • NIDA Speakers Bureau
    • Clinical Electives Program
    • Clinical Mentoring Program
  • Study Volunteers
  • TDI Home
  • TDI Paper of the Month
  • TDI Seminar Series
  • Resources
  • Staff
  • TDI Paper of the Month Committee
  • Technology Transfer
  • Transgenic Rat Project
  • Equipment Inventory Database
    (NIDA Staff Only, VPN Required)

Technology Development Initiative – Paper of the Month – June 2024

A portion of a figure from this study. Image copyright: Nature

Image copyright: Nature

Simple behavioral analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience

Published in Nat Neuroscience (2024)

Authors

Nastacia L. Goodwin, Jia J. Choong, Sophia Hwang, Kayla Pitts, Liana Bloom, Aasiya Islam, Yizhe Y. Zhang, Eric R. Szelenyi, Xiaoyu Tong, Emily L. Newman, Klaus Miczek, Hayden R. Wright, Ryan J. McLaughlin, Zane C. Norville, Neir Eshel, Mitra Heshmati, Simon R. O. Nilsson & Sam A. Golden

Paper presented by Dr. Rajtarun Madangopal and selected by the NIDA TDI Paper of the Month Committee

Publication Brief Description

Simple Behavioral Analysis (SimBA) is an open-source machine learning platform designed for the automated detection of animal behaviors. It leverages markerless key-point pose tracking from open-source programs like SLEAP and DeepLabCut to transform tracking data into features that describe relationships between body parts over time. Researchers can train classifiers within SimBA to detect specific behaviors based on these features. A key feature of SimBA is its integration with Shapley Additive Explanations (SHAP) which provides users with quantitative insights into which features are critical to their behavioral predictions. The explainability of the outcome facilitates the standardization and sharing of behavioral definitions across labs, making complex behavioral analysis accessible to non-specialists. Further, by computing and sharing these explainability metrics, behavioral classifiers can be reconceptualized as shareable reagents akin to the commonly used Research Reagent Identifiers (RRIDs) system for wet lab reagents, enhancing reproducibility and interpretability between research groups.


Goodwin, Nastacia L; Choong, Jia J; Hwang, Sophia; Pitts, Kayla; Bloom, Liana; Islam, Aasiya; Zhang, Yizhe Y; Szelenyi, Eric R; Tong, Xiaoyu; Newman, Emily L; Miczek, Klaus; Wright, Hayden R; McLaughlin, Ryan J; Norville, Zane C; Eshel, Neir; Heshmati, Mitra; Nilsson, Simon R O; Golden, Sam A

Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience Journal Article

In: Nat Neurosci, 2024, ISSN: 1546-1726.

Abstract | Links

@article{pmid38778146,
title = {Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience},
author = {Nastacia L Goodwin and Jia J Choong and Sophia Hwang and Kayla Pitts and Liana Bloom and Aasiya Islam and Yizhe Y Zhang and Eric R Szelenyi and Xiaoyu Tong and Emily L Newman and Klaus Miczek and Hayden R Wright and Ryan J McLaughlin and Zane C Norville and Neir Eshel and Mitra Heshmati and Simon R O Nilsson and Sam A Golden},
url = {https://pubmed.ncbi.nlm.nih.gov/38778146/},
doi = {10.1038/s41593-024-01649-9},
issn = {1546-1726},
year = {2024},
date = {2024-05-01},
urldate = {2024-05-01},
journal = {Nat Neurosci},
abstract = {The study of complex behaviors is often challenging when using manual annotation due to the absence of quantifiable behavioral definitions and the subjective nature of behavioral annotation. Integration of supervised machine learning approaches mitigates some of these issues through the inclusion of accessible and explainable model interpretation. To decrease barriers to access, and with an emphasis on accessible model explainability, we developed the open-source Simple Behavioral Analysis (SimBA) platform for behavioral neuroscientists. SimBA introduces several machine learning interpretability tools, including SHapley Additive exPlanation (SHAP) scores, that aid in creating explainable and transparent behavioral classifiers. Here we show how the addition of explainability metrics allows for quantifiable comparisons of aggressive social behavior across research groups and species, reconceptualizing behavior as a sharable reagent and providing an open-source framework. We provide an open-source, graphical user interface (GUI)-driven, well-documented package to facilitate the movement toward improved automation and sharing of behavioral classification tools across laboratories.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}

Close

The study of complex behaviors is often challenging when using manual annotation due to the absence of quantifiable behavioral definitions and the subjective nature of behavioral annotation. Integration of supervised machine learning approaches mitigates some of these issues through the inclusion of accessible and explainable model interpretation. To decrease barriers to access, and with an emphasis on accessible model explainability, we developed the open-source Simple Behavioral Analysis (SimBA) platform for behavioral neuroscientists. SimBA introduces several machine learning interpretability tools, including SHapley Additive exPlanation (SHAP) scores, that aid in creating explainable and transparent behavioral classifiers. Here we show how the addition of explainability metrics allows for quantifiable comparisons of aggressive social behavior across research groups and species, reconceptualizing behavior as a sharable reagent and providing an open-source framework. We provide an open-source, graphical user interface (GUI)-driven, well-documented package to facilitate the movement toward improved automation and sharing of behavioral classification tools across laboratories.

Close

  • https://pubmed.ncbi.nlm.nih.gov/38778146/
  • doi:10.1038/s41593-024-01649-9

Close

Primary Sidebar

Technology Development Initiative

  • TDI Home
  • TDI Paper of the Month
  • TDI Seminar Series
  • Resources
  • Staff
  • TDI Paper of the Month Committee
  • Technology Transfer
  • Transgenic Rat Project
  • Equipment Inventory Database
    (NIDA Staff Only, VPN Required)

Organization

  • Organization
  • Faculty
  • Office of the Scientific Director
  • Office of the Clinical Director
  • Administrative Management Branch
  • Molecular Targets and Medications Discovery Branch
  • Cellular and Neurocomputational Systems Branch
  • Molecular Neuropsychiatry Research Branch
  • Neuroimaging Research Branch
  • Behavioral Neuroscience Research Branch
  • Integrative Neuroscience Research Branch
  • Translational Addiction Medicine Branch
  • Core Facilities
  • Careers at NIDA IRP
  • Technology Development Initiative
  • Community Outreach Group
Home / News Main / Technology Development Initiative Paper of the Month / Technology Development Initiative – Paper of the Month – June 2024
  • National Institute on Drug Abuse
  • NIH Intramural Research Program
  • National Institutes of Health
  • Health and Human Services
  • USA.GOV
  • Emergency Contacts
  • Employee Assistance
  • Treatment Information
  • Contact Us
  • Careers at NIDA IRP
  • Accessibility
  • Privacy
  • HHS Vulnerability Disclosure
  • Freedom of Information Act
  • Document Viewing Tools
  • Offsite Links
  • National Institute on Drug Abuse
  • NIH Intramural Research Program
  • National Institutes of Health
  • Health and Human Services
  • USA.GOV
  • Emergency Contacts
  • Employee Assistance
  • Treatment Information
  • Contact Us
  • Careers at NIDA IRP
  • Accessibility
  • Privacy
  • HHS Vulnerability Disclosure
  • Freedom of Information Act
  • Document Viewing Tools
  • Offsite Links

  • Home
  • News
    ▼
    • Featured Paper of the Month
    • Reviews to Read
    • Hot off the Press
    • IRP News
    • Awards
    • Technology Development Initiative Paper of the Month
    • Seminar Series
    • Addiction Grand Rounds
  • About
    ▼
    • About NIDA IRP
    • Contact Us
    • Directions and Map
    • Careers at NIDA IRP
    • Emergency Contacts
    • Employee Assistance Resources
  • Organization
    ▼
    • Faculty
    • Office of the Scientific Director
    • Office of the Clinical Director
    • Office of Education and Career Development
    • Administrative Management Branch
    • Molecular Targets and Medications Discovery Branch
    • Cellular and Neurocomputational Systems Branch
    • Molecular Neuropsychiatry Research Branch
    • Neuroimaging Research Branch
    • Behavioral Neuroscience Research Branch
    • Integrative Neuroscience Research Branch
    • Translational Addiction Medicine Branch
    • Core Facilities
    • Community Outreach Group
  • Training Programs
    ▼
    • Office of Education and Career Development
    • OECD Awards
    • Summer Internship Program
    • Postbaccalaureate Program
    • Graduate Partnership Program
    • Postdoctoral Program
    • NIDA Speakers Bureau
    • Clinical Electives Program
    • Clinical Mentoring Program
  • Study Volunteers