Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing - Institut Pasteur Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing

Résumé

Robust quantification of animal behavior is fundamental in experimental neuroscience research. Systems providing automated behavioral assessment are an important alternative to manual measurements avoiding problems such as human bias, low reproducibility and high cost. Integrating these tools with closed-loop control systems creates conditions to correlate environment and behavioral expressions effectively, and ultimately explain the neural foundations of behavior. We present an integrated solution for automated behavioral analysis of rodents using deep learning networks on video streams acquired from a depth-sensing camera. The use of depth sensors has notable advantages: tracking/classification performance is improved and independent of animals’ coat color, and videos can be recorded in dark conditions without affecting animals’ natural behavior. Convolutional and recurrent layers were combined in deep network architectures, and both spatial and temporal representations were successfully learned for a 4- classes behavior classification task (standstill, walking, rearing and grooming). Integration with Arduino microcontrollers creates an easy-to-use control platform providing low-latency feedback signals based on the deep learning automatic classification of animal behavior. The complete system, combining depth-sensor camera, computer, and Arduino microcontroller, allows simple mapping of input-output control signals using the animal’s current behavior and position. For example, a feeder can be controlled not by pressing a lever but by the animal behavior itself. An integrated graphical user interface completes a user-friendly and cost-effective solution for animal tracking and behavior classification. This open-software/open-hardware platform can boost the development of customized protocols for automated behavioral research, and support ever more sophisticated, reliable and reproducible behavioral neuroscience experiments.
Fichier principal
Vignette du fichier
2022.02.22.481410v1.full.pdf (2.93 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY NC ND - Paternité - Pas d'utilisation commerciale - Pas de modification

Dates et versions

pasteur-04163465 , version 1 (20-07-2023)

Licence

Paternité - Pas d'utilisation commerciale - Pas de modification

Identifiants

Citer

Ana Gerós, Ricardo Cruz, Fabrice de Chaumont, Jaime Cardoso, Paulo Aguiar. Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing. 2022. ⟨pasteur-04163465⟩
16 Consultations
99 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More