Optimizing extubation success: a comparative analysis of time series algorithms and activation functions
The success and failure of extubation of patients with acute respiratory failure is a very important issue for clinicians, and the failure of the ventilator often leads to possible complications, which in turn leads to a lot of doubts about the medical treatment in the minds of the people, so in order to increase the success of extubation success of the doctors to prevent the possible complications, the present study compared different time series algorithms and different activation functions for the training and prediction of extubation success or failure models.
Editorial: Understanding and bridging the gap between neuromorphic computing and machine learning, volume II
Multi-scale asynchronous correlation and 2D convolutional autoencoder for adolescent health risk prediction with limited fMRI data
Adolescence is a fundamental period of transformation, encompassing extensive physical, psychological, and behavioral changes. Effective health risk assessment during this stage is crucial for timely intervention, yet traditional methodologies often fail to accurately predict mental and behavioral health risks due to the intricacy of neural dynamics and the scarcity of quality-annotated fMRI datasets.
Decoding the application of deep learning in neuroscience: a bibliometric analysis
The application of deep learning in neuroscience holds unprecedented potential for unraveling the complex dynamics of the brain. Our bibliometric analysis, spanning from 2012 to 2023, delves into the integration of deep learning in neuroscience, shedding light on the evolutionary trends and identifying pivotal research hotspots. Through the examination of 421 articles, this study unveils a significant growth in interdisciplinary research, marked by the burgeoning application of deep learning techniques in understanding neural mechanisms and addressing neurological disorders. Central to our findings is the critical role of classification algorithms, models, and neural networks in advancing neuroscience, highlighting their efficacy in interpreting complex neural data, simulating brain functions, and translating theoretical insights into practical diagnostics and therapeutic interventions. Additionally, our analysis delineates a thematic evolution, showcasing a shift from foundational methodologies toward more specialized and nuanced approaches, particularly in areas like EEG analysis and convolutional neural networks. This evolution reflects the field's maturation and its adaptation to technological advancements. The study further emphasizes the importance of interdisciplinary collaborations and the adoption of cutting-edge technologies to foster innovation in decoding the cerebral code. The current study provides a strategic roadmap for future explorations, urging the scientific community toward areas ripe for breakthrough discoveries and practical applications. This analysis not only charts the past and present landscape of deep learning in neuroscience but also illuminates pathways for future research, underscoring the transformative impact of deep learning on our understanding of the brain.
Electroencephalogram-based adaptive closed-loop brain-computer interface in neurorehabilitation: a review
Brain-computer interfaces (BCIs) represent a groundbreaking approach to enabling direct communication for individuals with severe motor impairments, circumventing traditional neural and muscular pathways. Among the diverse array of BCI technologies, electroencephalogram (EEG)-based systems are particularly favored due to their non-invasive nature, user-friendly operation, and cost-effectiveness. Recent advancements have facilitated the development of adaptive bidirectional closed-loop BCIs, which dynamically adjust to users' brain activity, thereby enhancing responsiveness and efficacy in neurorehabilitation. These systems support real-time modulation and continuous feedback, fostering personalized therapeutic interventions that align with users' neural and behavioral responses. By incorporating machine learning algorithms, these BCIs optimize user interaction and promote recovery outcomes through mechanisms of activity-dependent neuroplasticity. This paper reviews the current landscape of EEG-based adaptive bidirectional closed-loop BCIs, examining their applications in the recovery of motor and sensory functions, as well as the challenges encountered in practical implementation. The findings underscore the potential of these technologies to significantly enhance patients' quality of life and social interaction, while also identifying critical areas for future research aimed at improving system adaptability and performance. As advancements in artificial intelligence continue, the evolution of sophisticated BCI systems holds promise for transforming neurorehabilitation and expanding applications across various domains.
Sex differences in brain MRI using deep learning toward fairer healthcare outcomes
This study leverages deep learning to analyze sex differences in brain MRI data, aiming to further advance fairness in medical imaging. We employed 3D T1-weighted Magnetic Resonance images from four diverse datasets: Calgary-Campinas-359, OASIS-3, Alzheimer's Disease Neuroimaging Initiative, and Cambridge Center for Aging and Neuroscience, ensuring a balanced representation of sexes and a broad demographic scope. Our methodology focused on minimal preprocessing to preserve the integrity of brain structures, utilizing a Convolutional Neural Network model for sex classification. The model achieved an accuracy of 87% on the test set without employing total intracranial volume (TIV) adjustment techniques. We observed that while the model exhibited biases at extreme brain sizes, it performed with less bias when the TIV distributions overlapped more. Saliency maps were used to identify brain regions significant in sex differentiation, revealing that certain supratentorial and infratentorial regions were important for predictions. Furthermore, our interdisciplinary team, comprising machine learning specialists and a radiologist, ensured diverse perspectives in validating the results. The detailed investigation of sex differences in brain MRI in this study, highlighted by the sex differences map, offers valuable insights into sex-specific aspects of medical imaging and could aid in developing sex-based bias mitigation strategies, contributing to the future development of fair AI algorithms. Awareness of the brain's differences between sexes enables more equitable AI predictions, promoting fairness in healthcare outcomes. Our code and saliency maps are available at https://github.com/mahsadibaji/sex-differences-brain-dl.
Latent dynamics of primary sensory cortical population activity structured by fluctuations in the local field potential
As emerging technologies enable measurement of precise details of the activity within microcircuits at ever-increasing scales, there is a growing need to identify the salient features and patterns within the neural populations that represent physiologically and behaviorally relevant aspects of the network. Accumulating evidence from recordings of large neural populations suggests that neural population activity frequently exhibits relatively low-dimensional structure, with a small number of variables explaining a substantial fraction of the structure of the activity. While such structure has been observed across the brain, it is not known how reduced-dimension representations of neural population activity relate to classical metrics of "brain state," typically described in terms of fluctuations in the local field potential (LFP), single-cell activity, and behavioral metrics.
Analyzing top-down visual attention in the context of gamma oscillations: a layer- dependent network-of- networks approach
Top-down visual attention is a fundamental cognitive process that allows individuals to selectively attend to salient visual stimuli in the environment. Recent empirical findings have revealed that gamma oscillations participate in the modulation of visual attention. However, computational studies face challenges when analyzing the attentional process in the context of gamma oscillation due to the unstable nature of gamma oscillations and the complexity induced by the layered fashion in the visual cortex. In this study, we propose a layer-dependent network-of-networks approach to analyze such attention with gamma oscillations. The model is validated by reproducing empirical findings on orientation preference and the enhancement of neuronal response due to top-down attention. We perform parameter plane analysis to classify neuronal responses into several patterns and find that the neuronal response to sensory and attention signals was modulated by the heterogeneity of the neuronal population. Furthermore, we revealed a counter-intuitive scenario that the excitatory populations in layer 2/3 and layer 5 exhibit opposite responses to the attentional input. By modification of the original model, we confirmed layer 6 plays an indispensable role in such cases. Our findings uncover the layer-dependent dynamics in the cortical processing of visual attention and open up new possibilities for further research on layer-dependent properties in the cerebral cortex.
Facial emotion recognition using deep quantum and advanced transfer learning mechanism
Facial expressions have become a common way for interaction among humans. People cannot comprehend and predict the emotions or expressions of individuals through simple vision. Thus, in psychology, detecting facial expressions or emotion analysis demands an assessment and evaluation of decisions for identifying the emotions of a person or any group during communication. With the recent evolution of technology, AI (Artificial Intelligence) has gained significant usage, wherein DL (Deep Learning) based algorithms are employed for detecting facial expressions.
BrainNet: an automated approach for brain stress prediction utilizing electrodermal activity signal with XLNet model
Brain stress monitoring has emerged as a critical research area for understanding and managing stress and neurological health issues. This burgeoning field aims to provide accurate information and prediction about individuals' stress levels by analyzing behavioral data and physiological signals. To address this emerging problem, this research study proposes an innovative approach that uses an attention mechanism-based XLNet model (called BrainNet) for continuous stress monitoring and stress level prediction. The proposed model analyzes streams of brain data, including behavioral and physiological signal patterns using Swell and WESAD datasets. Testing on the Swell multi-class dataset, the model achieves an impressive accuracy of 95.76%. Furthermore, when evaluated on the WESAD dataset, it demonstrates even higher accuracy, reaching 98.32%. When applied to the binary classification of stress and no stress using the Swell dataset, the model achieves an outstanding accuracy of 97.19%. Comparative analysis with other previously published research studies underscores the superior performance of the proposed approach. In addition, cross-validation confirms the significance, efficacy, and robustness of the model in brain stress level prediction and aligns with the goals of smart diagnostics for understanding neurological behaviors.
Systematic review of cognitive impairment in drivers through mental workload using physiological measures of heart rate variability
The intricate interplay between driver cognitive dysfunction, mental workload (MWL), and heart rate variability (HRV) provides a captivating avenue for investigation within the domain of transportation safety studies. This article provides a systematic review and examines cognitive hindrance stemming from mental workload and heart rate variability. It scrutinizes the mental workload experienced by drivers by leveraging data gleaned from prior studies that employed heart rate monitoring systems and eye tracking technology, thereby illuminating the correlation between cognitive impairment, mental workload, and physiological indicators such as heart rate and ocular movements. The investigation is grounded in the premise that the mental workload of drivers can be assessed through physiological cues, such as heart rate and eye movements. The study discovered that HRV and infrared (IR) measurements played a crucial role in evaluating fatigue and workload for skilled drivers. However, the study overlooked potential factors contributing to cognitive impairment in drivers and could benefit from incorporating alternative indicators of cognitive workload for deeper insights. Furthermore, investigated driving simulators demonstrated that an eco-safe driving Human-Machine Interface (HMI) significantly promoted safe driving behaviors without imposing excessive mental and visual workload on drivers. Recommendations were made for future studies to consider additional indicators of cognitive workload, such as subjective assessments or task performance metrics, for a more comprehensive understanding.
Simulated synapse loss induces depression-like behaviors in deep reinforcement learning
Deep Reinforcement Learning is a branch of artificial intelligence that uses artificial neural networks to model reward-based learning as it occurs in biological agents. Here we modify a Deep Reinforcement Learning approach by imposing a suppressive effect on the connections between neurons in the artificial network-simulating the effect of dendritic spine loss as observed in major depressive disorder (MDD). Surprisingly, this simulated spine loss is sufficient to induce a variety of MDD-like behaviors in the artificially intelligent agent, including anhedonia, increased temporal discounting, avoidance, and an altered exploration/exploitation balance. Furthermore, simulating alternative and longstanding reward-processing-centric conceptions of MDD (dysfunction of the dopamine system, altered reward discounting, context-dependent learning rates, increased exploration) does not produce the same range of MDD-like behaviors. These results support a conceptual model of MDD as a reduction of brain connectivity (and thus information-processing capacity) rather than an imbalance in monoamines-though the computational model suggests a possible explanation for the dysfunction of dopamine systems in MDD. Reversing the spine-loss effect in our computational MDD model can lead to rescue of rewarding behavior under some conditions. This supports the search for treatments that increase plasticity and synaptogenesis, and the model suggests some implications for their effective administration.
Editorial: Computational modeling and machine learning methods in neurodevelopment and neurodegeneration: from basic research to clinical applications
Multi-label remote sensing classification with self-supervised gated multi-modal transformers
With the great success of Transformers in the field of machine learning, it is also gradually attracting widespread interest in the field of remote sensing (RS). However, the research in the field of remote sensing has been hampered by the lack of large labeled data sets and the inconsistency of data modes caused by the diversity of RS platforms. With the rise of self-supervised learning (SSL) algorithms in recent years, RS researchers began to pay attention to the application of "pre-training and fine-tuning" paradigm in RS. However, there are few researches on multi-modal data fusion in remote sensing field. Most of them choose to use only one of the modal data or simply splice multiple modal data roughly.
Multi-stage semi-supervised learning enhances white matter hyperintensity segmentation
White matter hyperintensities (WMHs) are frequently observed on magnetic resonance (MR) images in older adults, commonly appearing as areas of high signal intensity on fluid-attenuated inversion recovery (FLAIR) MR scans. Elevated WMH volumes are associated with a greater risk of dementia and stroke, even after accounting for vascular risk factors. Manual segmentation, while considered the ground truth, is both labor-intensive and time-consuming, limiting the generation of annotated WMH datasets. Un-annotated data are relatively available; however, the requirement of annotated data poses a challenge for developing supervised machine learning models.
Dynamical predictive coding with reservoir computing performs noise-robust multi-sensory speech recognition
Multi-sensory integration is a perceptual process through which the brain synthesizes a unified perception by integrating inputs from multiple sensory modalities. A key issue is understanding how the brain performs multi-sensory integrations using a common neural basis in the cortex. A cortical model based on reservoir computing has been proposed to elucidate the role of recurrent connectivity among cortical neurons in this process. Reservoir computing is well-suited for time series processing, such as speech recognition. This inquiry focuses on extending a reservoir computing-based cortical model to encompass multi-sensory integration within the cortex. This research introduces a dynamical model of multi-sensory speech recognition, leveraging predictive coding combined with reservoir computing. Predictive coding offers a framework for the hierarchical structure of the cortex. The model integrates reliability weighting, derived from the computational theory of multi-sensory integration, to adapt to multi-sensory time series processing. The model addresses a multi-sensory speech recognition task, necessitating the management of complex time series. We observed that the reservoir effectively recognizes speech by extracting time-contextual information and weighting sensory inputs according to sensory noise. These findings indicate that the dynamic properties of recurrent networks are applicable to multi-sensory time series processing, positioning reservoir computing as a suitable model for multi-sensory integration.
Data-centric automated approach to predict autism spectrum disorder based on selective features and explainable artificial intelligence
Autism spectrum disorder (ASD) is a neurodevelopmental condition marked by notable challenges in cognitive function, understanding language, recognizing objects, interacting with others, and communicating effectively. Its origins are mainly genetic, and identifying it early and intervening promptly can reduce the necessity for extensive medical treatments and lengthy diagnostic procedures for those impacted by ASD. This research is designed with two types of experimentation for ASD analysis. In the first set of experiments, authors utilized three feature engineering techniques (Chi-square, backward feature elimination, and PCA) with multiple machine learning models for autism presence prediction in toddlers. The proposed XGBoost 2.0 obtained 99% accuracy, F1 score, and recall with 98% precision with chi-square significant features. In the second scenario, main focus shifts to identifying tailored educational methods for children with ASD through the assessment of their behavioral, verbal, and physical responses. Again, the proposed approach performs well with 99% accuracy, F1 score, recall, and precision. In this research, cross-validation technique is also implemented to check the stability of the proposed model along with the comparison of previously published research works to show the significance of the proposed model. This study aims to develop personalized educational strategies for individuals with ASD using machine learning techniques to meet their specific needs better.
Deep learning-based Alzheimer's disease detection: reproducibility and the effect of modeling choices
Machine Learning (ML) has emerged as a promising approach in healthcare, outperforming traditional statistical techniques. However, to establish ML as a reliable tool in clinical practice, adherence to best practices in , and is crucial. In this work, we summarize and strictly adhere to such practices to ensure reproducible and reliable ML. Specifically, we focus on Alzheimer's Disease (AD) detection, a challenging problem in healthcare. Additionally, we investigate the impact of modeling choices, including different data augmentation techniques and model complexity, on overall performance.
A combinatorial deep learning method for Alzheimer's disease classification-based merging pretrained networks
Alzheimer's disease (AD) is a progressive neurodegenerative disorder characterized by cognitive decline, memory loss, and impaired daily functioning. Despite significant research, AD remains incurable, highlighting the critical need for early diagnosis and intervention to improve patient outcomes. Timely detection plays a crucial role in managing the disease more effectively. Pretrained convolutional neural networks (CNNs) trained on large-scale datasets, such as ImageNet, have been employed for AD classification, providing a head start for developing more accurate models.
Reinforcement learning as a robotics-inspired framework for insect navigation: from spatial representations to neural implementation
Bees are among the master navigators of the insect world. Despite impressive advances in robot navigation research, the performance of these insects is still unrivaled by any artificial system in terms of training efficiency and generalization capabilities, particularly considering the limited computational capacity. On the other hand, computational principles underlying these extraordinary feats are still only partially understood. The theoretical framework of reinforcement learning (RL) provides an ideal focal point to bring the two fields together for mutual benefit. In particular, we analyze and compare representations of space in robot and insect navigation models through the lens of RL, as the efficiency of insect navigation is likely rooted in an efficient and robust internal representation, linking retinotopic (egocentric) visual input with the geometry of the environment. While RL has long been at the core of robot navigation research, current computational theories of insect navigation are not commonly formulated within this framework, but largely as an associative learning process implemented in the insect brain, especially in the mushroom body (MB). Here we propose specific hypothetical components of the MB circuit that would enable the implementation of a certain class of relatively simple RL algorithms, capable of integrating distinct components of a navigation task, reminiscent of hierarchical RL models used in robot navigation. We discuss how current models of insect and robot navigation are exploring representations beyond classical, complete map-like representations, with spatial information being embedded in the respective latent representations to varying degrees.
Modeling functional connectivity changes during an auditory language task using line graph neural networks
Functional connectivity (FC) refers to the activation correlation between different brain regions. FC networks as typically represented as graphs with brain regions of interest (ROIs) as nodes and functional correlation as edges. Graph neural networks (GNNs) are machine learning architectures used to analyze FC graphs. However, traditional GNNs are limited in their ability to characterize FC edge attributes because they typically emphasize the importance of ROI node-based brain activation data. Line GNNs convert the edges of the original graph to nodes in the transformed graph, thereby emphasizing the FC between brain regions. We hypothesize that line GNNs will outperform traditional GNNs in FC applications. We investigated the performance of two common GNN architectures (GraphSAGE and GCN) trained on line and traditional graphs predicting task-associated FC changes across two datasets. The first dataset was from the Human Connectome Project (HCP) with 205 participants, the second was a dataset with 12 participants. The HCP dataset detailed FC changes in participants during a story-listening task, while the second dataset included the FC changes in a different auditory language task. Our findings from the HCP dataset indicated that line GNNs achieved lower mean squared error compared to traditional GNNs, with the line GraphSAGE model outperforming the traditional GraphSAGE by 18% ( < 0.0001). When applying the same models to the second dataset, both line GNNs also showed statistically significant improvements over their traditional counterparts with little to no overfitting. We believe this shows that line GNN models demonstrate promising utility in FC studies.