A non-contact oxygen saturation detection method based on dynamic spectrum
Blood oxygen saturation (SpO) is an important monitoring indicator for many respiratory diseases. Non-contact oximetry offers outstanding advantages in both coronavirus pandemic monitoring and sleep monitoring, but at the same time poses both challenges regarding technology and environment. Therefore, we propose a method for non-contact SpO measurement based on the principle of DS (dynamic spectrum) in this paper. A multispectral camera with 24 wavelengths (range in 660 nm-950 nm) is used to capture video of the people's cheek region, and then the two-dimensional images are converted into a one-dimensional temporal PPG signal. After pre-processing the PPG signal, the 24 wavelengths DS values are extracted. The optimal wavelength combination is obtained by wavelength screening using the one-by-one elimination method, and a PLS (partial least squares) model is established using the SpO values measured simultaneously by pulse oximetry as the modeled true values. The facial videos of eight healthy subjects were collected, and a total of 140 valid samples were obtained. By analyzing the modeling results, the regression coefficient (R) and root mean square error (RMSE) of the modeled set were 0.6366 and 0.9906, respectively. This method can significantly respond to the variation of SpO, and the prediction results are approaching to the prediction accuracy (±2%) of most pulse oximeters in the market. Using DS theory in this method eliminates in principle the interference of static tissue, individual differences, and environment. It fully meets the strong demand for non-contact oximetry and provides a new measurement idea.
Low-cost thermal imaging with machine learning for non-invasive diagnosis and therapeutic monitoring of pneumonia
Rapid screening and early treatment of lung infection are essential for effective control of many epidemics such as Coronavirus Disease 2019 (COVID-19). Recent studies have demonstrated the potential correlation between lung infection and the change of back skin temperature distribution. Based on these findings, we propose to use low-cost, portable and rapid thermal imaging in combination with image-processing algorithms and machine learning analysis for non-invasive and safe detection of pneumonia. The proposed method was tested in 69 subjects (30 normal adults, 11 cases of fever without pneumonia, 19 cases of general pneumonia and 9 cases of COVID-19) where both RGB and thermal images were acquired from the back of each subject. The acquired images were processed automatically in order to extract multiple location and shape features that distinguish normal subjects from pneumonia patients at a high accuracy of 93 . Furthermore, daily assessment of two pneumonia patients by the proposed method accurately predicted the clinical outcomes, coincident with those of laboratory tests. Our pilot study demonstrated the technical feasibility of portable and intelligent thermal imaging for screening and therapeutic assessment of pneumonia. The method can be potentially implemented in under-resourced regions for more effective control of respiratory epidemics.
Application of infrared thermography in computer aided diagnosis
The invention of thermography, in the 1950s, posed a formidable problem to the research community: What is the relationship between disease and heat radiation captured with Infrared (IR) cameras? The research community responded with a continuous effort to find this crucial relationship. This effort was aided by advances in processing techniques, improved sensitivity and spatial resolution of thermal sensors. However, despite this progress fundamental issues with this imaging modality still remain. The main problem is that the link between disease and heat radiation is complex and in many cases even non-linear. Furthermore, the change in heat radiation as well as the change in radiation pattern, which indicate disease, is minute. On a technical level, this poses high requirements on image capturing and processing. On a more abstract level, these problems lead to inter-observer variability and on an even more abstract level they lead to a lack of trust in this imaging modality. In this review, we adopt the position that these problems can only be solved through a strict application of scientific principles and objective performance assessment. Computing machinery is inherently objective; this helps us to apply scientific principles in a transparent way and to assess the performance results. As a consequence, we aim to promote thermography based Computer-Aided Diagnosis (CAD) systems. Another benefit of CAD systems comes from the fact that the diagnostic accuracy is linked to the capability of the computing machinery and, in general, computers become ever more potent. We predict that a pervasive application of computers and networking technology in medicine will help us to overcome the shortcomings of any single imaging modality and this will pave the way for integrated health care systems which maximize the quality of patient care.
Motion tracking in infrared imaging for quantitative medical diagnostic applications
In medical applications, infrared (IR) thermography is used to detect and examine the thermal signature of skin abnormalities by quantitatively analyzing skin temperature in steady state conditions or its evolution over time, captured in an image sequence. However, during the image acquisition period, the involuntary movements of the patient are unavoidable, and such movements will undermine the accuracy of temperature measurement for any particular location on the skin. In this study, a tracking approach using a template-based algorithm is proposed, to follow the involuntary motion of the subject in the IR image sequence. The motion tacking will allow to associate a temperature evolution to each spatial location on the body while the body moves relative to the image frame. The affine transformation model is adopted to estimate the motion parameters of the template image. The Lucas-Kanade algorithm is applied to search for the optimized parameters of the affine transformation. A weighting mask is incorporated into the algorithm to ensure its tracking robustness. To evaluate the feasibility of the tracking approach, two sets of IR image sequences with random in-plane motion were tested in our experiments. A steady-state (no heating or cooling) IR image sequence in which the skin temperature is in equilibrium with the environment was considered first. The thermal recovery IR image sequence, acquired when the skin is recovering from 60-s cooling, was the second case analyzed. By proper selection of the template image along with template update, satisfactory tracking results were obtained for both IR image sequences. The achieved tracking accuracies are promising in terms of satisfying the demands imposed by clinical applications of IR thermography.
Characterization of Lesion Formation and Bubble Activities during High Intensity Focused Ultrasound Ablation using Temperature-Derived Parameters
Successful high-intensity focused ultrasound (HIFU) thermal tissue ablation relies on accurate information of the tissue temperature and tissue status. Often temperature measurements are used to predict and monitor the ablation process. In this study, we conducted HIFU ablation experiments with porcine myocardium tissue specimens to identify changes in temperature associated with tissue coagulation and bubble/cavity formation. Using infrared (IR) thermography and synchronized bright-field imaging with HIFU applied near the tissue surface, parameters derived from the spatiotemporal evolution of temperature were correlated with HIFU-induced lesion formation and overheating, of which the latter typically results in cavity generation and/or tissue dehydration. Emissivity of porcine myocardium was first measured to be 0.857 ± 0.006 ( = 3). HIFU outcomes were classified into non-ablative, normal lesion, and overheated lesion. A marked increase in the rate of temperature change during HIFU application was observed with lesion formation. A criterion using the maximum normalized second time derivative of temperature change provided 99.1% accuracy for lesion identification with a 0.05 s threshold. Asymmetric temperature distribution on the tissue surface was observed to correlate with overheating and/or bubble generation. A criterion using the maximum displacement of the spatial location of the peak temperature provided 90.9% accuracy to identify overheated lesion with a 0.16 mm threshold. Spatiotemporal evolution of temperature obtained using IR imaging allowed determination of the cumulative equivalent minutes at 43 °C () for lesion formation to be 170 min. Similar temperature characteristics indicative of lesion formation and overheating were identified for subsurface HIFU ablation. These results suggest that parameters derived from temperature changes during HIFU application are associated with irreversible changes in tissue and may provide useful information for monitoring HIFU treatment.
Face and eyes localization algorithm in thermal images for temperature measurement of the inner canthus of the eyes
In this paper, a novel algorithm for the detection and localization of the face and eyes in thermal images is presented, particularly the temperature measurement of the human body by measuring the eye corner (inner canthus) temperature. The algorithm uses a combination of the template-matching, knowledge-based and morphological methods, particularly the modified Randomized Hough Transform (RHT) in the localization process, also growing segmentation to increase accuracy of the localization algorithm. In many solutions, the localization of the face and/or eyes is made by manual selection of the regions of the face and eyes and then the average temperature in the region is measured. The paper also discusses experimental studies and the results, which allowed the evaluation of the effectiveness of the developed algorithm. The standardization of measurement, necessary for proper temperature measurement with the use of infrared thermal imaging, are also presented.
Medical applications of infrared thermography: A review
Abnormal body temperature is a natural indicator of illness. Infrared thermography (IRT) is a fast, passive, non-contact and non-invasive alternative to conventional clinical thermometers for monitoring body temperature. Besides, IRT can also map body surface temperature remotely. Last five decades witnessed a steady increase in the utility of thermal imaging cameras to obtain correlations between the thermal physiology and skin temperature. IRT has been successfully used in diagnosis of breast cancer, diabetes neuropathy and peripheral vascular disorders. It has also been used to detect problems associated with gynecology, kidney transplantation, dermatology, heart, neonatal physiology, fever screening and brain imaging. With the advent of modern infrared cameras, data acquisition and processing techniques, it is now possible to have real time high resolution thermographic images, which is likely to surge further research in this field. The present efforts are focused on automatic analysis of temperature distribution of regions of interest and their statistical analysis for detection of abnormalities. This critical review focuses on advances in the area of medical IRT. The basics of IRT, essential theoretical background, the procedures adopted for various measurements and applications of IRT in various medical fields are discussed in this review. Besides background information is provided for beginners for better understanding of the subject.