- Open Access
The case for using digital EEG analysis in clinical sleep medicine
© The Author(s) 2017
- Received: 23 August 2016
- Accepted: 22 December 2016
- Published: 6 February 2017
Evaluation of sleep in clinical polysomnograms continues to rely almost exclusively on visual scoring that implements rules proposed by Rechtschaffen and Kales nearly 50 years ago. Apart from its cost and time-consuming nature, visual scoring has limitations including: A) Sleep depth, which is a continuous variable, is treated as if it changes in a stepwise fashion from light (stage 1), to intermediate (stage 2) to deep (stage 3). B) Even with this limited scale, there is considerable inter-scorer variability, particularly in scoring stages 1 and 3 of non-REM sleep, thereby adding uncertainty to %time spent in these stages as a reliable metric for evaluating sleep depth. C) Limitation in scoring some of EEG features, including 1) arousal intensity, 2) extent of Alpha intrusion and 3) frequency, and characteristics of sleep spindles and K complexes. Digital analysis can solve these problems but producing a reliable system has been a challenge. In this review I begin with recent advances in digital scoring of sleep according to the Rechtschaffen and Kales rules and conclude that this technology has progressed enough to make it possible to obtain reliable, reproducible scoring, comparable in accuracy to scoring by highly experienced technologists, with minimal editing. This is followed by description of several new metrics that can be obtained if digital scoring systems were to be used routinely in clinical studies. The scientific evidence supporting the potential of these metrics to positively impact sleep medicine practice and the wide range of such metrics in patients studied in the sleep laboratory are highlighted.
- Sleep depth
- Arousal intensity
- Alpha intrusion
- Sleep spindles
- K Complexes
- Odds ratio product
- Michele sleep scoring
The polysomnogram (PSG) is the cornerstone of investigations in clinical sleep medicine. Interpretation of sleep in these studies is based primarily on the scoring rules introduced by Rechtschaffen and Kales (R&K) almost 50 years ago (Rechtschaffen and Kales 1968). In 1996, Kubicki et al. lamented the fact that, up to then, digital analysis of PSGs was focused on implementing the R&K rules more efficiently and not on exploring the microstructure of sleep which, they argued, could provide clinically important information (Kubicki and Herrmann 1996). In the intervening 20 years, advances in digital technology have revolutionized almost every aspect of our lives. Yet, the only benefit to sleep studies from this digital revolution has been conversion of data format from ink on paper to fancy digital displays. It is true that we now need much less space to store data, less time to retrieve patient information and the ability to store data on digital media, and change the montage and filters after data collection. But, the medically-helpful information we get has hardly changed. We still divide non-REM sleep into three distinct stages, consider arousals as simply present or absent, and we see all kinds of differences between patients’ EEGs that might well explain the patient’s problems, but we have no idea what they mean. R&K rules were introduced when visual scoring was the only way to make any sense of the massive data generated from sleep studies. It was not feasible then to propose visual criteria for defining more than a few sleep stages, to ask technologists to count spindles or alpha bursts or characterize their durations and intensity…etc. We have learned from basic science that differences in these features may mean something, but because we don’t get this information in clinical studies we can’t determine the clinical utility of measuring them. And, since we don’t have proof that measuring these differences will impact patient care, why should we change how we score clinical studies? A catch 22!
Criticism of digital systems’ ability to reproduce R&K staging is no longer justified.
Even if full manual editing is still insisted upon, and the economy achieved by digital scoring according to R&K is not large, including digital scoring routinely in clinical studies would make it possible to easily obtain potentially valuable information that is not possible to obtain with visual scoring.
Although the evidence provided below in support of these arguments is primarily from my own work (Malhotra et al. 2013; Azarbarzin et al. 2014; Younes et al. 2015a; Azarbarzin et al. 2015; Younes et al. 2015b; Younes and Hanly 2016; Younes et al. 2015c; Meza et al. 2016; Younes et al. 2016; Younes and Hanly PJ 2016; Amatoury et al. In Press; Younes) (I found no other relevant work), such evidence can be produced by anyone who is involved in digital scoring, and the additional information I generated in my own system can be generated by other systems. My intention is to simply encourage the use of digital scoring systems in clinical practice, regardless of which system is used. Availability of digital EEG analysis in every PSG system would greatly facilitate the introduction, testing and utilization of specialized information on microstructure. My own results are simply used here to illustrate some of what might be achieved with digital analysis.
Agreement between MSS and manual scoring compared to agreement between two scorers
ICCs MSS vs. Manual scoring
ICCs Between two scorers
Malhotra et al.a
Younes et al.b
Younes et al.c
Mean (95% CI)
Total sleep time
Non-REM stage 1
Non-REM stage 2
Non-REM stage 3
Sleep onset latency
REM onset latency
#Arousals-non REM sleep
Table 1 shows that agreement between unedited MSS and the average of 10 scorers (leftmost column) is well within the range of ICCs observed for comparisons between two scorers in the same institution (fourth column) or between scorers in different institutions (fifth column) and exceeds the average between-site ICCs in several sleep variables. In two subsequent validation studies (second and third columns, Table 1), utilizing a newer version of MSS, agreement of unedited MSS scores with manual scoring (one scorer) was also within the range of agreement reported by Malhotra et al. (Malhotra et al. 2013) for comparison between two scorers (Table 1). In another study in which 5-stage epoch-by-epoch comparisons were made between MSS scores and the scores of two academic technologists, MSS scores agreed with the scoring of one or both scorers in 87% of epochs (Younes et al. 2016). The comparable figures in the literature range from 68.0% to 82.6% (Pittman et al. 2004; Anderer et al. 2005; Norman et al. 2000; Danker-Hopfe et al. 2004; Rosenberg and Van Hout 2013). In the same study (Younes et al. 2016) each PSG was scored seven times, three times by each of two technologists and once by a third technologist. A true scoring error was defined as one that was not assigned in any of the other sessions. The number of errors made by any of the technologists in a single session averaged 13 epochs/PSG. The corresponding number for the unedited Auto score was 23 epochs/PSG, a clinically insignificant difference of 10 epochs/PSG (<2% of epochs), even without editing.
Notwithstanding these good results, there has been tremendous resistance to using any of the three validated systems in clinical laboratories. As judged from my experience with our own system (MSS) the main reason for this resistance is that Auto-scoring differs from manual scoring by local technologists in many epochs. This necessitates editing. Because the location of epochs with scoring differences cannot be predicted, all epochs need to be reviewed. There is little saving in time or expense.
In a recent informal evaluation in our laboratory, we found that technologists spend between 30 and 120 min editing files scored by MSS. How can it be necessary to edit so much when it has been proven through rigorous studies (Malhotra et al. 2013; Younes et al. 2015b; Younes et al. 2015c; Younes et al. 2016) that, without editing, the summary results are not that different from manual scoring? To investigate this issue, we introduced an algorithm in MSS that recorded all editing actions taken and the time spent on editing. Technologists fully edited the automatic scoring of 42 PSGs (Younes et al. 2015b). Intraclass correlation coeffecients (ICCs) for agreement between manual and auto-scoring before editing were 0.94 for TST, 0.76 for SE, 0.87 for stage W, 0.63 for N1, 0.81 for N2, 0.55 for N3, and 0.86 for REM sleep. Notwithstanding the fact that these ICCs were well within the range seen between expert scorers (Pittman et al. 2004; Anderer et al. 2005; Ferri et al. 1989; Norman et al. 2000; Collop 2002; Danker-Hopfe et al. 2004; Magalang et al. 2013; Zhang et al. 2015) the technologists performed an average 90 ± 47 changes/file to the automatic sleep stage (Younes et al. 2015b). These changes were often in opposite directions and involved many types of changes such that the net effect on duration of any sleep stage was clinically insignificant except in a few patients. Having found that the vast majority of editing changes are of little clinical consequence (e.g. changing TST from 360 to 350 min, or REM time from 35 to 45 min), we introduced a feature in MSS (Editing Helper) that scans the summary results looking for potential errors that, in our judgement, may influence clinical management (Younes et al. 2015b). These potentially significant errors included very early sleep or REM onset, too much awake time, N3 time or REM time, too little REM time…etc. The technologists were then asked to edit the automatic scoring of 102 full PSGs, once doing a full edit and once following only the suggestions of the Editing Helper. This group included 49 patients with sleep apnea, 12 patients with periodic limb movements >15 hr−1, 14 patients with insomnia and 27 patients with no pathology. The Helper issued an average of 2.5 ± 1.2 suggestions per file (Younes et al. 2015b). Editing time was reduced from 59 ± 26 to 6 ± 7 min while the ICCs for comparisons between manual and the abbreviated editing were not different from the ICCs for manual vs. full edit comparisons (0.87 ± 0.08 vs. 0.89 ± 0.09) (Younes et al. 2015b).
In a more recent study (Younes and Hanly PJ 2016) epoch by epoch agreement in 5-stage sleep scoring between two senior technologists was 78.9% (kappa statistic = 71.1%). When the scoring of each technologist was independently edited based on features calculated within MSS (odds-ratio-product (Younes et al. 2015a), spindles, K complexes, delta wave duration), % agreement increased to 96.5% (kappa statistic = 95.1%). ICCs for comparisons between the edited and original manually determined times in different stages were excellent and well within the accepted range for agreement between two expert scorers (Younes and Hanly PJ 2016). Thus, using the features generated by MSS to edit the manual scores essentially eliminated inter-observer variability while the edited score was in acceptable agreement with the original scoring of both technologists. This shows that the features extracted by MSS to stage sleep are a good compromise between the scoring of these features by two expert technologists.
It is not clear what more evidence is needed to convince decision makers that digital systems currently exist that can save a lot of time and money while producing consistent reliable results. A paradox exists in this regard. As illustrated by the numerous studies reporting on inter-observer scoring variability (Pittman et al. 2004; Anderer et al. 2005; Norman et al. 2000; Danker-Hopfe et al. 2004; Rosenberg and Van Hout 2013) the most one can expect between two experts scoring sleep in the same PSGs is agreement in 85% of epochs. This means that it is acceptable to have 120 disagreements between two humans in a typical 800-epoch PSG. Yet, any difference between the automatic score and the scoring of the local physician/technologist is unacceptable! This paradox has two fundamental underpinnings. First, numerous very poor digital systems were previously introduced and failed miserably. This resulted in a general mistrust of automatic systems. Second, decisions to implement, or not, a new digital scoring system are made by a local expert, or by an administrator who relies on local experts. When evaluating the new system, the local expert will inevitably find differences between his/her scoring and the Auto-score. Human nature causes one to trust his/her own scoring over that of another system, regardless of how many validation studies were published, and the decision will almost invariably be against the digital system. It follows that use of automatic scoring will only become commonplace if payers or regulatory bodies encourage/promote its use, with obvious stipulations as to what is an acceptable automatic system and the editing required. The problem with regulatory bodies is that they also rely on experts, most of whom have, for the reasons mentioned above, already decided that automatic scoring is inaccurate. This impasse will remain as the main barrier to moving sleep staging into the 21st century.
Assessment of sleep depth and quality
Insomnia and non-restorative sleep, are very common in the general population (Ohayon and Reynolds 2009; Ohayon 2005) and in patients with cognitive and psychiatric disorders (Nissen et al. 2006; Riemann and Voderholzer 2003; Baglioni et al. 2010). Sleep studies in such patients sometimes reveal organic disorders such as sleep apnea or a movement disorder. However, in many cases, sleep studies provide no explanation for the patient’s complaint. Management of such patients is problematic. This is not a trivial issue since there is increasing evidence that poor sleep is a risk factor for cognitive impairment (Nissen et al. 2006; Altena et al. 2008), mood disorders (Riemann and Voderholzer 2003; Baglioni et al. 2010), weight gain (Patel and Hu 2008; Spiegel et al. 2009), diabetes (Nilsson et al. 2004; Mallon et al. 2005), and increased overall mortality (Gallicchio and Kalesan 2009; Cappuccio et al. 2010).
A normal sleep study in the face of sleep complaints may indicate either that the complaint represents a perception problem or that the criteria currently used to evaluate sleep quality are not sensitive enough to identify poor sleep. There are reasons to believe the latter proposition and that, as suggested by Jackson et al. (Jackson and Bruck 2012), analysis of sleep microstructure may provide a fruitful alternative for uncovering differences during sleep in these individuals:
Apart from the above consideration, scoring of stages N1 and N3 is subject to much inter-rater variability (Malhotra et al. 2013; Anderer et al. 2005; Punjabi et al. 2015; Ferri et al. 1989; Norman et al. 2000; Collop 2002; Danker-Hopfe et al. 2004; Magalang et al. 2013; Zhang et al. 2015; Rosenberg and Van Hout 2013). In a recent study in which each epoch was scored manually three times by two senior technologists and once by another senior technologist (i.e. 7 scores for each epoch) the likelihood of an epoch scored N1 by any technologist being scored N1 in all other six scores was only 9.7% (Younes and Hanly PJ 2016). The corresponding likelihood for an epoch scored N3 by at least one scorer was 24%. Given this uncertainty about the scores of two of the three non-REM stages, it is difficult to have much confidence in using the fractions of time spent in each of these stages as indices of sleep quality/depth.
B) Conventional Indices of Sleep Quality are Difficult to Interpret: Sleep quality is conventionally evaluated by a number of variables that include sleep onset latency (SOL), sleep efficiency (SE), times spent in different non-REM stages, and extent of sleep disruption (e.g. arousal and awakening index (A/AW index) and wake after sleep onset (WASO)). The normal range for each of these variables is very wide so that it is difficult to conclude that a person’s sleep is poor unless one of these variables is grossly abnormal. Furthermore, in comparing two groups of patients, or the same patients in two conditions, the differences are often contradictory, for example SE may be better (higher) but N1% and/or A/AW index may be worse. Since the units of measurement of these indices are different (%, rate, minutes) the contradictory changes cannot be integrated into a unitary index that describes the net difference in sleep quality between the two groups/interventions.
A look-up table is consulted to determine the probability of each of the 10,000 patterns occurring in 30-second epochs scored awake or during an event scored as an arousal. This table was constructed from the results of manual scoring, by three very senior technologists, of the same PSGs containing the 3-second segments used to generate the 10,000 bin numbers. This table indicates that a segment with, for example, a bin number of 9549 was never seen except during arousals or in epochs staged awake (i.e. probability is 100%, Fig. 2). On the other hand, the table indicates that only 7% of segments with bin number 9846 are seen during wakefulness or arousals; the probability is 7% (Fig. 2). The 0 to 100 probability values were all divided by 40 (% awake time in the development PSGs) to generate the ORP. Thus, an ORP of 2.5 indicates a pattern that only occurs during wakefulness or in arousals, an ORP of 1.25 indicates a pattern with an equal probability of occurring during wakefulness or sleep and an ORP of 0 never occurs during wakefulness or in arousals.
The average of the 10 ORP values in each 30s epoch is the primary variable used in MSS to determine whether the patient is almost certainly awake (ORP >2.0), almost certainly asleep (ORP < 1.0) or is in an intermediate state (ORP 1.0–2.0) (Younes et al. 2015a). Epochs with intermediate values are staged awake or asleep based on a number of ancillary features. As indicated earlier, this staging system has proved quite accurate (Malhotra et al. 2013; Younes et al. 2015b; Younes et al. 2015c; Younes et al. 2016; Younes and Hanly PJ 2016). However, other than its utility in distinguishing wakefulness from sleep, ORP proved to be a good continuous measure of sleep depth, as indicated by the following observations (Younes et al. 2015a):
(A) Relation between ORP and conventional sleep stages: Figure 1 shows that average ORP in the 30s epochs decreased progressively as stage moved from full wakefulness (panel A) to deep sleep (panel F). Reflecting what the eye sees, there is little change in average ORP as stage moved from a “dozing” awake state (panel B) through stage 1 (Panel C) and early stage 2 (panel D) while there was a large drop in ORP within stage 2 as the pattern changed from one that resembles stage 1 (panel D) to a pattern that resembles stage 3 (panel E). Spindles are a traditional marker of stage 2 (Rechtschaffen and Kales 1968; Berry et al. 2012). However, spindles are present throughout stage 2, regardless of whether the background EEG pattern is close to that of stage 1 or stage 3, and there is no evidence that the first appearance of a spindle (or K complex) on an EEG background of stage 1 represents a major shift in sleep depth.
That ORP is consistently close to zero in N3 regardless of age, gender, body habitus, sleep pathology, equipment used or the sleep center where the study was performed (Fig. 3), is of particular importance since it indicates that when the patient is in the deepest sleep by current criteria, ORP is always near zero. This supports the notion that differences in ORP within other stages reflect differences in sleep depth. Had these differences been related to individual or technical differences ORP in stage N3 would have shown the same degree of variability.
(B) Relation between ORP and Arousability: By its very name, sleep depth reflects the ease with which the brain arouses in response to arousal stimuli (arousability); the lighter sleep is, the easier it is to arouse from a given stimulus (Philip et al. 1994; Roehrs et al. 1994; Berry et al. 1998). Arousal occurs when the intensity of a spontaneous or induced stimulus exceeds the intensity required to cause arousal; the arousal threshold. Thus, a high arousal/awakening index could indicate a generally low arousal threshold (light sleep), a high frequency of intense arousal stimuli, or both. Distinction between these two mechanisms is of obvious importance in determining the cause of sleep fragmentation.
Since ORP is lowest in N3 (Fig. 2) and arousability is lowest (Philip et al. 1994; Roehrs et al. 1994; Berry et al. 1998), it can be assumed that ORP correlates with conventionally measured arousal threshold. However, we wanted to determine if differences in ORP within lighter stages (Figs. 1 and 2) also reflect different degrees of arousability. Measurement of arousal threshold is typically performed by applying stimuli (e.g. sound) with different intensities and determining the minimum stimulus intensity that causes EEG arousal (Philip et al. 1994; Roehrs et al. 1994; Martin et al. 1997). Alternatively, if the arousal stimulus is known, it is determined by measuring the intensity of the known stimulus just before arousal (e.g. determining arousal threshold in OSA by measuring pharyngeal pressure just before arousal (Berry and Gleeson 1997)). Neither approach can be used to determine arousal threshold for spontaneous unknown stimuli. Furthermore, with the first approach, multiple stimulus intensities need to be applied to determine the minimum intensity at which arousal occurs and the sequence needs to be repeated several times during stable sleep to allow for the spontaneous changes in threshold (Philip et al. 1994; Roehrs et al. 1994). Thus, much time of relatively stable sleep is required to determine a single arousal threshold value that represents the average threshold over the period of testing. Accordingly, current approaches cannot be used to determine the instantaneous arousal threshold or the arousal threshold for stimuli responsible for spontaneous arousals.
The relation shown in Fig. 4 confirms that current ORP reflects the ease with which the brain can be aroused, and can therefore be used as a measure of arousability. It has advantages over conventional arousal threshold determination in that: a) No intervention is required. Therefore, it can be determined in clinical studies. b) Arousability can be determined on an epoch-by-epoch basis making it possible to examine dynamic changes in this important variable.
It is interesting to note that ORP-9 was independent of age, gender, body habitus or the sleep disorder (Younes and Hanly 2016). Furthermore, ORP-9 was not affected when patients with severe OSA were placed on CPAP despite reductions in A/AW index and in average ORP. Thus, ORP-9 is likely a trait.
In summary, average ORP during non-REM sleep is largely determined by the speed with which sleep deepens following arousals. When these dynamics are fast (low ORP-9), the patient returns to deep sleep very quickly and is resistant to all but very intense stimuli. Arousals will be infrequent and the patient remains in deep sleep (patient Y, Fig. 5b). However, when ORP-9 is high, the patient may or not progress to deep sleep depending on the frequency and intensity of arousal stimuli. In the presence of relatively frequent/strong stimuli these patients are more likely to sustain severe sleep fragmentation and to remain in light sleep throughout (patient X, Fig. 5b). It is well known that some healthy subjects are more prone to sleep disruption in the face of stress than others (Bonnet and Arand 2003; Drake et al. 2004) and that this trait may be inherited (Drake et al. 2008; Bonnet and Arand 2010; Heath et al. 1990). Post-arousal sleep dynamics may provide the basis for these inter-individual differences.
Investigation of Primary Insomnia: Availability of ORP during periods staged awake may help distinguish patients who are wide awake during these periods (Fig. 1a) from those who develop frequent mini-sleep periods but fail to progress to sustained sleep (e.g. Fig. 1b). Furthermore, it is now well established that a hyperarousal state exists in some patients with primary insomnia (Bonnet and Arand 2010; Riemann et al. 2010). The EEG representation of the hyperarousal state is an increase in power in the beta frequency range during sleep (Freedman 1986; Krystal et al. 2002; Perlis et al. 2001; Buysse et al. 2008). ORP is extremely sensitive to relative EEG beta power (Younes et al. 2015a). Accordingly, ORP during non-REM sleep should be elevated in patients with the hyperarousal state. It is possible that the etiology in patients who are wide awake during awake periods and develop high quality sleep when they sleep is related to lifestyle issues and these patients may be better candidates for cognitive behavioral therapy, whereas in those who fail to progress to deep sleep the problem is in central sleep control or excessive arousal stimuli from some source. The last two possibilities can be distinguished by ORP-9.
Investigation of paradoxical insomnia: Previous studies identified microstructure abnormalities in patients with paradoxical insomnia (Krystal et al. 2002; Perlis et al. 2001; Parrino et al. 2009). All reported abnormalities (increased beta activity (Perlis et al. 2001), decreased delta and increased alpha/beta activity (Buysse et al. 2008), and cyclic alternating pattern (Parrino et al. 2009)) result in a higher ORP during non-REM sleep (Younes et al. 2015a). Thus, having ORPNR available in clinical studies may help identify patients with abnormal sleep quality from those in whom the problem is in perception of sleep. Furthermore, in a recent study (Meza et al. 2016) in which we measured ORP during multiple sleep latency tests (MSLTs) and correlated ORP values with probability of sleep being perceived after each nap we identified patients who failed to perceive sleep despite reaching ORP levels that were followed by sleep perception in the vast majority of patients. Thus, measurement of ORP and post-nap sleep perception during MSLTs may help identify patients with a central perception abnormality.
Investigation of patients with idiopathic hypersomnia and non-restorative sleep: These symptoms may be related to poor quality sleep or a need to sleep longer than the patient is sleeping. As indicated earlier, sleep may be of poor quality (e.g. Fig. 1d) even though the patient spends a normal amount of time in stage N2. Knowledge of ORP in stage N2 may help identify those in whom the problem is poor sleep quality. In a recent study (Meza et al. 2016), we found that patients with excessive somnolence (Epworth scale 15.2 ± 3.0) and normal nocturnal sleep had, on average, significantly higher ORP values during non-REM sleep (Study #5, Fig. 2).
Evaluation of the impact of an intervention on sleep quality: A number of interventions are commonly used to improve sleep quality in patients with sleep disorders including mechanical devices (CPAP, mandibular devices) for respiratory sleep disorders and medications for insomnia, depression and nonrestorative sleep. As indicated above, conventional indices of sleep quality are not sensitive enough for this purpose and are often difficult to interpret. ORP may be suited for this purpose.
Enhancements to the multiple sleep latency test (MSLT) (Meza et al. 2016): Despite the fact that MSLTs are resource intensive, expensive and inconvenient to the patient the clinical utility of this test is very limited. Except for the occasional confirmation of narcolepsy, the only information gained is average sleep onset latency (SOL). A short SOL does not necessarily confirm pathologic somnolence since the range is extremely wide in asymptomatic subjects (Levine et al. 1988; Drake et al. 2010). Furthermore, a short SOL simply means that the patient managed to develop 15 s of light sleep (Berry et al. 2012) in no more than one epoch under conditions that are highly conducive to sleep. In many patients sleep does not progress beyond this extremely light phase (Meza et al. 2016). In a recent examination of 150 naps in 30 patients with excessive somnolence SOL was <5 min in 47 naps (21 patients). Of these, ORP decreased below 1.0 in only 13 naps (9 patients) and below 0.5 in only two naps in one patient (Meza et al. 2016). This indicates that within a given SOL there are gradations of objective sleepiness. Although, on average, patients with a SOL <5 min are at greater risk of motor vehicle accidents than those with SOL >10 min (Drake et al. 2010), the risk in an individual patient is difficult to assess from SOL; the difference in accident risk between the two groups was barely significant despite the fact that the study involved >600 patients followed for 10 years (Drake et al. 2010). It is possible that including the times at which different ORP values are reached may provide a better assessment of accident risk in individual patients (Meza et al. 2016).
Real time applications: ORP can be calculated very quickly and a monitor that outputs ORP in real time (every 3 s and/or as a moving average) has become available (Younes et al. 2016). Such information may be useful in monitoring depth of sedation in intensive care units. As well, ORP may be useful in detecting periods of intermittent dozing during activities that require vigilance (e.g. compare Fig. 1a and b).
Assessment of arousal intensity
It is possible that differences in arousal intensity between subjects may explain why some patients develop more daytime symptoms than others for the same degree of sleep fragmentation. It is also possible that the heart rate response to arousal may be predictive for development of cardiovascular complications in patients with sleep fragmentation. Availability of this information in clinical sleep studies would facilitate investigation of these possibilities.
Assessment of alpha intrusion (alpha-delta sleep)
Intrusion of alpha activity in non-REM sleep is frequently present in patients with fibromyalgia, chronic fatigue and non-restorative sleep (Anch et al. 1991; Branco et al. 1994; Moldofsky et al. 1975; Olsen et al. 2013), arthritis (Mahowald et al. 1989), insomnia (Martinez et al. 2010; Riedner et al. 2016) and depression (Hauri and Hawkins 1973; Jaimchariyatam et al. 2011). Although it may be seen in asymptomatic subjects (Scheuler et al. 1983; Horne and Shackell 1991), its prevalence and extent are clearly greater in these disorders such that a clinical association is well established. Whether alpha intrusion causes the patient’s complaints, is a consequence of disruptive stimuli, or both is not clear (Riedner et al. 2016; Pivik and Harman 1995; Stone et al. 2008). Large studies are needed to identify its clinical significance.
Visual quantification of the alpha intrusions in routine sleep studies is impractical. Utilization of this potentially useful marker in clinical practice has been hampered by the need for digital analysis and lack of quantitative guidelines for its identification and quantification. In order to generate ORP, our clinical sleep scoring program performs spectral analysis on consecutive 3-second epochs throughout the PSG and calculates power in different EEG frequency ranges including the alpha range (Younes et al. 2015a). By comparing the 3-second alpha power with the corresponding visual appearance of the EEG we established a threshold of 30 μV2 for what one can confidently score as alpha intrusion. The fraction of 3-second epochs with ORP <1.0 (i.e. patient is clearly asleep) that meet this threshold is reported as the alpha intrusion index. The alpha intrusion index was evaluated in 448 PSGs scored by MSS. In 60% of patients the index was <1% while it was >5% in 15% of patients and >20% in 4% of patients. This information is presented not to suggest that the threshold for scoring alpha intrusion should be the same as used here. The criteria can obviously be changed with experience or by consensus. Rather, it is presented to show that if clinical PSGs are routinely subjected to digital analysis such an index, regardless of what criteria are used to measure it, can be painlessly obtained in a limitless number of studies, making it possible to identify its clinical significance easily and inexpensively.
Assessment of sleep spindles and K complexes
Sleep spindles have been extensively investigated in research studies (recently reviewed by Clawson et al. (Clawson et al. 2016)). It is clear that spindles are involved in learning and memory (Clemens et al. 2006; Cox et al. 2014; Yotsumoto et al. 2009) and their characteristics are correlated with intelligence and cognitive ability (Geiger et al. 2011; Fogel et al. 2007; Schabus et al. 2006). They are greatly reduced in developmental abnormalities in children (Ellingson and Peters 1980; Selvitellia et al. 2009; Godbout et al. 2000; Limoges et al. 2005), in adult schizophrenia (Ferrarelli et al. 2007; Ferrarelli et al. 2010; Manoach et al. 2010; Manoach et al. 2014) and in patients with Parkinson’s disease with dementia (Latreille et al. 2015). Spindle density, duration and amplitude decrease with age but the rate of decline is not the same in all subjects (Nicolas et al. 2001; Crowley et al. 2002; Guazzelli et al. 1986; Wei et al. 1999; Principe and Smith 1982). There is a correlation between age-related decline in spindle activity and decline in cognitive functioning (Peters et al. 2008; Mander et al. 2014). Sleep disruption by sleep-related disorders (e.g. sleep apnea,) is frequently associated with cognitive impairment. It is not known whether cognitive impairment resulting from sleep fragmentation, per se, is also associated with reduced spindle activity. Availability of information about spindle characteristics during clinical studies before and after correction of the sleep fragmentation would make it possible to easily address this issue. Furthermore, should it become evident that cognitive impairment due to sleep disruption, per se, is not associated with reduced spindle activity, or is not reversible if present, it will be clear that reduction of spindle activity is at least a marker for the presence of a neurodegenerative process.
Likewise, K complexes (Rechtschaffen and Kales 1968; Loomis et al. 1939) have been extensively investigated (see (Halasz 2005) (Halasz 2005) and Halasz (Halász 2015), for reviews). K complexes can be routinely evoked by experimental stimuli (e.g. noise or airway obstruction) but also occur spontaneously during stages N2 and N3 of non-REM sleep. Because of the similarity between K complexes and some of the delta waves encountered in deep sleep it is possible that some spontaneous complexes represent preliminary appearance of deeper sleep (De Gennaro et al. 2000). However, because the delta waves of deep sleep have no consistent pattern, it is reasonable to assume that a high frequency of slow waves with a consistent K complex appearance reflects a high frequency of naturally occurring noxious stimuli. Knowledge of the frequency of K complexes may therefore be helpful in identifying the presence of excessive subthreshold arousal stimuli that may contribute to the patient’s complaints. Excessive K complexes in the absence of a clear cause in the PSG (e.g. sleep disordered breathing, PLMs) may prompt a search for, and correction of, other somatic or environmental sources of arousal stimuli.
In the current visual scoring of clinical studies spindles and K complexes are used exclusively to identify stage N2 (Berry et al. 2012). There is no consideration of spindle characteristics or frequency of K complexes. Accordingly, such potentially useful information is not captured. A number of digital methods for identifying and characterizing spindles (Ferrarelli et al. 2007; Martin et al. 2013; Wamsley et al. 2012; Mölle et al. 2002; Bódizs et al. 2009; Wendt et al. 2012; Devuyst et al. 2010; Lajnef et al. 2015b; Ray et al. 2015) and K complexes (Bremer et al. 1970; Krohne et al. 2014; Richard and Lengelle 1998; Bankman et al. 1992; Parekh et al. 2015) have been proposed and used in research studies but none has been adapted to clinical studies. Although there is agreement on the visual appearance of these events (Berry et al. 2012), there is no agreement on how to define them in quantitative terms. This and the considerable inter-scorer variability in visual scoring of these events (Warby et al. 2014; Wendt et al. 2015) have made it difficult to arrive at the “optimal” digital approach. In the opinion of this writer, it is preferable to begin using any reasonable approach, and refine it later if necessary, than wait for a consensus that has been elusive for over 50 years. Once such an approach becomes routinely available, its results in normal people can be established, making it possible to determine when a patient’s value is abnormal.
As indicated earlier, there are three validated commercial systems for digital sleep scoring (Morpheus, somnolyzer, MSS). Since all three are capable of breaking down non-REM sleep into its three stages, all include algorithms for spindle and K complex detection. There is no information regarding these algorithms in Morpheus or Somnolyzer. The algorithms in MSS have proven robust enough such that when spindles and K complexes identified by this system were used to edit (overrule) the manual scoring of non-REM sleep N1/N2 discrepancies between scorers decreased from 42 ± 36 epochs/PSG to 10 ± 10 epochs/PSG (Younes and Hanly PJ. Minimizing Interrater Variability in Staging Sleep by Use of Computer-Derived Features. J Clin Sleep Med 2016). The algorithms used by MSS to identify spindles and K complexes have been described before (Younes and Hanly PJ 2016). In addition to calculating the frequency of the two events in stage N2, the software also determines average spindle duration and power. In 316 PSGs scored by MSS, average spindle density over all N2 time in each central derivation (C3/M2, C4/M1) ranged 0.2 to 8.9 min−1 in different subjects and K complex density ranged from 0.09 to 0.84 min−1. Average spindle duration ranged from 1.05 to 1.7 s and average spindle power ranged from 1.9 to 117.0 μV2. These values are presented here to show that there is a wide range in all these characteristics within the clinical sleep population, which likely reflects clinical/pathological differences between patients, and also to show the ease with which a large amount of such information can be obtained if digital identification of these characteristics becomes a routine component of EEG analysis.
It is argued that the technology of digital sleep scoring has progressed enough to make it possible to obtain reliable, reproducible scoring, comparable in accuracy to that of highly trained technologists, with minimal editing. At the same time, it has become clear that inter-rater variability in scoring sleep is sufficiently serious as to raise doubt about the validity of R&K’s N1 to N3 stages as a measure of sleep depth. Apart from elimination of variability in conventional sleep assessment between scorers, and reduction in cost, inclusion of digital scoring in the routine analysis of clinical PSGs would make it possible to obtain information that is not possible to obtain with visual scoring. These include providing in each patient a continuous index of sleep depth, and quantitative estimates of arousal intensity, alpha intrusion, and characteristics of spindles and K complexes. Although the clinical utility of these indices has not yet been proven, there is sufficient information from scientific investigations that they might well explain some complaints/disorders that are currently not explained after conventional scoring. Widespread availability of this additional information at no cost and with no intervention would greatly facilitate research into the clinical utility of these indices.
The author acknowledges the contributions of all YRT employees, without whose work none of the new technologies could have been developed, and of the many collaborators in the research studies which evaluated these technologies (see references (Malhotra et al. 2013; Azarbarzin et al. 2014; Younes et al. 2015a; Azarbarzin et al. 2015; Younes et al. 2015b; Younes and Hanly 2016; Younes et al. 2015c; Meza et al. 2016; Younes et al. 2016; Younes and Hanly PJ 2016; Amatoury et al. 2016; Younes et al. J Clin Sleep Med. In Press.
Availability of data and materials
No datasets were generated or analyzed anew for this review.
The author was the sole contributor to this review.
MY (MD, FRCPC, PhD) is distinguished professor emeritus at the University of Manitoba.
MY is the owner of YRT Ltd, the company that developed the scoring system (MSS) and associated algorithms. A patent is pending for the ORP depth of sleep index.
Consent for publication
Ethics approval and consent to participate
No new experimental recordings were generated for this review. All data provided here that were generated in the author’s laboratory was: a) already published (see relevant publications for ethics approval), b) in submitted manuscripts (reference (Younes)) describing studies approved by the Research Ethics Board of the University of Manitoba, c) obtained from previously recorded PSGs used in published studies, or d) clinical PSGs obtained at the Misericordia Sleep Center and scored by MSS (MSS is an approved scoring system by FDA and Health Canada). Patients undergoing clinical sleep studies at our center sign/decline to sign a consent form allowing the use of their anonymized results in research. Only data from patients who agreed to the use of their data was included here.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Altena A, van der Werf YD, Strijers RL, Van Someren EJ. Sleep loss affects vigilance: effects of chronic insomnia and sleep therapy. J Sleep Res. 2008;17:335–43.PubMedView ArticleGoogle Scholar
- Amatoury J, Azarbarzin A, Younes M, Jordan AS, Wellman A, Eckert DJ. Arousal Intensity is a Distinct Pathophysiological Trait in Obstructive Sleep Apnea. Sleep. 2016;39:2091–100.Google Scholar
- Anch AM, Lue FA, MacLean AW, Moldofsky H. Sleep physiology and psychological aspects of the fibrositis (fibromyalgia) syndrome. Can J Psychol. 1991;45:179–84.PubMedView ArticleGoogle Scholar
- Anderer P, Gruber G, Parapatics S, Woertz M, Miazhynskaia T, Klosch G, et al. An E-health solution for automatic sleep classification according to rechtschaffen and kales: validation study of the somnolyzer 24 x 7 utilizing the siesta database. Neuropsychobiology. 2005;51:115–33.PubMedView ArticleGoogle Scholar
- Azarbarzin A, Ostrowski M, Hanly P, Younes M. Relationship between arousal intensity and heart rate response to arousal. Sleep. 2014;37:645–53.PubMedPubMed CentralGoogle Scholar
- Azarbarzin A, Ostrowski M, Keenan B, Younes M, Kuna S. Arousal responses during overnight polysomhography and their reproducibility in healthy young adults. Sleep. 2015;38:1313–21.PubMedPubMed CentralGoogle Scholar
- Baglioni C, Spiegelhalder K, Lombardo C, Riemann D. Sleep and emotions: focus on insomnia. Sleep Med Rev. 2010;14:227–38.PubMedView ArticleGoogle Scholar
- Bankman IN, Sigillito VG, Wise RA, Smith PL. Feature-based detection of the K-complex wave in the human electroencephalogram using neural networks. IEEE Trans Biomed Eng. 1992;39:1305–10.PubMedView ArticleGoogle Scholar
- Berry RB, Gleeson K. Respiratory arousal from sleep: mechanisms and significance. Sleep. 1997;20:654–75.PubMedGoogle Scholar
- Berry RB, Asyali MA, McNellis MI, Khoo MC. Within-night variation in respiratory effort preceding apnea termination and EEG delta power in sleep apnea. J Appl Physiol (1985). 1998;85:1434–41.Google Scholar
- Berry RB, Budhiraja R, Gottlieb DJ, Gozal D, Iber C, Kapur VK. Rules for scoring respiratory events in sleep: update of the 2007 AASM manual for the scoring of sleep and associated events. J Clin Sleep Med. 2012;8:597–619.PubMedPubMed CentralGoogle Scholar
- Bódizs R, Körmendi J, Rigó P, Lázár AS. The individual adjustment method of sleep spindle analysis: methodological improvements and roots in the fingerprint paradigm. J Neurosci Methods. 2009;178:205–13.PubMedView ArticleGoogle Scholar
- Bonnet MH, Arand DL. Situational insomnia: consistency, predictors, and outcomes. Sleep. 2003;26:1029–36.PubMedGoogle Scholar
- Bonnet MH, Arand DL. Hyperarousal and insomnia: state of the science. Sleep Med Rev. 2010;14:9–15.PubMedView ArticleGoogle Scholar
- Branco J, Atalaia A, Paiva T. Sleep cycles and alpha-delta sleep in fibromyalgia syndrome. J Rheumatol. 1994;21:1113–7.PubMedGoogle Scholar
- Bremer G, Smith JR, Karacan I. Automatic detection of the K-complex in sleep electroencephalograms. IEEE Trans Biomed Eng. 1970;17:314–23.PubMedView ArticleGoogle Scholar
- Buysse DJ, Germain A, Hall ML, et al. EEG spectral analysis in primary insomnia: NREM period effects and sex differences. Sleep. 2008;31:1673–82.PubMedPubMed CentralGoogle Scholar
- Cappuccio FP, D’Elia L, Strazzullo P, Miller MA. Sleep duration and all-cause mortality: a systematic review and meta-analysis of prospective studies. Sleep. 2010;33:585–92.PubMedPubMed CentralGoogle Scholar
- Clawson BC, Durkin J, Aton SJ. Form and function of sleep spindles across the lifespan. Neural Plast. 2016;2016:6936381. doi:10.1155/2016/6936381. Epub 2016 Apr 14.PubMedPubMed CentralGoogle Scholar
- Clemens Z, Fabo D, Hal’asz P. Twenty-four hours retention of visuospatial memory correlates with the number of parietal sleep spindles. Neurosci Lett. 2006;403:52–6.PubMedView ArticleGoogle Scholar
- Collop NA. Scoring variability between polysomnography technologists in different sleep laboratories. Sleep Med. 2002;3:43–7.PubMedView ArticleGoogle Scholar
- Cox R, Hofman WF, de Boer M, Talamini LM. Local sleep spindle modulations in relation to specific memory cues. NeuroImage. 2014;99:103–10.PubMedView ArticleGoogle Scholar
- Crowley K, Trinder J, Kim Y, Carrington M, Colrain IM. The effects of normal aging on sleep spindle and K-complex production. Clin Neurophysiol. 2002;113:1615–22.PubMedView ArticleGoogle Scholar
- Danker-Hopfe H, Kunz D, Gruber G, Klösch G, Lorenzo JL, Himanen SL, et al. Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders. J Sleep Res. 2004;13:63–9.PubMedView ArticleGoogle Scholar
- De Gennaro L, Ferrara M, Bertini M. The spontaneous K-complex during stage 2 sleep: is it the ‘forerunner’ of delta waves? Neurosci Lett. 2000;291:41–3.PubMedView ArticleGoogle Scholar
- Devuyst S, Dutoit T, Stenuit P, Kerkhofs M. Automatic K-complexes detection in sleep EEG recordings using likelihood thresholds. Conf Proc IEEE Eng Med Biol Soc. 2010;2010:4658–61.PubMedGoogle Scholar
- Drake C, Richardson G, Roehrs T, Scofield H, Roth T. Vulnerability to stress-related sleep disturbance and hyperarousal. Sleep. 2004;27:285–91.PubMedGoogle Scholar
- Drake CL, Scofield H, Roth T. Vulnerability to insomnia: the role of familial aggregation. Sleep Med. 2008;9:297–302.PubMedView ArticleGoogle Scholar
- Drake C, Roehrs T, Breslau N, Johnson E, Jefferson C, Scofield H, et al. The 10-year risk of verified motor vehicle crashes in relation to physiologic sleepiness. Sleep. 2010;33:745–52.PubMedPubMed CentralGoogle Scholar
- Ellingson RJ, Peters JF. Development of EEG and daytime sleep patterns in trisomy-21 infants during the first year of life: longitudinal observations. Electroencephalogr Clin Neurophysiol. 1980;50:457–66.PubMedView ArticleGoogle Scholar
- Ferrarelli F, Huber R, Peterson MJ, Massimini M, Murphy M, Riedner BA, et al. Reduced sleep spindle activity in schizophrenia patients. Am J Psychiatry. 2007;164:483–92.PubMedView ArticleGoogle Scholar
- Ferrarelli F, Peterson MJ, Sarasso S, Riedner BA, Murphy MJ, Benca RM, et al. Thalamic dysfunction in schizophrenia suggested by whole-night deficits in slow and fast spindles. Am J Psychiatry. 2010;167:1339–48.PubMedPubMed CentralView ArticleGoogle Scholar
- Ferri R, Ferri P, Colognola RM, Petrella MA, Musumeci SA, Bergonzi P. Comparison between the results of an automatic and a visual scoring of sleep EEG recordings. Sleep. 1989;12:354–62.PubMedGoogle Scholar
- Fogel SM, Nader R, Cote KA, Smith CT. Sleep spindles and learning potential. Behav Neurosci. 2007;12:1–10.View ArticleGoogle Scholar
- Freedman RR. EEG power spectra in sleep-onset insomnia. Electroencephalogr Clin Neurophysiol. 1986;63:408–13.PubMedView ArticleGoogle Scholar
- Gallicchio L, Kalesan B. Sleep duration and mortality: a systematic review and meta-analysis. J Sleep Res. 2009;18:148–58.PubMedView ArticleGoogle Scholar
- Geiger A, Huber R, Kurth S, Ringli M, Jenni OG, Achermann P. The sleep EEG as a marker of intellectual ability in school age children. Sleep. 2011;34:181–89.PubMedPubMed CentralGoogle Scholar
- Godbout R, Bergeron C, Limoges E, Stip E, Mottron L. A laboratory study of sleep in Asperger’s syndrome. Neuroreport. 2000;11:127–30.PubMedView ArticleGoogle Scholar
- Guazzelli M, Feinberg I, Aminoff M, Fein G, Floyd TC, Maggini C. Sleep spindles in normal elderly: comparison with young adult patterns and relation to nocturnal awakening, cognitive function and brain atrophy. Electroencephalogr Clin Neurophysiol. 1986;63:526–39.PubMedView ArticleGoogle Scholar
- Halasz P. K-complex, a reactive EEG graphoelement of NREM sleep: an old chap in a new garment. Sleep Med Rev. 2005;9:391–412.PubMedView ArticleGoogle Scholar
- Halász P. The K-complex as a special reactive sleep slow wave - a theoretical update. Sleep Med Rev. 2015;29:34–40.PubMedView ArticleGoogle Scholar
- Hauri P, Hawkins DR. Alpha-delta sleep. Electroencephalogr Clin Neurophysiol. 1973;34:233–7.PubMedView ArticleGoogle Scholar
- Heath AC, Kendler KS, Eaves LJ, Martin NG. Evidence for genetic influences on sleep disturbance and sleep pattern in twins. Sleep. 1990;13:318–35.PubMedGoogle Scholar
- Horne JA, Shackell BS. Alpha-like EEG activity in non-REM sleep and the fibromyalgia (fibrositis) syndrome. Electroencephalogr Clin Neurophysiol. 1991;79:271–6.PubMedView ArticleGoogle Scholar
- Jackson ML, Bruck D. Sleep abnormalities in chronic fatigue syndrome/myalgic encephalomyelitis: a review. J Clin Sleep Med. 2012;8:719–28.PubMedPubMed CentralGoogle Scholar
- Jaimchariyatam N, Rodriguez CL, Budur K. Prevalence and correlates of alpha-delta sleep in major depressive disorders. Innov Clin Neurosci. 2011;8:35–49.PubMedPubMed CentralGoogle Scholar
- Krohne LK, Hansen RB, Christensen JA, Sorensen HB, Jennum P. Detection of K-complexes based on the wavelet transform. Conf Proc IEEE Eng Med Biol Soc. 2014;2014:5450–3.PubMedGoogle Scholar
- Krystal AD, Edinger JD, Wohlgemuth WK, Marsh GR. NREM sleep EEG frequency spectral correlates of sleep complaints in primary insomnia subtypes. Sleep. 2002;25:630–40.PubMedGoogle Scholar
- Kubicki S, Herrmann WM. The future of computer-assisted investigation of the polysomnogram: sleep microstructure. J Clin Neurophysiol. 1996;13:285–94.PubMedView ArticleGoogle Scholar
- Lajnef T, Chaibi S, Ruby P, Aguera PE, Eichenlaub JB, Samet M, et al. Learning machines and sleeping brains: automatic sleep stage classification using decision-tree multi-class support vector machines. J Neurosci Methods. 2015a;250:94–105.PubMedView ArticleGoogle Scholar
- Lajnef T, Chaibi S, Eichenlaub JB, Ruby PM, Aguera PE, Samet M, et al. Sleep spindle and K-complex detection using tunable Q-factor wavelet transform and morphological component analysis. Front Hum Neurosci. 2015b;9:414.PubMedPubMed CentralView ArticleGoogle Scholar
- Latreille V, Carrier J, Lafortune M, Postuma RB, Bertrand JA, Panisset M, et al. Sleep spindles in Parkinson’s disease may predict the development of dementia. Neurobiol Aging. 2015;36:1083–90.PubMedView ArticleGoogle Scholar
- Levine B, Roehrs T, Zorick F, Roth T. Daytime sleepiness in young adults. Sleep. 1988;11:39–46.PubMedGoogle Scholar
- Limoges E, Mottron L, Bolduc C, Berthiaume C, Godbout R. Atypical sleep architecture and the autism phenotype. Brain. 2005;128:1049–61.PubMedView ArticleGoogle Scholar
- Loomis AL, Harvey EN, Hobart GA. Distribution of disturbance-patterns in the human electroencephalogram, with special reference to sleep. J Neurophysiol. 1939;2:413–30.Google Scholar
- Magalang UJ, Chen NH, Cistulli PA, Fedson AC, Gíslason T, Hillman D, et al. Agreement in the scoring of respiratory events and sleep among international sleep centers. Sleep. 2013;36:591–6.PubMedPubMed CentralGoogle Scholar
- Mahowald MW, Mahowald ML, Bundlie SR, Ytterberg SR. Sleep fragmentation in rheumatoid arthritis. Arthritis Rheum. 1989;32:974–83.PubMedView ArticleGoogle Scholar
- Malhotra A, Younes M, Kuna ST, Benca R, Kushida CA, Walsh J, et al. Performance of an automated polysomnography scoring system versus computer-assisted manual scoring. Sleep. 2013;36:573–82.PubMedPubMed CentralGoogle Scholar
- Mallon L, Broman JE, Hetta J. High incidence of diabetes in men with sleep complaints or short sleep duration. Diabetes Care. 2005;28:2762–7.PubMedView ArticleGoogle Scholar
- Mander BA, Rao V, Lu B, Saletin JM, Ancoli-Israel S, Jagust WJ, Walker MP. Impaired prefrontal sleep spindle regulation of hippocampal-dependent learning in older adults. Cereb Cortex. 2014;24:3301–9.PubMedView ArticleGoogle Scholar
- Manoach DS, Thakkar KN, Stroynowski E, Ely A, McKinley SK, Wamsley E, et al. Reduced overnight consolidation of procedural learning in chronic medicated schizophrenia is related to specific sleep stages. J Psychiatr Res. 2010;44:112–20.PubMedView ArticleGoogle Scholar
- Manoach DS, Demanuele C, Wamsley EJ EJ, Vangel M, Montrose DM, Miewald J, et al. Sleep spindle deficits in antipsychotic-naïve early course schizophrenia and in non-psychotic first-degree relatives. Front Hum Neurosci. 2014;8:762. doi:10.3389/fnhum.2014.00762.eCollection2014.PubMedPubMed CentralView ArticleGoogle Scholar
- Martin SE, Wraith PK, Deary IJ, Douglas NJ. The effect of nonvisible sleep fragmentation on daytime function. Am J Respir Crit Care Med. 1997;155:1596–601.PubMedView ArticleGoogle Scholar
- Martin N, Lafortune N, Godbout J, Barakat M, Robillard R, Poirier G, et al. Topography of age-related changes in sleep spindles. Neurobiol Aging. 2013;34:468–76.PubMedView ArticleGoogle Scholar
- Martinez D, Breitenbach TC, Lenz MDCS. Light sleep and sleep time misperception - relationship to alpha-delta sleep. Clin Neurophysiol. 2010;121:704–11.PubMedView ArticleGoogle Scholar
- Meza S, Giannouli E, Younes M. Enhancements to the multiple sleep latency test. Nat Sci Sleep. 2016;8:145–58.Google Scholar
- Moldofsky H, Scarisbrick P, England R, Smythe H. Musculosketal symptoms and non-REM sleep disturbance in patients with “fibrositis syndrome” and healthy subjects. Psychosom Med. 1975;37:341–51.PubMedView ArticleGoogle Scholar
- Mölle M, Marshall L, Gais S, Born J. Grouping of spindle activity during slow oscillations in human non-rapid eye movement sleep. J Neurosci. 2002;22:10941–7.PubMedGoogle Scholar
- Nicolas A, Petit D, Rompré S, Montplaisir J. Sleep spindle characteristics in healthy subjects of different age groups. Clin Neurophysiol. 2001;112:521–7.PubMedView ArticleGoogle Scholar
- Nilsson PM, Rööst M, Engström G, Hedblad B, Berglund G. Incidence of diabetes in middle-aged men is related to sleep disturbances. Diabetes Care. 2004;27:2464–69.PubMedView ArticleGoogle Scholar
- Nissen C, Kloepfer C, Nofzinger EA, Feige B, Voderholzer U, Riemann D. Impaired sleep-related memory consolidation in primary insomnia. Sleep. 2006;29:1068–73.PubMedGoogle Scholar
- Norman RG, Pal I, Stewart C, Walsleben JA, Rapoport DM. Interobserver agreement among sleep scorers from different centers in a large dataset. Sleep. 2000;23:901–8.PubMedGoogle Scholar
- Ohayon MM. Prevalence and correlates of nonrestorative sleep complaints. Arch Intern Med. 2005;165:35–41.PubMedView ArticleGoogle Scholar
- Ohayon M, Reynolds III CF. Epidemiological and clinical relevance of insomnia diagnoses algorithms according to the DSM-IV and the international classification of sleep disorders (ICSD). Sleep Med. 2009;10:952–60.PubMedPubMed CentralView ArticleGoogle Scholar
- Olsen MN, Sherry DD, Boyne K, McCue R, Gallagher PR, Brooks LJ. Relationship between sleep and pain in adolescents with juvenile primary fibromyalgia syndrome. Sleep. 2013;36:509–16.PubMedPubMed CentralGoogle Scholar
- Parekh A, Selesnick IW, Rapoport DM, Ayappa I. Detection of K-complexes and sleep spindles (DETOKS) using sparse optimization. J Neurosci Methods. 2015;251:37–46.PubMedView ArticleGoogle Scholar
- Parrino L, Milioli G, De Paolis F, Grassi A, Terzano MG. Paradoxical insomnia: the role of CAP and arousals in sleep misperception. Sleep Med. 2009;10:1139–45.PubMedView ArticleGoogle Scholar
- Patel S, Hu FB. Short sleep duration and weight gain: a systematic review. Obesity. 2008;16:643–53.PubMedPubMed CentralView ArticleGoogle Scholar
- Penzel T, Hirshkowitz M, Harsh J, Chervin RD, Butkov N, Kryger M, et al. Digital analysis and technical specifications. J Clin Sleep Med. 2007;3:109–20.PubMedGoogle Scholar
- Perlis ML, Smith MT, Andrews PJ, Orff H, Giles DE. Beta/Gamma EEG activity in patients with primary and secondary insomnia and good sleeper controls. Sleep. 2001;24:110–7.PubMedGoogle Scholar
- Peters KR, Rockwood K, Black SE, Hogan DB, Gauthier SG, Loy-English I, et al. Neuropsychiatric symptom clusters and functional disability in cognitively-impaired-not-demented individuals. Am J Geriatr Psychiatry. 2008;16:136–44.PubMedView ArticleGoogle Scholar
- Philip P, Stoohs R, Guilleminault C. Sleep fragmentation in normals: a model for sleepiness associated with upper airway resistance syndrome. Sleep. 1994;17:242–7.PubMedGoogle Scholar
- Pittman SD, MacDonald MM, Fogel RB, Malhotra A, Todros K, Levy B, et al. Assessment of automated scoring of polysomnographic recordings in a population with suspected sleepdisordered breathing. Sleep. 2004;27:1394–403.PubMedGoogle Scholar
- Pivik RT, Harman K. A reconceptualization of EEG alpha activity as an index of arousal during sleep: all alpha activity is not equal. J Sleep Res. 1995;4:131–37.PubMedView ArticleGoogle Scholar
- Principe JC, Smith JR. Sleep spindle characteristics as a function of age. Sleep. 1982;5:73–84.PubMedGoogle Scholar
- Punjabi NM, Shifa N, Doffner G, Patil S, Pien G, Aurora RN. Computerassisted automated scoring of polysomnograms using the somnolyzer system. Sleep. 2015;38:1555–66.PubMedPubMed CentralView ArticleGoogle Scholar
- Ray LB, Sockeel S, Soon M, Bore A, Myhr A, Stojanoski B, et al. Expert and crowd-sourced validation of an individualized sleep spindle detection method employing complex demodulation and individualized normalization. Front Hum Neurosci. 2015;9:507.PubMedPubMed CentralView ArticleGoogle Scholar
- Rechtschaffen A, Kales A. A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects. Washington, DC: National Institute of Health, Publ. 204, US Government Printing Office; 1968.Google Scholar
- Richard C, Lengelle R. Joint time and time-frequency optimal detection of K-complexes in sleep EEG. Comput Biomed Res. 1998;31:209–29.PubMedView ArticleGoogle Scholar
- Riedner BA, Goldstein MR, Plante DT, Rumble ME, Ferrarelli F, Tononi G, et al. Regional patterns of elevated alpha and high-frequency electroencephalographic activity during nonrapid eye movement sleep in chronic insomnia: a pilot study. Sleep. 2016;39:801–12.PubMedPubMed CentralView ArticleGoogle Scholar
- Riemann D, Voderholzer U. Primary insomnia: a risk factor to develop depression? J Affect Disorders. 2003;76:255–59.PubMedView ArticleGoogle Scholar
- Riemann D, Spiegelhalder K, Feige B, Voderholzer U, Berger M, Perlis M, et al. The hyperarousal model of insomnia: a review of the concept and its evidence. Sleep Med Rev. 2010;14:19–31.PubMedView ArticleGoogle Scholar
- Roehrs T, Merlotti L, Petrucelli N, Stepanski E, Roth T. Experimental sleep fragmentation. Sleep. 1994;17:438–43.PubMedGoogle Scholar
- Rosenberg RS, Van Hout S. The American academy of sleep medicine interscorer reliability program: sleep stage scoring. J Clin Sleep Med. 2013;9:81–7.PubMedPubMed CentralGoogle Scholar
- Schabus M, Hodlmoser KH, Gruber G, Sauter C, Anderer P, Klösch G, et al. Sleep spindle-related activity in the human EEG and its relation to general cognitive and learning abilities. Eur J Neurosci. 2006;23:1738–46.PubMedView ArticleGoogle Scholar
- Scheuler W, Stinshoff D, Kubicki S. The alpha-sleep pattern. Differentiation from other sleep patterns and effect of hypnotics. Neuropsychobiology. 1983;10:183–9.PubMedView ArticleGoogle Scholar
- Selvitellia MF, Krishnamurthya KB, Herzog AG, Schomer DL, Chang BS. Sleep spindle alterations in patients with malformations of cortical development. Brain Dev. 2009;31:163–8.View ArticleGoogle Scholar
- Spiegel K, Tasali E, Leproult R, Van Cauter E. Effects of poor and short sleep on glucose metabolism and obesity risk. Nat Rev Endocr. 2009;5:253–61.View ArticleGoogle Scholar
- Stone KC, Taylor DJ, McCrae CS, Kalsekar A, Lichstein KL. Nonrestorative sleep. Sleep Med Rev. 2008;12:275–88.PubMedView ArticleGoogle Scholar
- Wamsley EJ, Tucker MA, Shinn AK, Ono KE, McKinley SK, Ely AV, et al. Reduced sleep spindles and spindle coherence in schizophrenia: mechanisms of impaired memory consolidation? Biol Psychiatry. 2012;71:154–61.PubMedView ArticleGoogle Scholar
- Warby SC, Wendt SL, Welinder P, Munk EG, Carrillo O, Sorensen HB, et al. Sleep-spindle detection: crowdsourcing and evaluating performance of experts, non-experts and automated methods. Nat Methods. 2014;11:385–92.PubMedPubMed CentralView ArticleGoogle Scholar
- Wei HG, Riel E, Czeisler CA, Dijk DJ. Attenuated amplitude of circadian and sleep-dependent modulation of electroencephalographic sleep spindle characteristics in elderly human subjects. Neurosci Lett. 1999;260:29–32.PubMedView ArticleGoogle Scholar
- Wendt SL, Christensen JA, Kempfner J, Leonthin HL, Jennum P, Sorensen HB. Validation of a novel automatic sleep spindle detector with high performance during sleep in middle aged subjects. Conf Proc IEEE Eng Med Biol Soc. 2012;2012:4250–3.PubMedGoogle Scholar
- Wendt SL, Welinder P, Sorensen HB, Peppard PE, Jennum P, Perona P, et al. Inter-expert and intra-expert reliability in sleep spindle scoring. Clin Neurophysiol. 2015;126:1548–56.PubMedView ArticleGoogle Scholar
- Yotsumoto Y, Sasaki Y, Chan P, Vasios CE, Bonmassar G, Ito N, et al. Location-specific cortical activation changes during sleep after training for perceptual learning. Curr Biol. 2009;19:1278–82.PubMedPubMed CentralView ArticleGoogle Scholar
- Younes M. Role of arousals in the pathogenesis of obstructive sleep apnea. Amer J Respir Crit Care Med. 2004;169:623–33.View ArticleGoogle Scholar
- Younes M, Soiferman M, Thompson W, Giannouli E. Performance of a New Portable Wireless Sleep Monitor. J Clin Sleep Med. 2016. Acceptable for Publication with 2016 Oct 20.Google Scholar
- Younes M, Hanly PJ. Immediate post-arousal sleep dynamics: an important determinant of sleep stability in obstructive sleep apnea. J Appl Physiol. 2016;120:801–8.PubMedView ArticleGoogle Scholar
- Younes M, Hanly PJ. Minimizing Interrater Variability in Staging Sleep by Use of Computer-Derived Features. J Clin Sleep Med. 2016. [Epub ahead of print].Google Scholar
- Younes M, Ostrowski M, Soiferman M, Younes H, Younes M, Raneri J, Hanly P. Odds ratio product of sleep EEG as a continuous measure of sleep state. Sleep. 2015a;28:641–54.Google Scholar
- Younes M, Thompson W, Leslie C, Egan T, Giannouli E. Utility of technologist editing of polysomnography scoring performed by a validated automatic system. Ann Am Thorac Soc. 2015b;12:1206–18.PubMedGoogle Scholar
- Younes M, Younes M, Giannouli E. Accuracy of automatic polysomnography scoring using frontal electrodes. J Clin Sleep Med. 2015c;12:735–46.View ArticleGoogle Scholar
- Younes M, Raneri J, Hanly P. Staging sleep in polysomnograms: analysis of inter-scorer variability. J Clin Sleep Med. 2016;12:885–94.PubMedPubMed CentralView ArticleGoogle Scholar
- Zhang X, Dong X, Kantelhardt JW, Li J, Zhao L, Garcia C, et al. Process and outcome for international reliability in sleep scoring. Sleep Breath. 2015;19:191–5.PubMedView ArticleGoogle Scholar