- Open Access
Refining sleep measurement using the Motionwatch8©: how many days of monitoring do we need to get reliable estimates of sleep quality for older adults with mild cognitive impairment?
Sleep Science and Practice volume 4, Article number: 11 (2020)
Poor sleep is common among older adults with mild cognitive impairment (MCI)—a transition stage between healthy cognition and dementia. Objective, reliable, and low-burden field methods to measure older adult sleep are also currently needed. The MotionWatch8© (MW8) wrist-worn actigraph provides estimates of sleep with 14 days of observation; however, there may be underlying differences in the reliability of sleep estimates based on MCI status. We therefore investigated the number of MW8 monitoring days required to estimate sleep in older adults with MCI and without.
Older adults (55+ years; N = 151) wore the MW8 for ≥14 days. The Montreal Cognitive Assessment was used to categorize participants with probable MCI (scores of < 26/30) and participants without MCI (≥ 26/30). We calculated intra-class reliability coefficients for one, seven, and 14 days of wear-time, and performed Spearman-Brown predictions to determine the number of monitoring days needed for an ICC = 0.80.
Older adults with MCI were older (p < 0.01), more likely to be male (p = 0.03), and had shorter sleep duration (p < 0.01). Spearman-Brown analyses indicated that the number of monitoring days needed for an ICC = 0.80 in older adults with probable MCI was 7 days for sleep duration, 4 days for fragmentation, and 4 days for efficiency; adults without MCI required 4 days for duration, 6 days for fragmentation, and 3 days for efficiency.
Our results indicate that while the reliability of MW8 estimates of sleep differs based on cognitive status, 7 days of MW8 monitoring provides reliable estimates of sleep for adults with MCI and those without.
Promoting older adult cognitive health is a public health priority since the number of older adults with cognitive impairment and dementia is increasing (Jacqmin-Gadda et al., 2013). Lifestyle and behavioural modification strategies which promote or maintain cognitive health are thus a frontline, low-cost, and increasingly popular line of research inquiry.
Good quality sleep is one lifestyle factor which is a pillar of healthy cognitive aging (Scullin, 2017; Yaffe et al., 2014; Liu-Ambrose & Falck, 2019). Sleep is critical for the maintenance of cognitive function and for brain function (Lowe et al., 2017; Banks & Dinges, 2007; Killgore, 2010). While the importance of sleep for cognitive health does not change with age (Scullin, 2017), there are changes in sleep which occur as a normal part of the aging process – both in terms of decreased quality and quantity (Crowley, 2011; Espiritu, 2008). However, more than half of adults over 65 years of age report at least one chronic sleep complaint—the most common being the inability to stay asleep at night (Foley et al., 1995). One reason is age-associated changes in the sleep-wake cycle of older adults (Crowley, 2011; Landry & Liu-Ambrose, 2014). For example, homeostatic drive (i.e., Process S) declines with age (Borbély et al., 2016). Older adults also commonly report excessive daytime sleepiness—which is a key indicator of accumulated sleep debt (Espiritu, 2008).
While changes in sleep thus appear to be an unavoidable consequence of aging (Scullin, 2017; Yaffe et al., 2014; Crowley, 2011), older adults who sleep poorly are also at increased risk for mild cognitive impairment (MCI) and dementia (da Silva, 2015). MCI is classified as cognitive decline greater than expected for age and education level which does not interfere with independence (Petersen et al., 1999). An estimated 10–20% of adults over 65 years of age are living with MCI (Langa & Levine, 2014), which is associated with up to a 30% increased risk of developing dementia within 5 years (Petersen, 2004). MCI thus represents a transition period between healthy cognitive aging and dementia, wherein lifestyle factors such as sleep may be critical to maintaining cognitive health (Petersen et al., 2001). Importantly, older adults with MCI are more likely to experience poor sleep than healthy older adults (Naismith et al., 2014), and poor sleep is associated with an increased risk of progression from MCI to dementia (Tranah et al., 2011). Animal models indicate that chronic poor sleep leads to increased cortical amyloid-beta (Aβ)—a hallmark pathology of Alzheimer’s disease (Roh et al., 2012). Rodents which are deprived of sleep experience increased Aβ production (Kang et al., 2009), while in vivo animal models suggest sleep promotes the clearance of Aβ (Xie et al., 2013). Sleep is thus a critical pathway by which the brain appears to maintain cognitive health (Scullin, 2017; Yaffe et al., 2014; Liu-Ambrose & Falck, 2019). When this pathway is disrupted, a vicious cycle of accelerating cognitive decline may occur—whereby poor sleep may lead to increasing cognitive decline, and vice-versa (Ju et al., 2013).
Valid and reliable field methods for measuring sleep are thus needed to understand the impact of sleep on cognitive health. Sleep can be measured objectively using polysomnography, or it can be estimated using wrist-worn and hip-worn actigraphy (Krystal & Edinger, 2008). In addition, sleep can be estimated subjectively by questionnaire (Zinkhan et al., 2014; Landry et al., 2015a). The gold standard for measuring sleep is polysomnography (Scullin & Bliwise, 2015); however the invasive nature of polysomnography—usually requiring an overnight stay in a sleep laboratory or clinic—makes long-term multi-night recordings impractical. Subjective measures of sleep are quick and easy to administer and score, and can discriminate “good” vs. “poor” sleepers, but they are not able to detect subtle but clinically important changes in sleep due to age or disease (Landry et al., 2015a). Estimating sleep using actigraphy is therefore an increasingly popular alternative for measuring sleep, although it is open to issues of validity and reliability compared to polysomnography (Scullin & Bliwise, 2015). Nonetheless, actigraphy does provide an objective method of estimating sleep in a natural environment which can span multiple nights, thus delivering a clearer illustration of an older adult’s usual sleep pattern.
One readily-available actigraph capable of measuring sleep quality is the Motionwatch8© wrist-worn accelerometer (MW8; (Landry et al., 2015b)). Previous investigations with the device have observed sleep quality over a period of 14 days (Landry et al., 2015a; Falck et al., 2018), since this measurement protocol is based on current guidelines and past analyses of actigraphy (Ancoli-Israel et al., 2015; Van Someren, 2007); however, reducing the number of days necessary to wear the MW8 could reduce participant burden. Moreover, since older adults with MCI appear to have different sleep than their healthy cognitive counterparts (Naismith et al., 2014; Tranah et al., 2011), it is plausible that the MW8 may have different estimates of reliability for the measurement of sleep based on cognitive status. Hence, we examined the necessary number of days for obtaining reliable estimates of sleep in older adults with MCI and those without.
Ethical approval for this study was obtained from the Vancouver Coastal Health Research Institute and the University of British Columbia’s Clinical Research Ethics Board (H14–01301). All participants provided written informed consent.
Data for this study were collected as part of the Sleep and Cognition Study, a cross-sectional study examining the associations between sleep quality and cognition among older adults (Falck et al., 2017). We recruited and collected data between August 27, 2014 and June 30, 2016. Details of the full study protocol can be found elsewhere (Falck et al., 2017). We recruited 153 older adults from Vancouver, British Columbia by advertisements placed in local community centres, newspapers, and word of mouth referrals. Interested individuals were initially pre-screened for eligibility criteria.
Participants were included if they: 1) were 55+ years of age living the Greater Vancouver area; 2) scored ≥24/30 on the Mini-Mental State Examination (MMSE), with scoring of attention being performed using serial sevens (Folstein et al., 1975); and 3) were able to read, write, and speak English with acceptable visual and auditory acuity. Participants were excluded if they were: 1) diagnosed with dementia of any type; 2) diagnosed with another type of neurodegenerative or neurological condition; 3) taking medications that may negatively affect cognitive function; 4) planning to participate or were currently enrolled in a clinical drug trial; or 5) unable to speak as judged by an inability to communicate by phone. Individuals were not excluded based on use of medications which may affect sleep quality (either negatively or positively), nor were participants selected on the basis of their sleep.
Study design and measurement
At study entry, we ascertained general health, subjective sleep quality using the Pittsburgh Sleep Quality Index (PSQI; (Buysse et al., 1989)), height to the nearest 0.1 cm using a stadiometer, weight to the nearest 0.1 kg using an electronic scale, demographics, socioeconomic status, and education by a questionnaire. Height and weight were used to calculate body mass index (BMI; kg/m2; (Garrouste-Orgeas et al., 2004)). Global cognitive function was assessed by the MMSE (Folstein et al., 1975), and the Montreal Cognitive Assessment (MoCA; (Nasreddine et al., 2005)). We categorized participants based on MCI status with a score of < 26/30 on the MoCA indicating probable MCI, which has been found to have good internal consistency and test-retest reliability, and was able to correctly identify 90% of a large sample of MCI individuals from two different clinics (Nasreddine et al., 2005).
Participants were then fitted with the MW8 and provided detailed information on its features (i.e., the light sensor, event marker button, and status indicator). Participants were instructed to press the event marker button each night when they started trying to sleep, and again each morning when they finished trying to sleep. Consistent with established protocol for wrist-worn actigraphy, participants wore the MW8 on the non-dominant wrist (Ancoli-Israel et al., 2015; Sadeh, 2011).
Participants were also given the 9-item Consensus Sleep Diary (CSD) and asked to complete it each morning upon waking (Carney et al., 2012). The responses from the CSD were used to confirm sleep windows as determined by the time stamped event markers. In cases where the event marker and CSD entry disagreed for the start time of the sleep window, we used activity cessation and light sensor data from the MW8 to determine “lights out”. Similarly, when the event marker and CSD entry disagreed for the end of the sleep window, we used activity onset and “lights on” to determine the end of the sleep window. If responses from the CSD entry disagreed with the event markers entered by participants as the start of the day (i.e., participant finished trying to sleep, and was awake and out of bed), we used activity onset and light sensor data to determine the start of the day. Similarly, when the event marker and CSD entry disagreed for the end of day (i.e., participant in bed and trying to sleep), we used activity cessation and light sensor data to determine the end of the day. In accordance with the currently established protocol for measuring sleep quality via actigraphy (Ancoli-Israel et al., 2015; Sadeh, 2011), each participant was continuously monitored for a minimum of 14 nights. After collection, stored activity counts were downloaded and saved to an IBM compatible computer for subsequent data reduction and analysis.
MW8 instrumentation and data reduction
We measured sleep using the MW8 actigraphy system (CamNtech; Cambridge, United Kingdom). The MW8 is a tri-axial accelerometer designed to observe acceleration ranging in magnitude from 0.01G to 8G, with a frequency of 3-11 Hz. The filtered acceleration signal is digitized and the magnitude is summed over a user-specified time interval. At the end of each interval, the summed value or activity “count” is stored in memory and the integrator is reset. The MW8 is the updated version of the Actiwatch7, an actigraph with evidence of validity against polysomnography in healthy adults (Mean age: 30 ± 6 years; 45% female; (O’Hare et al., 2015)), and also adults with chronic insomnia (Mean age: 41 ± 12 years; 78% female; (Martoni et al., 2012)). There is also initial evidence of validity against polysomnography for the MW8 among 1) 54 adults with suspected sleep disorders including obstructive sleep apnea, insomnia, hypersomnia, and Ehlers Danlos syndrome (Mean Age: 53 ± 16 years; 61% female); and 2) 19 healthy adults (Mean Age: 28 ± 5 years; 53% female; (Elbaz et al., 2012)). For the current study, we used 60 s epochs (Ancoli-Israel et al., 2015; Sadeh, 2011).
Data were analyzed using MotionWare 1.0.27 (camntech) to estimate different sleep indices including: fragmentation index, sleep efficiency (time asleep expressed as a percentage of time in bed), sleep duration (total time spent sleeping), sleep latency (time between “lights out” and falling asleep), and wake after sleep onset (time spent awake after sleep has been initiated and before final awakening). Fragmentation index is a description of restlessness while sleeping and is defined by MotionWare as the sum of 1) the total time spent sleeping categorized as mobile in the epoch-by-epoch mobile/immobile categorization expressed as a percentage of the time spent asleep; and 2) the number of immobile bouts which were equal to 1 min in length expressed as a percentage of the total number of immobile bouts during time spent sleeping. Only minutes categorized as asleep were included in the calculation of fragmentation index.
We performed all of our statistical analyses using R version 3.3.1 using the psych, Hmisc, and ICC packages. Our statistical code can be found in Supplementary Material S1. Two participants did not complete the MoCA. These individuals were removed from analyses such that our final sample was 151 participants.
Participant characteristics based on probable MCI status
We calculated means and standard deviations for all variables of interest based upon probable MCI status (i.e., MoCA score < 26/30). We determined demographic differences in probable MCI status using independent sample t-tests for continuous variables and chi-square tests for categorical variables, using probable MCI status (yes/no) as the grouping variable. Subsequently, we performed analyses of covariance (ANCOVA) to determine differences in estimates of sleep quality based on probable MCI status. We performed separate ANCOVA models for each of our measures estimating sleep quality (i.e., PSQI total score, PSQI sleep duration, and MW8 measured sleep duration, fragmentation index, sleep efficiency, sleep latency, and wake after sleep onset). Within each ANCOVA model, we controlled for age, sex, and sleep medication use while using probable MCI status as the grouping variable.
Reliability of the MW8 for estimating sleep quality based on probable MCI status
We then calculated between-day intraclass correlations (ICC) and 95% confidence intervals (CIs) for one, four, seven and 14 days of monitoring, and classified ICCs according to the criteria of Koo and Li (Koo & Li, 2016). For single day ICC’s we used a single absolute intraclass correlation coefficient (ICC1,1) to determine single day expected reliability using the following formula (Denegar & Ball, 1993):
Wherein, BMS is the between subject mean square, the EMS is the residual error, TMS is the trial mean square, k refers to the number of trials (in this case, one trial), and N is the number of participants. We used all 14 days of data to calculate our single day ICCs. For our analysis of multiple day reliability, we used average random raters (ICC2,k) using the same formula, wherein k was the number of days monitored. For our calculations of four and 7 day reliability, we only used data from the first 4 and 7 days, respectively.
We also calculated the required days of monitoring needed to achieve ICC’s of 0.70, 0.80 and 0.90 using the Spearman-Brown prophecy formula (Hopkins, 1998). Subsequently, we calculated separate ICCs and Spearman-Brown prophecies for 1) participants with probable MCI and 2) those without MCI. We then performed z tests to determine if ICC estimates for our different sleep parameters differed significantly by MCI status after one, four, seven, and 14 days of monitoring.
Participant characteristics based on probable MCI status
Participant characteristics are described in Table 1. Mean participant age was 71.19 years (SD = 7.26; Range: 55–101 years), 66.89% of the sample was female, and 77.48% were retired. Average BMI was 26.71 kg/m2 (SD = 5.05; Range: 17.08–42.40 kg/m2), 13.25% of the sample used sleep medications, and average MMSE score was 28.89 (SD = 1.11; Range: 25–30). Average PSQI score was 7.28 (SD = 4.00; Range: 1–18), and participants reported sleeping an average of 373.60 min/day (SD = 73.43; Range: 120–570 min/day) on the PSQI. Participants had an average MW8 measured sleep duration of 401.10 min/day (SD = 51.23; Range: 164.85–541.77 min/day), average fragmentation index of 31.17 (SD = 11.03; Range: 11.21–57.15), and average sleep efficiency of 82.57% (SD = 6.10; Range: 66.74–94.99%).
Older adults with probable MCI were significantly older (p = 0.01) and had poorer performance on the MMSE (p < 0.01). The proportion of males categorized as MCI was greater than the proportion of males categorized as cognitively healthy (p = 0.03). Older adults with probable MCI had significantly shorter subjective sleep duration on the PSQI (p = 0.01) and shorter MW8 measured sleep duration (p < 0.01) than their healthy cognitive peers after controlling for age, sex, and sleep medication use.
All participants (N = 151)
Intraclass reliability coefficients and 95% CIs for mean daily activity levels derived from one, four, seven and 14 days are shown in Table 2. The reliability coefficients exhibit a trend towards greater reliability for sleep duration, fragmentation index, sleep efficiency, and wake after sleep onset. Overall, there was poor reliability of sleep quality indices derived from a single day of monitoring. Wake after sleep onset was the most reliable with an estimate of ICC = 0.64 (95% CI: 0.59, 0.70). Sleep latency showed the least agreement with ICC = 0.33 (95% CI: 0.27, 0.39). Reliability estimates for 7 days showed moderate-to-high reliability across all five sleep quality indices. Sleep duration had a reliability ICC = 0.84 (95% CI: 0.80, 0.88) at 7 days, fragmentation index had an ICC = 0.90 (95% CI: 0.87, 0.92), sleep efficiency had an ICC = 0.92 (95% CI: 0.90, 0.94), sleep latency had an ICC = 0.73 (95% CI: 0.66, 0.79), and wake after sleep onset had an ICC = 0.93 (95% CI: 0.91, 0.94). Spearman-Brown analyses indicated that in order to achieve reliability of ICC = 0.80, sleep duration needed to be monitored for 5 days, fragmentation index for 4 days, sleep efficiency for 3 days, sleep latency for 12 days, and wake after sleep onset for 3 days.
Older adults without MCI (N = 69)
There was poor reliability of sleep quality indices derived from a single day of monitoring for adults without MCI. Sleep efficiency was the most reliable with an estimate of ICC = 0.61 (95% CI: 0.53, 0.70), while sleep latency showed the least agreement with ICC = 0.31 (95% CI: 0.23, 0.41). Reliability estimates for 7 days showed moderate-to-high reliability across all five sleep quality indices. Sleep duration had a reliability ICC = 0.86 (95% CI: 0.81, 0.91) at 7 days, fragmentation index had an ICC = 0.85 (95% CI: 0.79, 0.90), sleep efficiency had an ICC = 0.91 (95% CI: 0.87, 0.94), sleep latency had an ICC = 0.73 (95% CI: 0.62, 0.82), and wake after sleep onset had an ICC = 0.91 (95% CI: 0.88, 0.94). In order to achieve reliability of ICC = 0.80, sleep duration needed to be monitored for 4 days, fragmentation index needed to be monitored for 6 days, sleep efficiency needed 3 days, sleep latency needed 9 days, and wake after sleep onset needed 3 days.
Older adults with probable MCI (N = 82)
We determined there was poor reliability of sleep quality from a single day of monitoring for all sleep quality indices in adults with probable MCI. Wake after sleep onset was the most reliable with an estimate of ICC = 0.68 (95% CI: 0.61, 0.75), while sleep latency showed the least agreement with ICC = 0.35 (95% CI: 0.27, 0.44). Reliability estimates for 7 days showed modest-to-good reliability across all four sleep quality indices. Sleep duration had a reliability ICC = 0.80 (95% CI: 0.73, 0.86) at 7 days, fragmentation index had an ICC = 0.91 (95% CI: 0.88, 0.94), sleep efficiency had an ICC = 0.92 (95% CI: 0.89, 0.95), sleep latency had an ICC = 0.73 (95% CI: 0.63, 0.81), and wake after sleep onset had an ICC = 0.93 (95% CI: 0.91, 0.95). Spearman-Brown prophecies indicated that in order to achieve reliability of ICC = 0.80, sleep duration needed to be monitored for 6 days, fragmentation index and sleep efficiency needed 3 days, sleep latency needed 8 days, and wake after sleep onset needed 2 days.
Differences in ICC estimates for different sleep parameters by cognitive status
Significantly different ICCs are demarcated in Table 2. We determined that there were significantly different ICCs based on cognitive status for fragmentation index following 14 days (z = 2.34; p = 0.02) and 1 day (z = 2.68; p < 0.01) of monitoring. There were marginally different ICCs based on cognitive status for sleep duration following one (z = 1.85; p = 0.06) and 4 days (z = 1.96; p = 0.05) of monitoring, sleep fragmentation following four (z = 1.89; p = 0.06) and 7 days (z = 1.88; p = 0.06), and wake after sleep onset following one (z = 1.78; p = 0.08) and 14 days (z = 1.85; p = 0.06).
Our results indicate the MW8 provides reliable estimates of sleep after at least 7 days of observation for both older adults with MCI and those without. Specifically, we found that at least 7 days of monitoring—irrespective of cognitive status—provides good agreement for sleep duration (ICC = 0.87), fragmentation index (ICC = 0.87), sleep efficiency (ICC = 0.91, and wake after sleep onset (ICC = 0.93). Sleep latency provides moderate agreement after at least 7 days of wear (ICC = 0.72). Given that four measures of sleep provide good reliability after 7 days, and one measure provides at least an acceptable level of agreement, we suggest the MW8 requires at least 7 days of consecutive wear to provide reliable estimates of sleep. Although our Spearman-Brown analyses indicate reliable estimates of fragmentation index, sleep efficiency, and wake after sleep onset can be achieved from less than 7 days of monitoring for both older adults with and without MCI, we also determined that at least 7 days of wear-time is needed to achieve a reliable estimate of sleep duration in older adults with MCI. Hence, we suggest that future investigations into the sleep of older adults with and without MCI should measure wrist-worn actigraphy for a period of at least 7 days.
Few studies have examined the number of nights needed to reliably estimate sleep. Acebo and colleagues determined the reliability of the Mini Motionlogger wrist-worn actigraph (Advanced Model, Ambulatory Monitoring Inc.) for measuring sleep in 169 young children (aged 1–5 years) and 55 adolescents (11–16 years; (Acebo et al., 1999)). The results of this study indicated that five nights of monitoring was enough to provide good estimates of sleep in both young children and adolescents. A recent analysis of the MW8 in middle-aged men and women suggested that at least 7 days of observation was enough to provide reliable estimates of sleep (Aili et al., 2017), however we are only aware of two studies which have examined the reliability of sleep measures for older adults (Van Someren, 2007; Wohlgemuth et al., 1999). Wohlgemuth and colleagues determined that seven nights of monitoring using sleep logs and polysomnography was enough to reliably estimate sleep duration, sleep efficiency, and time in bed in both healthy older adults (N = 32) and older adults with primary insomnia (N = 32; (Wohlgemuth et al., 1999)). More recently, Van Someren determined that seven nights of sleep monitoring using the Actiwatch (Cambridge Neurotechnology, Cambridge, UK), provides good estimates of reliability for sleep duration and sleep efficiency in both older adults with primary insomnia (N = 10) and older adults with dementia (N = 12; (Van Someren, 2007)). Our study of older adults with and without MCI appears to echo these results, and further indicates that estimates of sleep can be reliably measured using seven nights of actigraphy monitoring.
Our results also indicate that older adults with MCI have poorer sleep than their healthy cognitive peers. We determined that older adults with MCI have lower subjective and objective sleep duration than those without MCI after adjusting for age, sex, and sleep medication use. We also found that older adults with MCI appear to have more consistent fragmentation indices from night-to-night, but less consistent sleep duration from night-to-night. While these differences in ICCs do not warrant different monitoring protocols—given that 7 days of wear time provides good estimates of reliability for sleep duration and fragmentation index irrespective of cognitive status—it is interesting that older adults with MCI have different sleep patterns. One plausible explanation is that MCI associated changes in sleep quality include less regularity in sleep duration (with a tendency towards shorter sleep durations than cognitively healthy older adults) and consistently greater sleep fragmentation. This lower consistency in sleep duration from night-to-night appears to suggest that older adults with MCI might have less homeostatic sleep drive (i.e., Process S) than their healthy cognitive counterparts. It is also plausible that underlying changes in the brains of older adults with MCI – such as neural atrophy, nocturnal hypoxia, and altered neuromodulation – might alter their sleep (Scullin & Bliwise, 2015). For example, older adults with MCI have greater amounts of Aβ accumulation (Pike et al., 2007), and greater Aβ load is associated with more disrupted sleep (Mander et al., 2015). Future research should therefore examine why older adults with MCI experience different sleep patterns than their healthy cognitive counterparts, since these underlying differences could be related to their increased risk of dementia (Landry & Liu-Ambrose, 2014).
While 7 days of wear-time provides good agreement for sleep duration, fragmentation index, and wake after sleep onset, this monitoring protocol only provides moderate agreement for sleep latency. However, sleep latency is difficult to accurately and reliably determine—even using polysomnography (Ancoli-Israel et al., 2003; Cantero et al., 2002). Actigraphic assessments of sleep latency are even more challenging since individuals with poor sleep tend to lie in bed motionless, but awake, for long periods of time (de Souza et al., 2003). Sleep latency may thus be difficult to accurately and reliably estimate using currently available field methods, and associations between sleep latency and cognitive health should be treated with caution.
Limitations and future research
Our study has only determined the reliability of MW8 in a sample of community-dwelling older adults. Use of this device in diseased populations may not yield accurate estimations of sleep quality after 7 days of measurement. While there is at least preliminary evidence of validity for the MW8 (O’Hare et al., 2015; Martoni et al., 2012; Elbaz et al., 2012), there is not yet criterion evidence of validity for the MW8 in older adults. Future research is thus needed to determine the validity of the MW8 for estimating sleep in older adults with and without MCI.
MCI is typically diagnosed using the Petersen criteria: 1) subjective cognitive impairment; 2) objective cognitive impairment according to a MoCA score of < 26/30; 3) no functional impairment in activities of daily living; and 4) no dementia (Petersen, 2004). However, we did not use a clinical diagnosis of MCI in our study, but rather classified individuals as MCI solely based on a MoCA score of < 26/30. All participants were likely free of dementia as they all had an MMSE score of > 24/30 (Folstein et al., 1975).
We did not include napping in our calculations for each sleep variable, and thus our estimates of different sleep indices are exclusive to the major sleep period. Information outside of the major sleep period can be clinically informative, however sleep scoring algorithims for nighttime sleep estimation are not as well validated for scoring of daytime sleeping and naps (Ancoli-Israel et al., 2015). Thus, future research is needed to examine the reliability of indices of each total 24-h period of sleep for both older adults with and without MCI.
There are also significant changes which occur in sleep schedules, sleep architecture, and other aspects of sleep quality from middle-age to old-age (Crowley, 2011; Espiritu, 2008; Scullin & Bliwise, 2015), and it is possible that the younger-older adults of our sample may have significant differences in sleep-wake patterns compared with the older-older adults. Our results should be applied with caution to older adults with significant sleep disturbances as well as older adults with chronic conditions, as these individuals may require different observation periods than our sample. Although we confirmed event-marker time stamps with the CSD to determine when a participant was awake and out of bed according to current actigraphy guidelines (Ancoli-Israel et al., 2015), it is possible that the last awakening during each sleep window did not coincide with the time participants got out of bed. Future research is needed to establish more accurate field methods for determining when older adults are awake and out of bed.
Our analyses were limited to five markers of sleep quality that are estimated by the MW8 (i.e., sleep duration, fragmentation index, sleep efficiency, sleep latency, and wake after sleep onset). We cannot provide guidance for other potential markers of sleep quality that may be estimated by the MW8. Other actigraphs will likely require different observation periods in order to collect reliable estimates of sleep quality.
In summary, the results of this study indicate that at least 7 days of MW8 wear-time is appropriate for population-based field studies involving older adults. We determined that the MW8, an actigraphy device commonly used to measure physical activity (Landry et al., 2015b; Falck et al., 2017), provides reliable estimates of sleep for older adults with and without MCI after at least 7 days of observation. While there are differences in sleep quality based on cognitive status, similar measurement protocols can be used for older adults with MCI and those without MCI. These results provide researchers with a reliable tool to examine differences in sleep (as well as physical activity) in older adults with and without cognitive impairment, which may have future impact on the prevention of cognitive decline.
Availability of data and materials
The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.
Analysis of Covariance
Body Mass Index
Consensus Sleep Diary
- ICC1,1 :
Single Absolute Intraclass Correlation
Average Random Raters Intraclass Correlation
Mild Cognitive Impairment
Mini-Mental State Exam
Montreal Cognitive Assessment
MotionWatch8© wrist-worn actigraph
Pittsburgh Sleep Quality Index
Acebo C, Sadeh A, Seifer R, Tzischinsky O, Wolfson AR, Hafer A, et al. Estimating sleep patterns with activity monitoring in children and adolescents: how many nights are necessary for reliable measures? Sleep. 1999;22(1):95–103.
Aili K, Åström-Paulsson S, Stoetzer U, Svartengren M, Hillert L. Reliability of actigraphy and subjective sleep measurements in adults: the design of sleep assessments. J Clin Sleep Med. 2017;13(01):39–47.
Ancoli-Israel S, Cole R, Alessi C, Chambers M, Moorcroft W, Pollak CP. The role of actigraphy in the study of sleep and circadian rhythms. Sleep. 2003;26(3):342–92.
Ancoli-Israel S, Martin JL, Blackwell T, Buenaver L, Liu L, Meltzer LJ, et al. The SBSM guide to actigraphy monitoring: clinical and research applications. Behav Sleep Med. 2015;13(sup1):S4–S38.
Banks S, Dinges DF. Behavioral and physiological consequences of sleep restriction. J Clin Sleep Med. 2007;3(5):519.
Borbély AA, Daan S, Wirz-Justice A, Deboer T. The two-process model of sleep regulation: a reappraisal. J Sleep Res. 2016;25(2):131–43.
Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res. 1989;28(2):193–213.
Cantero JL, Atienza M, Stickgold R, Hobson JA. Nightcap: a reliable system for determining sleep onset latency. Sleep. 2002;25(2):238–45.
Carney CE, Buysse DJ, Ancoli-Israel S, Edinger JD, Krystal AD, Lichstein KL, et al. The consensus sleep diary: standardizing prospective sleep self-monitoring. Sleep. 2012;35(2):287–302.
Crowley K. Sleep and sleep disorders in older adults. Neuropsychol Rev. 2011;21(1):41–53.
da Silva RAPC. Sleep disturbances and mild cognitive impairment: a review. Sleep Sci. 2015;8(1):36–41.
de Souza L, Benedito-Silva AA, Pires MLN, Poyares D, Tufik S, Calil HM. Further validation of actigraphy for sleep studies. Sleep. 2003;26(1):81–5.
Denegar CR, Ball DW. Assessing reliability and precision of measurement: an introduction to intraclass correlation and standard error of measurement. J Sport Rehabil. 1993;2(1):35–42.
Elbaz M, Yauy K, Metlaine A, Martoni M, Leger D. Validation of a new actigraph motion watch versus polysomnography on 70 healthy and suspected sleep-disordered subjects. J Sleep Res. 2012;21:218.
Espiritu JRD. Aging-related sleep changes. Clin Geriatr Med. 2008;24(1):1–14.
Falck RS, Best JR, Davis JC, Liu-Ambrose T. The independent associations of physical activity and sleep with cognitive function in older adults. J Alzheimers Dis. 2018;63:1–16.
Falck RS, Landry GJ, Best JR, Davis JC, Chiu BK, Liu-Ambrose T. Cross-sectional relationships of physical activity and sedentary behavior with cognitive function in older adults with probable mild cognitive impairment. Phys Ther. 2017;97:975–84.
Foley DJ, Monjan AA, Brown SL, Simonsick EM, Wallace RB, Blazer DG. Sleep complaints among elderly persons: an epidemiologic study of three communities. Sleep. 1995;18(6):425–32.
Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98.
Garrouste-Orgeas M, Troché G, Azoulay E, Caubel A, de Lassence A, Cheval C, et al. Body mass index. Intensive Care Med. 2004;30(3):437–43.
Hopkins KD. Educational and psychological measurement and evaluation: ERIC; 1998.
Jacqmin-Gadda H, Alperovitch A, Montlahuc C, Commenges D, Leffondre K, Dufouil C, et al. 20-year prevalence projections for dementia and impact of preventive policy about risk factors. Eur J Epidemiol. 2013;28(6):493–502.
Ju Y-ES, Lucey BP, Holtzman DM. Sleep and Alzheimer disease pathology—a bidirectional relationship; 2013.
Kang J-E, Lim MM, Bateman RJ, Lee JJ, Smyth LP, Cirrito JR, et al. Amyloid-β dynamics are regulated by orexin and the sleep-wake cycle. Science. 2009;326(5955):1005–7.
Killgore WD. Effects of sleep deprivation on cognition. Prog Brain Res. 2010;185:105–29 Elsevier.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.
Krystal AD, Edinger JD. Measuring sleep quality. Sleep Med. 2008;9:S10–S7.
Landry GJ, Best JR, Liu-Ambrose T. Measuring sleep quality in older adults: a comparison using subjective and objective methods. Front Aging Neurosci. 2015a;7:166.
Landry GJ, Falck RS, Beets MW, Liu-Ambrose T. Measuring physical activity in older adults: calibrating cut-points for the MotionWatch 8©. Front Aging Neurosci. 2015b;7:165.
Landry GJ, Liu-Ambrose T. Buying time: a rationale for examining the use of circadian rhythm and sleep interventions to delay progression of mild cognitive impairment to Alzheimer’s disease. Front Aging Neurosci. 2014;6:325.
Langa KM, Levine DA. The diagnosis and management of mild cognitive impairment: a clinical review. JAMA. 2014;312(23):2551–61.
Liu-Ambrose T, Falck RS. Sleep, physical activity, and cognitive health in older adults. Handbook Behav Neurosci Elsevier. 2019;30:665–76.
Lowe CJ, Safati A, Hall PA. The neurocognitive consequences of sleep restriction: a meta-analytic review. Neurosci Biobehav Rev. 2017;80:586–604.
Mander BA, Marks SM, Vogel JW, Rao V, Lu B, Saletin JM, et al. β-Amyloid disrupts human NREM slow waves and related hippocampus-dependent memory consolidation. Nat Neurosci. 2015;18(7):1051.
Martoni M, Bayon V, Elbaz M, Léger D. Using actigraphy versus polysomnography in the clinical assessment of chronic insomnia (retrospective analysis of 27 patients). Presse Med. 2012;41(3):e95–e100.
Naismith SL, Hickie IB, Terpening Z, Rajaratnam SW, Hodges JR, Bolitho S, et al. Circadian misalignment and sleep disruption in mild cognitive impairment. J Alzheimers Dis. 2014;38(4):857–66.
Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.
O’Hare E, Flanagan D, Penzel T, Garcia C, Frohberg D, Heneghan C. A comparison of radio-frequency biomotion sensors and actigraphy versus polysomnography for the assessment of sleep in normal subjects. Sleep Breathing. 2015;19(1):91–8.
Petersen R, Stevens J, Ganguli M, Tangalos E, Cummings J, DeKosky S. Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review) report of the quality standards Subcommittee of the American Academy of neurology. Neurology. 2001;56(9):1133–42.
Petersen RC. Mild cognitive impairment as a diagnostic entity. J Intern Med. 2004;256(3):183–94.
Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol. 1999;56(3):303–8.
Pike KE, Savage G, Villemagne VL, Ng S, Moss SA, Maruff P, et al. β-Amyloid imaging and memory in non-demented individuals: evidence for preclinical Alzheimer’s disease. Brain. 2007;130(11):2837–44.
Roh JH, Huang Y, Bero AW, Kasten T, Stewart FR, Bateman RJ, et al. Disruption of the sleep-wake cycle and diurnal fluctuation of β-amyloid in mice with Alzheimer’s disease pathology. Sci Transl Med. 2012;4(150):150ra22.
Sadeh A. The role and validity of actigraphy in sleep medicine: an update. Sleep Med Rev. 2011;15(4):259–67.
Scullin MK. Do older adults need sleep? A review of neuroimaging, sleep, and aging studies. Curr Sleep Med Rep. 2017;3(3):204–14.
Scullin MK, Bliwise DL. Sleep, cognition, and normal aging: integrating a half century of multidisciplinary research. Perspect Psychol Sci. 2015;10(1):97–137.
Tranah GJ, Blackwell T, Stone KL, Ancoli-Israel S, Paudel ML, Ensrud KE, et al. Circadian activity rhythms and risk of incident dementia and mild cognitive impairment in older women. Ann Neurol. 2011;70(5):722–32.
Van Someren EJ. Improving actigraphic sleep estimates in insomnia and dementia: how many nights? J Sleep Res. 2007;16(3):269–75.
Wohlgemuth WK, Edinger JD, Fins AI, Sullivan RJ. How many nights are enough? The short-term stability of sleep parameters in elderly insomniacs and normal sleepers. Psychophysiology. 1999;36(2):233–44.
Xie L, Kang H, Xu Q, Chen MJ, Liao Y, Thiyagarajan M, et al. Sleep drives metabolite clearance from the adult brain. Science. 2013;342(6156):373–7.
Yaffe K, Falvey CM, Hoang T. Connections between sleep and cognition in older adults. Lancet Neurol. 2014;13(10):1017–28.
Zinkhan M, Berger K, Hense S, Nagel M, Obst A, Koch B, et al. Agreement of different methods for assessing sleep characteristics: a comparison of two actigraphs, wrist and hip placement, and self-report with polysomnography. Sleep Med. 2014;15(9):1107–14.
We would like to thank the members of the Aging, Mobility, and Cognitive Neuroscience Laboratory for their assistance with recruitment and data collection.
CKB is funded by Brain Canada and the Alzheimer’s Association. Funding for this work was provided to TL-A by the Jack Brown and Family Alzheimer Research Foundation.
Ethics approval and consent to participate
Ethical approval for this study was obtained from the Vancouver Coastal Health Research Institute and the University of British Columbia’s Clinical Research Ethics Board (H14–01301). All participants provided written informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1: Supplementary Material S1.
R statistical code.
Additional file 2: Supplementary Material S2.
Sensitivity Analyses when including participants without Montreal Cognitive Assessment scores.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Falck, R.S., Barha, C.K., Chan, P.C.Y. et al. Refining sleep measurement using the Motionwatch8©: how many days of monitoring do we need to get reliable estimates of sleep quality for older adults with mild cognitive impairment?. Sleep Science Practice 4, 11 (2020). https://doi.org/10.1186/s41606-020-00048-w
- Older adults
- Mild cognitive impairment