Abstract

Perioperative sleep disturbances may impact healing and negatively affect the patient’s perception of well-being. Therefore, accurately assessing postoperative sleep characteristics is necessary to treat sleep disturbances. This study is a secondary data analysis of research investigating the association between sleep and cognition in a perioperative setting. This study compares sleep characteristics between the St. Mary’s Hospital Sleep Questionnaire and WatchPAT, a portable sleep apnea testing device. The goal of this study is to compare an objective measurement of sleep quality (WatchPAT) with a traditional questionnaire. One hundred and one patients who underwent elective, noncardiac surgical procedures wore a WatchPAT and completed the St. Mary’s Hospital Sleep Questionnaire for three nights: two preoperative and one postoperative night. In the preoperative period, a Bland-Altman analysis showed an agreement Watch PAT and the St Mary’s hospital sleep questionnaire except for sleep fragmentation. A good to fair correlation during the preoperative period was observed with both sleep latency and total sleep time. In the postoperative period, no correlation was observed between the St. Mary’s Hospital Sleep Questionnaire data and WatchPAT data. Our study indicates that some potential factors affecting sleep and cognition such as admission type, depression, anesthesia type, and sleep apnea may limit patients’ ability to report their sleep characteristics after surgery. Therefore, relying solely on one sleep assessment method is not advisable.

1. Introduction

Sleep disruption after surgery is a common phenomenon, especially after major surgery [1, 2]. It is characterized by longer sleep latency, increased awakenings, lower total sleep time, loss of rapid eye movement (REM) sleep, disruption of circadian rhythm, and other issues [13]. In addition, sleep is an essential physiological function that allows our bodies to rest and restore; hence, such disruptions may affect the body’s ability to heal and negatively impact patients’ perception of well-being.

Given the number of patients who undergo surgical procedures at some point in their lives, accurately assessing sleep characteristics in the perioperative setting is important. Patient-reported, subjective sleep measures often play an important role in this assessment due to their ease of use. They are efficient, cost-effective, and noninvasive. Plus, they are well-suited to repeated use, which can capture sleep changes for a patient over time [4].

St. Mary’s Hospital Sleep Questionnaire (SMHSQ), one of the most commonly used sleep surveys, was developed as a standardized evaluation of sleep experience in the hospital setting, evaluating sleep characteristics during a previous 24-hour period [4] (see the Appendix). This quick 14-question test is simple to administer and designed to be used throughout a hospital stay. It asks patients to describe their sleep over the past 24 hours using subjective rankings. When administered over multiple days, it has been shown to provide a picture of sleep changes in inpatients [4]. However, to the best of our knowledge, the SMHSQ has yet to be well studied by comparing it to objective methods in a perioperative setting. Thus, this study was aimed at evaluating the correlation between SMHSQ as a subjective method and WatchPAT (Itamar Medical, Caesarea, Israel), as an objective method, along with the covariates which may affect sleep characteristics in a perioperative setting.

2. Materials and Methods

The present study is a secondary data analysis of a prospective study investigating the association between sleep and cognition in a perioperative setting. The prospective study was conducted from 2013 to 2018 at the University of California, San Francisco Medical Center. The Institutional IRB approved the study, and written informed consent was obtained preoperatively from each patient.

2.1. Participants

years of age with a scheduled elective noncardiac procedure were screened for eligibility (Figure 1). Study exclusion criteria included pregnancy, dementia, tumor, peripheral vascular disease, peripheral neuropathy, cardiac disease, pulmonary disease, severe diabetes, auditory or visual handicaps, and surgeries involving the airways, fingers, or arms. In addition, permanent pacemakers, nonsinus cardiac arrhythmias, and short-acting nitrates or alpha-blockers were excluded due to possible interaction with the portable sleep monitoring device, WatchPAT.

The preoperative interview was conducted by a trained research assistant in the preoperative anesthesia clinic, typically less than two weeks and a minimum of 3 days before the patient’s surgery, to ensure adequate time for preoperative baseline data collection. We obtained the patient’s health information and any potential covariates associated with sleep and cognition, including age, gender, body mass index, race, level of education, American Society of Anesthesiologists status, and preoperative depression-associated symptoms with the Center for Epidemiologic Studies Depression (CES-D) scale [5]. Individuals with a CES-D scale of 16 or greater appear to be at risk for depression.

2.2. Sleep Assessments
2.2.1. Objective Sleep Assessment (WatchPAT)

WatchPAT is an FDA-approved portable sleep apnea testing device. It records the parameters of sleep architecture and sleep-disordered breathing using built-in actigraphy and peripheral arterial tonometry. Among the recorded parameters, sleep fragmentation, sleep latency, and total night sleep time were obtained for analysis.

WatchPAT provides an accurate and clinically effective monitoring method; there are high correlations of pAHI, lowest oxygen saturation, and sleep time between polysomnography and the WatchPAT [6, 7].

After obtaining written consent for the study, patients were provided a WatchPAT. Participants wore a WatchPAT on their nondominant hand for two consecutive nights before surgery. On the day of their surgical procedure, patients returned the WatchPAT for analysis. The patients were given a new WatchPAT and asked to wear it on the night of surgery. After surgery, a WatchPAT was used either in the hospital room or at their own homes if they were discharged on the same day of surgery.

2.2.2. Subjective Sleep Assessment (SMHSQ)

Each morning, patients were asked to complete an SMHSQ about their previous night’s sleep. Sleep architecture was compared between WatchPAT and SMHSQ using three factors (sleep fragmentation, sleep latency, and total night sleep time). (1) Fragmentation: number of wakes vs. How many times did you wake up? (2) Sleep latency (in minutes) vs. How long did it take you to fall asleep last night. (3) Total night sleep time vs. How much sleep did you have last night (in hours)?

2.3. Intraoperative Data

Surgery duration and anesthesia type were noted. Anesthesia types were general, spinal, epidural, and/or peripheral nerve blocks, and then, they were dichotomized as general vs. other.

2.4. Postoperative Assessment

For inpatients, postoperative interviews were conducted in the patient’s hospital room by the same research assistant for the first postoperative day. For outpatients, patients were contacted by phone following surgery.

2.5. Statistical Analysis

Patients’ sleep characteristics were summarized using frequency, percentages, means, and standard deviations. Sleep assessment data measured for the two preoperative nights were averaged. If the sleep fragmentation occurred more than 6 times per night with WatchPAT, we used 7 as the top value for analysis in order to correlate with SMHSQ. Pearson’s correlation coefficient () and partial correlation coefficient (partial ) controlling for admission type, depression, anesthesia type, and surgery duration were calculated to assess bivariate associations of sleep fragmentation, sleep latency, and total night sleep time between SMHSQ and WatchPAT. Paired tests were conducted to see if there are any differences in the mean values of sleep fragmentation, sleep latency, and total night sleep time between SMHSQ and WatchPAT. In addition, Bland-Altman plots were created to evaluate the agreement of patients’ sleep characteristics between the SMHSQ and WatchPAT.

For each sleep assessment, their sleep characteristic data, pre- vs. postsurgery, was analyzed using a mixed-effects model [8, 9]. This model used the following factors: admission type [10, 11], anesthesia type [1, 2], depression [12], obesity [13, 14], and pAHI [15]. In this model, the patient was treated as a random effect. All analyses were performed using R version 4.1.2 (R Foundation for Statistical Computing, Vienna, Austria), and a two-sided value of <0.05 was considered significant.

3. Results

3.1. Descriptive Data

A total of 101 patients were included in this study, with a mean age of years. Table 1 shows patients’ baseline characteristics. Sixty patients (59.4%) were male. Most patients were admitted after surgery (71.3%), and 59.4% received general anesthesia.

3.2. Correlation and Agreement between WatchPAT and SMHSQ

Positive correlations were found in terms of sleep fragmentation (, partial ), sleep latency (, partial ), and night sleep time (, partial ) between the SMHSQ and WatchPAT data before surgery. However, there were no significant correlations between WatchPAT and the SMHSQ data for sleep fragmentation (, partial ), sleep latency (, partial ), and total night sleep time (, partial ) on the night of surgery (Table 2 and Figure 2). The mean values in each variable were compared using tests. They were statistically different in all three areas before surgery. After surgery, the mean values were similar except for sleep fragmentation (Table 2). Figure 3 depicts Bland-Altman plots for these sleep characteristics. For the preoperative period, all points were randomly spread around the mean difference, and almost all points were within generally accepted limits of agreement. The mean differences in sleep latency and total night sleep were close to zero, indicating a good agreement between WatchPAT and SMHSQ. However, the average difference in sleep fragmentation between the WatchPAT value was 3.2 times different than the SMHSQ value, indicating that the two methods were significantly different from zero. No significant correlations were noted in all parameters in the postoperative period.

3.3. Effects of Various Covariates on Each Measurement Method

Table 3 presents the results of the mixed-effects models controlling for pre-/postoperative night, admission type (inpatient vs. outpatient), anesthesia (general vs. other), depression ( vs. <16), obesity ( vs. <30), and sleep apnea ( vs. <15).

3.3.1. Postoperative Night vs. Preoperative Night

(1)Sleep fragmentation: WatchPAT showed an increase in sleep fragmentation of 0.50 episodes per night (95% , ) postoperatively, compared with preoperative sleep fragmentation. The SMHSQ also reported an increased sleep fragmentation, but significantly higher, at 1.50 episodes (95% , ) postoperatively(2)Sleep latency: WatchPAT showed an increase of 3.85 minutes (95% , ) postoperatively. The SMHSQ did not show any differences between pre- and postoperative nights (95% , )(3)Total night sleep time: WatchPAT did not show any differences between pre- and postoperative nights (95% , ), but the SMHSQ data showed a significant decrease in total night sleep time of 1.51 hours (95% , ) after surgery, as reported by the patients

3.3.2. Inpatient vs. Outpatient

(1)Sleep fragmentation: WatchPAT showed a decreased sleep fragmentation of 0.79 episodes per night (95% , -0.24], ) for inpatients vs. outpatients. However, no significant difference was noted on the SMHSQ (95% , )(2)Sleep latency: no difference was noted in sleep latency on the WatchPAT (95% , ) and SMHSQ (95% , ) for inpatients vs. outpatients(3)Total night sleep time: for inpatients vs. outpatients, total sleep time increased by 0.75 hours (95% , ) based on the WatchPAT data. This difference, however, was not apparent based on the SMHSQ data (95% , )

3.3.3. General Anesthesia vs. Other

(1)Sleep fragmentation: patients who received general anesthesia had less sleep fragmentation of 0.60 episodes/night (95% , ) after surgery than patients who received other types of anesthesia based on WatchPAT data, but no difference was noted on the SMHSQ (, )(2)Sleep latency: sleep latency was not significantly different after surgery, comparing general anesthesia and other types of anesthesia on WatchPAT (95% , ) and SMHSQ data (95% , )(3)Total night sleep time: on WatchPAT, sleep time was longer by 0.56 hours (95% , ) in patients who received general anesthesia than in patients who had other types of anesthesia. This difference was not apparent in the SMHSQ data (95% , )

3.3.4. Depression ( vs. )

(1)Sleep fragmentation: a decrease in sleep fragmentation of 0.91 episodes per night (95% , ) was detected in the patients with depression on the SMHSQ but not apparent in the WatchPAT data (95% , )(2)Sleep latency: no significant changes were noted with either reporting method (WatchPAT: 95% , , SMHSQ: 95% , )(3)Total night sleep time: no significant changes were noted in the WatchPAT (95% , ) and SMHSQ data (95% , )

3.3.5. Obesity ( vs. <30)

(1)Sleep fragmentation: no significant changes were noted in either dataset (WatchPAT: 95% , , SMHSQ: 95% , )(2)Sleep latency: in the group, sleep latency decreased by 6.08 minutes (95% , ) based on WatchPAT data. Reported sleep latency showed an increase of 15.15 minutes (95% , ) based on the SMHSQ data(3)Total night sleep time: it was decreased for 0.54 hours (95% , ) in the group, but SMHSQ did not report any significant differences in minutes (95% , )

3.3.6. Sleep Apnea ( vs. <15)

(1)Sleep fragmentation: sleep apnea was not associated with changes in sleep fragmentation in either the WatchPAT (95% , ) or SMHSQ data (95% , )(2)Sleep latency: WatchPAT (95% , ) and the SMHSQ data (95% , ) did not show any clear differences(3)Total night sleep time: data for total night sleep time showed an increase of 0.70 hours (95% , ) in the group, using the SMHSQ assessment. This increase was not apparent in the WatchPAT data (95% , )

4. Discussion

In this cohort study, comparing both subjective and objective methods, good to fair correlations were observed before surgery for sleep fragmentation, sleep latency, and total night sleep time. However, there were no meaningful correlations after surgery. Similarly, the Bland-Altman analysis showed no correlation between the two methods in the postoperative period.

Literature suggests that multiple factors can affect sleep quality after surgery: environment, physical/pathophysiological, and psychological [2, 16, 17]. The main environmental factors are the unfamiliar environment, nurses’ footsteps, and voices of other patients. Physical/pathophysiological factors include dyspnea, pain, and foreign body sensation caused by intubation. An example of a psychological factor is anxiety about unpredictable visits and examinations by a doctor or nurse [16].

4.1. Comparison to Previous Studies

Previous studies have investigated sleep using the SMHSQ in non-perioperative settings [1820], and the SMHSQ was found to be a valuable tool. For example, Jared et al. compared the SMHSQ and the scaled General Health and Hillier Questionnaire in patients with cystic fibrosis. They concluded that these two subjective methods were well correlated. However, the SMHSQ has yet to be well studied in the perioperative setting. Our findings indicate that the WatchPAT and SMHSQ do not correlate well after surgery. Comparing the mean values, WatchPAT showed more sleep fragmentation than the SMHSQ data postoperatively. It is possible that patients could recall full awakenings only, not shorter or less powerful arousals.

We speculate that changes in sleep patterns and cognitive dysfunction after surgery may contribute to discrepancies between the two methods. Therefore, we further explored the factors which may affect sleep and cognition: pre-/postoperative night, admission type, depression, anesthesia type, and sleep apnea [2, 21, 22] using the mixed-effects model (Table 3). Our study indicates that all these factors showed a discrepancy in at least one of the three variables. To the best of our knowledge, the previous studies have yet to investigate the etiology of a discrepancy between the SMHSQ and objective methods.

There are some limitations to our study. First, our sleep data was limited to night sleep only and did not include sleep happening during the day. The study was conducted this way since the WatchPAT is meant to be worn at night. Second, the sample size of our study was relatively small, and there needed to be more data to evaluate more than one night after surgery. To evaluate covariates and other unknown variables affecting perioperative sleep, studies with an appropriate sample size should be conducted in the future. Third, this study did not use polysomnography due to its resource intensiveness in the perioperative period. Although WatchPAT is significantly easier to use for sleep evaluation and has a high correlation with polysomnography [6, 23], it may still need to be more accurate. Fourth, CES-D was used as a surrogate marker for depression, but the patients were not necessarily clinically diagnosed or evaluated in this domain. Fifth, to compare sleep fragmentation between WatchPAT and the SMHSQ data, we chose to use the unified top value of 7 for analysis. Therefore, actual numbers of sleep fragmentation were not used for analysis if the episodes/night were 6 or higher.

In this study, we explored three of the many different aspects of sleep before and after surgery, along with several factors which may influence sleep quality during these periods. Given the importance of qualified sleep to facilitate patient recovery, it is essential to devise ways to measure sleep reliably and objectively in the perioperative setting.

In conclusion, its agreements and a good to fair correlation between the SMHSQ and WatchPAT were observed preoperatively, and both seem reliable for evaluating sleep characteristics before surgery. However, that was not the case for postoperative sleep. Our study indicates that factors that affect cognition and sleep, such as admission type (inpatient vs. outpatient), depression, anesthesia type (general anesthesia vs. other), and sleep apnea, may be related to this discrepancy. Therefore, relying solely on one sleep assessment method is not advisable. Future studies are required both to validate our findings and investigate the etiology of the discrepancy between these two methods.

Appendix

St. Mary’s Hospital Sleep Questionnaire [4].

Data Availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Disclosure

Part of the work in this article was presented at the ANESTHESIOLOGY Annual Meeting, October 13, 2018, San Francisco, California (abstract URL: http://www.asaabstracts.com/strands/asaabstracts/abstract.htm?year=2018&index=17&absnum=5108 (accessed on March 27, 2023)).

Conflicts of Interest

There are no conflicts of interest for Junyong In, Eunjung Lim, and Sakura Kinjo.

Authors’ Contributions

Study conception and design were carried out by Sakura Kinjo and Eunjung Lim. Data collection was performed by Sakura Kinjo. Analysis and interpretation of results were performed by Eunjung Lim and Junyong In. Manuscript draft preparation was carried out by Eunjung Lim, Junyong In, and Sakura Kinjo. All authors reviewed the results and approved the final version of the manuscript.

Acknowledgments

A part of this work was supported by the Mount Zion Health Fund and the Seed Support for Clinical Research Award by the Department of Anesthesia and Perioperative Care, University of California, San Francisco.