Buscar en
European Journal of Psychiatry
Toda la web
Inicio European Journal of Psychiatry Validation of a brief scale for the assessment of distress associated to bipolar...
Journal Information
Vol. 33. Issue 1.
Pages 32-37 (January - March 2019)
Share
Share
Download PDF
More article options
Visits
2052
Vol. 33. Issue 1.
Pages 32-37 (January - March 2019)
Original article
Full text access
Validation of a brief scale for the assessment of distress associated to bipolar disorder
Visits
2052
A. Pascual-Sáncheza,
Corresponding author
anapascualsan@gmail.com

Corresponding author.
, J.M. Montes-Rodrígueza, C. Jenaro-Ríob, J. Saiz-Ruiza
a Servicio de Psiquiatría, Hospital Ramón y Cajal, Madrid, Spain
b Facultad de Psicología, Universidad de Salamanca, Spain
This item has received
Article information
Abstract
Full Text
Bibliography
Download PDF
Statistics
Tables (3)
Table 1. Sociodemographic and clinical data.
Table 2. DISBIP-S items and factors, with mean and standard deviation scores.
Table 3. Unstandardized loadings (standard errors), standardized loadings, and r2 value for 3-factor confirmatory model.
Show moreShow less
Abstract
Background and objectives

Perceived distress and discomfort has received less attention in the literature than other factors that influence the course of bipolar disorder (BD). Given its proven relationship with psychopathology, it is of great importance. However, it is necessary to design an instrument to assess it since there is no scale that measures this feature.

Methods

Descriptive cross-sectional design in which 72 BD euthymic patients were assessed. A scale to measure perceived distress in BD (perceived consequences, impact on interpersonal relationships and disorder self-management), scored from 1 to 10 and developed for this study, was applied. In addition, the Young Mania Rating Scale (YMRS) and the Hamilton Depression Scale (HAM-D) were also applied.

Results

Reliability and validity analyses, as well as descriptive and inferential analysis were done. The developed measure showed adequate reliability and validity properties. Descriptive analyses show that the issues that generate more distress in patients were the burden associated to the disease, the perception of a lack of responsiveness from close people, the negative impact of their illness on those relationships, the alteration of mental functions, and the difficulties of managing daily stress.

Conclusions

The present study offers evidence of the psychometric adequacy and usefulness of the developed scale to assess the distress experienced by patients with BD. It is necessary for mental health professionals to pay attention to the patient's perception of illness.

Keywords:
Bipolar disorder
Distress
Scale
Assessment
Subjective well-being
Abbreviations:
BD
DISBIP
HAM-DH
YMRS
Full Text
Introduction

Bipolar disorder (BD) is a chronic and recurrent mood disorder characterized by affective episodes (mania, hypomania, and depression), alternating with periods of euthymia. These mood swings, as well as the possible persistence of subthreshold symptoms and neurocognitive alterations, make this a complex chronic condition that implies significant personal and social costs1–3 and a clear impact on quality of life.4

It is very well-known that recovery is associated with clinical factors, such as number of previous hospitalizations, severity of symptoms and comorbidity.5 Some studies have focused on the impact of gender and diagnosis. For example, it is possible to find differences associated with the subtype of BD (I or II) and predominant polarity (depressive or manic). Type II BD and/or predominantly depressive polarity patients are associated to lower quality of life.6 In addition, subthreshold symptoms are associated with poorer outcomes in terms of functioning and quality of life.6 Regarding gender, some studies7 found lower quality of life in women.

Many other studies have focused on identifying psychosocial factors associated with poorer outcome. Factors are related to lack of aware of illness,8 perceived stigma,1,9,10 perceived lack of disease control or coping skills11,12 and associated interpersonal and social consequences.13 In line with this, some studies14 highlight the interpersonal problems associated with the disease and the perceived associated difficulties at different levels (personal, social, and work) as highly relevant for patients. For example, variables such as having a close relationship could become better predictors of work adjustment than clinical factors, such as the number of previous hospitalizations.15 Thus, when only considering clinical factors, functioning and quality of life in patients with BD are not always as expected.

Since difficulties coping with the illness have been found to be associated with depression and perceived distress in these patients,16 a key aspect to take into account is the existence of negative thoughts towards the illness. Although perceived distress has received less attention, it is of great importance given its proven association to anxiety and depression.17

The concept of distress is a poorly-defined and, at the same time, widely used construct, including in diagnostic classifications such as DSM and ICD.18 In general, distress may be caused by physical, psychological, emotional, or social problems as consequences of illness.19 It is a variable that is often under-recognized and under-attended.20 Emotional distress usually refers to high levels of negative affect21 (e.g. high worthlessness, high sadness). In this regard, some authors distinguish between distress, which is defined as a non-specific, biological or emotional response to a demand or stressor that is harmful to the individual, and psychological distress, which is defined as a unique discomforting, emotional state experienced by an individual in response to a specific stressor or demand that results in harm, either temporary, or permanent, to the person.22 In this paper we are assuming a general distress approach, meaning that we are considering not only emotional discomfort, but also, psychological and social unease associated to BD.

Given the chronic and recurrent nature of BD, patients may experience a high degree of distress related to the consequences of the disorder and the difficulties associated with its management, and they may feel overwhelmed by not being able to reduce this distress by themselves. The distress could be conceptualized as difficulties to cope with the disorder. Although other issues related with this experience, such as the internal hopelessness and stigma, could also interact with the way patients deal with their conditions, the management of distress has shown to impact on the course of different psychopathological issues.23 In fact, some studies show that the absence of depressive symptoms does not necessarily reflect psychological well-being, but rather a significant degree of distress,24 so it is expected that people in euthymia experience some degree of distress depending on how they cope with the illness.

Assessment of this construct in BD is highly relevant, given that there may be an important degree of distress even in euthymic patients. There are different assessment instruments to measure distress in both general25 and clinical populations.26,27 However, current literature shows little development of specific tools for the assessment of distress associated with mental disorders such as BD. In recent years, some researchers have developed measures such as the Quality of Life Questionnaire on Bipolar Disorder, validated by Michalak and Murray.28 Nevertheless, some of the items include symptoms of the disorder itself (for example, feeling full of energy or having difficulty getting out of bed, among others), which may bias results for estimating distress associated with BD, regardless of clinical symptoms.

Based on the lack of adequate measures to assess distress experienced by BD patients from a comprehensive (i.e. physical, psychological, emotional and social) perspective, the current study reports on the validation process of a measure to asses perceived distress in BD patients in the absence of active clinical symptoms. Reliability and validity analyses, as well as results derived from applying the scale to a sample of BD patients are presented. In addition, four hypotheses are tested: (1) the existence of distress in both interpersonal and cognitive domains is predicted among BD euthymic patients. In addition, (2) higher levels of distress are expected in patients with a diagnosis of type II BD or predominant depressive polarity, as well as (3) significant differences according to gender, with higher distress levels in women. Finally, (4) significant correlations between the developed scale, the YMRS28 and the HAM-D29 are expected.

MethodsParticipants

Our sample consisted of 72 bipolar outpatients, aged 24–72 (mean=48.40±11.48); 59.7% were female. All participants were from the Ramón y Cajal Hospital and the Bipolar Association of Madrid. Sociodemographic and clinical data are shown in Table 1. As can be noted, approximately two thirds of the cases were diagnosed with type I BD and the predominant polarity was depressive. Almost half of the participants required one or two psychiatric admissions. Chi-square analyses show a lack of association between sociodemographic (i.e. age, cohabitation, etc.), and clinical (polarity, diagnosis, psychiatric admissions) and gender, which denote that males and females share similar characteristics.

Table 1.

Sociodemographic and clinical data.

Variables  Category  N 
Sociodemographic data
Sex  Male  29  40.3 
  Female  43  59.7 
Age  18–29  4.2 
  30–39  17  23.6 
  40–49  19  26.4 
  50–59  20  27.89 
  ≥60  13  18.1 
Cohabitation  Alone  20  27.8 
  With family of origin  29  40.3 
  With own family  23  31.9 
Marital status  Single  28  38.9 
  Married  21  29.2 
  Divorced  21  29.2 
  Widow  1.4 
Academic level  Elementary School or less  9.7 
  Middle School  29  40.3 
  University  35  48.6 
Employment status  Employed  27  37.5 
  Unemployed  17  23.6 
  Retired  28  38.9 
Clinical variables
Diagnosis  BD I  47  65.3 
  BD II  25  34.7 
Predominant polarity  Manic  25  34.7 
  Depressive  45  62.5 
Admissions in psychiatry  None  18  25.0 
  1–2  26  36.1 
  3–5  17  23.6 
  6–9  9.7 
  ≥10  5.6 

For inclusion in the study, participants had to score ≤7 on the YMRS28 and the HAM-D29 scales to ensure that they were euthymic. Patients with co-morbid diagnoses of personality disorder and substance abuse, as well as those with concomitant chronic physical pathologies were excluded from the current study.

Instruments

To assess euthymia, the Spanish version of the Young Mania Rating Scale (YMRS),28 and the Hamilton Depression Scale (HAM-D)29 were used. Likewise, to assess the perceived distress by BD patients, the DISBIP (Distress Scale for Bipolar Disorder) was developed (items, translated from Spanish, are shown in Table 2). This measure consists of 46 Likert type items (1–10), to assess three domains where psychological, emotional, and social distress are present: (1) distress associated with the perceived cognitive consequences of the disease, (2) distress associated with the management and coping of the disease, and (3) interpersonal distress. The first domain assesses the perceived discomfort associated to changes in emotions, personality and cognitive functions. The aim is to assess distress regarding perceived consequences of the illness from a predominantly cognitive viewpoint. The second domain assesses the extent to which patients feel capable of managing their own disease. That is, the capability to live a normal life, to attain personal goals, and to feel satisfied. Finally, the third domain assesses the impact of the disorder on the patient's social relationships. For all the domains and the total measure, the higher the score, the more distress experienced.

Table 2.

DISBIP-S items and factors, with mean and standard deviation scores.

  Items (and factor)  Mean  SD 
1.  I feel that bipolar disorder allows me to live a normal life. (M)  4.39  2.71 
2.  When I think about living with a bipolar disorder, I feel sad, angry and/or scared. (C)  5.13  2.83 
3.  Having a bipolar disorder does not stop me from doing those things which are important to me. (M)  4.39  2.89 
4.  Having a bipolar disorder allows me to live my life like anyone else. (M)  4.35  3.11 
5.  My bipolar disorder conditions my personality. (C)  5.75  3.16 
6.  I think my mental functions are impaired due to bipolar disorder. (C)  5.71  3.23 
7.  I can’t do the daily chores as I would like to do because of my bipolar disorder. (M)  4.63  3.31 
8.  Having bipolar disorder does not prevent me from reaching my goals. (M)  4.40  3.11 
9.  People who have bipolar disorder must face the heavy burden of the illness. (C)  5.89  3.27 
10.  If someone asks me if I think that I live a satisfying life despite having bipolar disorder, I would say yes without a doubt. (M)  4.08  3.04 
11.  Having this disease causes me great distress that I find difficult to cope with. (C)  4.50  3.00 
12.  Even though I have a bipolar disorder, I feel that I live a satisfying life. (M)  3.80  2.88 
13.  People who do not have bipolar disorder do not understand me. (I)  5.43  2.94 
14.  I think people close to me are well informed about what bipolar disorder is. (I)  4.92  3.19 
15.  My friends treat me like anyone else who doesn’t have a disease. (I)  3.82  3.13 
F1  Management of the disease  4.32  2.30 
F2  Cognitive distress  5.38  2.30 
F3  Interpersonal distress  4.72  2.34 
Procedure

First, an item-analysis was carried out by four expert raters who had to rate: (1) the intensity or degree to which each item belongs to a particular category, (2) the degree to which the item is considered adequate to assess BD patients (for both judgments a scale of 1–5 points was used, with 5 being the maximum score); and (3) the valence (positive or negative) of the item. After the ratings, agreement indices were calculated. This allowed us to refine the wording of the items. Then, reliability analysis and confirmatory factor analysis CFA) were performed.

After receiving the approval of the Ramón y Cajal Hospital Ethics Committee, the initial pool of 46 items was applied to the selected participants, together with a socio-demographic questionnaire and the YMRS28 and HAM-D29 scales. Previous, informed consent was acquired and confidentiality was guaranteed to the participants. Reliability and CFA were performed with a 15-item version of the scale, given the relatively small sample size and the search for an easier-to-administer scale that retains high reliability with evidence of construct validity

Statistical analysis

IBM@ SPSS@ and Amos v. 23 were utilized for the analyses. Interrater reliability was estimated with the Fleiss Kappa statistic.30 Reliability analyses were performed with Cronbach's alpha statistics. CFA were performed to assess the goodness-of-fit of the proposed three-factor model. Maximum likelihood parameter estimation was utilized as multivariate normality was identified.31 Several common fit indexes such as Absolute/predictive fit Chi-Square, the Non-Normed Fit Index (NNFI, also known as Tucker-Lewis index or TLI), the Comparative Fit Index (CFI), and the root mean square error of approximation (RMSEA) were utilized. In general, RMSEA<.06, TLI>.95, CFI>.95 are the suggested cutoff values to support model fit.32 Next, correlational and inferential analyses (Pearson's correlation, Student's T test and ANOVA test) were performed to contrast the additional hypotheses.

Results

The analysis of the concordance among raters concerning category resulted in a percent agreement=89.85% which is very high,30 and four items were revised for the wording and content. The agreement on the intensity and adequacy of the items required that only one item be reviewed. Finally, with respect to valence, it was suggested that one of the items be reviewed.

The 15-item version of the measure (see Table 2) was selected for further analyses. Cronbach's alpha for the scale was .90. The reliability was .88 for Management of the disease (n=7 items), .80 for Cognitive distress (n=5 items), and .64 for Interpersonal distress (n=3 items). These results support the reliability of the measure.

Table 3 shows the parameter estimates (unstandardized and standardized) and r2 values for the model when using ML estimator. Note that all the items have medium-high r2 values, as well as high loadings in their respective factors. The hypothesized model appears to be a good fit to the data: χ2 (87)=115.876; p=.021; χ2/df=1.332. The CFI is.93; RMSEA is .068 (90% CI: .028 to .099. The correlation between latent variables Management and Cognitive was .799 (covariance=3.064, SE=.833); the correlation between latent variables Interpersonal and Cognitive was .537 (covariance=1.479, SE=.611); the correlation between latent variables Interpersonal and Management was .770 (covariance=2.576, SE=.828). Altogether, the results offer support to the proposed three-factor model.

Table 3.

Unstandardized loadings (standard errors), standardized loadings, and r2 value for 3-factor confirmatory model.

      Unstandardized (SE)  Standardized  r2 
M1  ←  Management  1.000 (–)  .802  .644 
M2  ←  Management  .810 (.152)  .610  .372 
M3  ←  Management  1.128 (.153)  .788  .620 
M4  ←  Management  .951 (.173)  .625  .391 
M5  ←  Management  .799 (.167)  .559  .312 
M6  ←  Management  1.073 (.151)  .770  .593 
M7  ←  Management  1.148 (.139)  .864  .747 
C1  ←  Cognitive  1.000 (–)  .631  .399 
C2  ←  Cognitive  1.157 (.259)  .655  .430 
C3  ←  Cognitive  1.162 (.263)  .645  .415 
C4  ←  Cognitive  1.151 (.265)  .629  .396 
C5  ←  Cognitive  1.249 (.255)  .744  .553 
I1  ←  Interpersonal  1.000 (–)  .532  .283 
I2  ←  Interpersonal  1.469 (.405)  .721  .519 
I3  ←  Interpersonal  1.183 (.355)  .590  .348 

Note: Dashes (–) indicate the standard error was not estimated. r2=Squared Multiple Correlations

Regarding the second hypothesis (see Table 2), the descriptive analyses of the items showed that the issues that generate more distress were cognitive in nature, namely the perceived burden associated with the disease (5.89±3.27), the perceived alteration of personality (5.75±3.16), and the alteration of mental functions (5.71±3.23). Some Interpersonal issues, such as perception of a lack of understanding from people who do not have this disorder (5.43±2.94), are also noteworthy. Medium-moderate levels of distress associated to the disease are identified among the three factors.

Regarding the third hypothesis, predominant polarity was associated to significant differences in Management of the disease and Cognitive distress, in 6 of the 15 items. Patients with depressive polarity experience significantly higher distress in both domains. Regarding the fourth hypothesis, significant differences (p<.05) in the item concerning mental functioning (item 5, perceived difficulties), were more severe for men than for women. No additional differences were found by gender.

With regard to the associations between the utilized measures, contrary to our expectations, non-significant correlations were obtained between YMRS29 and the three factors of the developed measure. As expected, correlations with HAM-D30 were positive, medium-high and significant (p<.01) with the three domains of the scale: .657 (Management), .500 (Cognitive), and .414 (Interpersonal).

Discussion

This study offers evidence of the psychometric adequacy of the developed scale. First, the interrater’ agreement supports the scale content and face validity.33 Additionally, reliability indexes for the three factors and total scale support its internal consistency. The different indexes suggest the three-factor model fit to the data, which also offers support to the construct validity of the measure. The findings reveal the perception of burden associated with the disease itself, as well as with its impact on interpersonal life, is consistent with previous studies.14

As expected, the differences found by diagnosis and predominant polarity are congruent with previous studies6 and reveal that patients with type II BD and/or predominant depressive polarity experience worse quality of life. These results also support the validity of the scale to adequately discriminate between diagnostic subgroups.

With regard to the differences by gender, contrary to our expectations, there was a general lack of significant differences based on this variable. Previous studies have found poorer quality of life in women. Such findings are explained by comorbidities such as physical conditions, particularly if they involve pain.7 Therefore, current findings could be explained if we consider that this study excluded patients with concomitant chronic physical pathologies.

On the other hand, and in line with the fourth hypothesis, the analysis of the association between the items and the HAM-D29 showed significant correlations with all the dimensions of the scale, although no significant correlations with the YMRS28 were found. As the sample only included euthymic patients, these findings may show that distress related to BD euthymic patients is more closely associated to depression than to mania. Given the tendency of these patients to suffer from subclinical depressive symptoms at follow-up, and the association of these symptoms with worse functioning and poorer quality of life,34,35 the developed scale may be used as a screening tool to better meet each patients’ needs. In addition, as the findings suggest that the difficulties perceived by BD patients may occur at personal and interpersonal levels, interventions aimed at learning how to cope with their illness are essential to promote their wellbeing.9,35

The current study has a number of limitations that should be considered. First, this cross-sectional study was conducted at two institutions and with a relatively small sample. Therefore, caution should be noted when using the findings of this study to make generalized conclusions. Also, more homogeneous subsets in terms of age and diagnosis are also advisable and expected in further studies. The use of already validated measures to compare the current findings and the impact of distress in other dimensions (stigma and beliefs about the disease, for example) is recommended and planned for in future phases of the study. Also, the application of the current measure to a larger sample will allow performing additional reliability and validity analyses as expected in a scale validating process, leading to the definitive version of the scale.

Conclusions

In sum, this study offers evidence of the usefulness of the developed scale to assess the distress experienced by BD patients. The scale has shown adequate content, and construct (convergent and discriminant) validity, as well as reliability. It has also shown that being euthymic does not preclude experiencing distress in personal and interpersonal domains. The need to validate a measure which makes it possible to identify these issues is clear and is potentially useful for both clinical work and research. It would be a useful measure in terms of tertiary prevention, with the aim to promote psychosocial functioning and to prevent further deterioration. In short, it will allow us to improve the care of these patients, making it easier for the clinician to identify issues beyond the symptomatology, which can interfere both in the course of the disease and in their adaptation to the daily life.

Funding

There was no funding for this work.

Conflict of interest

The authors have no conflict of interest to declare.

Acknowledgements

The authors are indebted to the expert judges for their comments and review of the scale.

References
[1]
E. Michalak, J.D. Livingston, R. Hole, M. Suto, S. Hale, C. Haddock.
‘It's something that I manage but it is not who I am’: reflections on internalized stigma in individuals with bipolar disorder.
Chronic Illness, 7 (2011), pp. 209-224
[2]
S.V. Parikh, L.D. Hawke, V. Velyvis, A. Zaretsky, S. Beaulieu, I. Patelis-Siotis, et al.
Combined treatment: impact of optimal psychotherapy and medication in bipolar disorder.
Bipolar Disord, 17 (2015), pp. 86-96
[3]
L.G. Sylvia, R.C. Shelton, D.E. Kemp, E.E. Bernstein, E.S. Friedman, B.D. Brody, et al.
Medical burden in bipolar disorder: findings from the Clinical and Health Outcomes Initiative in Comparative Effectiveness for Bipolar Disorder study (bipolar CHOICE).
Bipolar Disord, 17 (2015), pp. 212-223
[4]
S.A. Mackala, I.J. Torres, J. Kozicky, E.E. Michalak, L.N. Yatham.
Cognitive performance and quality of life early in the course of bipolar disorder.
J Affect Disord, 168 (2014), pp. 119-124
[5]
A. Soni, P. Singh, R. Shah, S. Bagotia.
Impact of cognition and clinical factors on functional outcome in patients with bipolar disorder.
East Asian Arch Psychiatry, 27 (2017), pp. 26-34
[6]
C.M. Bonnín, J. Sánchez-Moreno, A. Martínez-Arán, B. Solé, M. Reinares, A.R. Rosa, et al.
Subthreshold symptoms in bipolar disorder: impact on neurocognition, quality of life and disability.
J Affect Disord, 136 (2012), pp. 650-659
[7]
M.S. de la Cruz, Z. Lai, D.E. Goodrich, A.M. Kilbourne.
Gender differences in health-related quality of life in patients with bipolar disorder.
Arch Womens Ment Health, 16 (2013), pp. 317-323
[8]
R.A. da Silva, D.C. Mograbi, J. Bifano, C.M.T. Santana, E. Cheniaux.
Insight in bipolar mania: evaluation of its heterogeneity and correlation with clinical symptoms.
J Affect Disord, 199 (2016), pp. 95-98
[9]
C. Cerit, A. Filizer, Ü. Tural, A.E. Tufan.
Stigma: a core factor on predicting functionality in bipolar disorder.
Compr Psychiatry, 53 (2012), pp. 484-489
[10]
K.K. Nilsson, P. Kugathasan, K.N. Straarup.
Characteristics, correlates and outcomes of perceived stigmatization in bipolar disorder patients.
J Affect Disord, 194 (2016), pp. 196-201
[11]
G.C. Nitzburg, M. Russo, A. Cuesta-Diaz, L. Ospina, M. Shanahan, M. Perez-Rodriguez, et al.
Coping strategies and real-world functioning in bipolar disorder.
J Affect Disord, 198 (2016), pp. 185-188
[12]
P.J. Taylor, M. Pyle, M. Schwannauer, P. Hutton, A. Morrison.
Confirming the structure of negative beliefs about psychosis and bipolar disorder: a confirmatory factor analysis study of the Personal Beliefs about Experience Questionnaire and Personal Beliefs about Illness Questionnaire.
Br J Clin Psychol, 54 (2015), pp. 361-377
[13]
T.E. Van Rheenen, S.L. Rossell.
Objective and subjective psychosocial functioning in bipolar disorder: an investigation of the relative importance of neurocognition, social cognition and emotion regulation.
J Affect Disord, 162 (2014), pp. 134-141
[14]
K. Watanabe, E. Harada, T. Inoue, Y. Tanji, T. Kikuchi.
Perceptions and impact of bipolar disorder in Japan: results of an Internet survey.
Neuropsychiatr Dis Treat, 12 (2016), pp. 2981-2987
[15]
C. Hammen, M. Gitlin, L. Altshuler.
Predictors of work adjustment in bipolar I patients: a naturalistic longitudinal follow-up.
J Consult Clin Psychol, 68 (2000), pp. 220-225
[16]
C. de Dios, A. González-Pinto, J.M. Montes, J.M. Goikolea, J. Saiz-Ruiz, E. Prieto, et al.
Predictors of recurrence in bipolar disorders in Spain (PREBIS study data).
J Affect Disord, 141 (2012), pp. 406-414
[17]
H.J. Stratford, M.J. Cooper, M. Di Simplicio, S.E. Blackwell, E.A. Holmes.
Psychological therapy for anxiety in bipolar spectrum disorders: a systematic review.
Clin Psychol Rev, 35 (2015), pp. 19-34
[18]
M. Phillips.
Is distress a symptom of mental disorders, a marker of impairment, both or neither?.
World Psychiatry, 82 (2009), pp. 91-92
[19]
D. Howell, K. Olsen.
Distress. The 6th vital sign.
Curr Oncol, 18 (2011), pp. 208-210
[20]
L. Vitek, Q. Rosenzweig, S. Stollings.
Distress in patients with cancer: definition, assessment, and suggested interventions.
Clin J Oncol Nurs, 11 (2007), pp. 413-418
[21]
D. David, G.H. Montgomery, B. Macavei, D.H. Bovbjerg.
An empirical investigation of Albert Ellis's binary model of distress.
J Clin Psychol, 61 (2005), pp. 499-516
[22]
L.P. Greenberg.
The flexibility of distress tolerance through a Brief-Acceptance and Commitment Therapy intervention: a pilot study.
Diss Abstr Int, 76 (2016),
[23]
A.A. Nierenberg, K.H. Bentley, A.H. Farabaugh, M. Fava, T. Deckersbach.
The absence of depressive symptoms is not the presence of wellness: validation of the Clinical Positive Affect Scale.
Aust NZ J Psychiatry, 46 (2012), pp. 1165-1172
[24]
R.C. Kessler, G. Andrews, L.J. Colpe, E. Hiripi, D.K. Mroczek, S.L. Normand, et al.
Short screening scales to monitor population prevalences and trends in non-specific psychological distress.
Psychol Med, 32 (2002), pp. 959-976
[25]
L. Fisher, R.E. Glasgow, J.T. Mullan, M.M. Skaff, W.H. Polonsky.
Development of a Brief Diabetes Distress Screening Instrument.
Ann Fam Med, 6 (2008), pp. 246-252
[26]
E.E. Michalak, G. Murray.
Development of the QoL BD: a disorder-specific scale to assess quality of life in bipolar disorder.
Bipolar Disord, 12 (2010), pp. 727-740
[27]
V.J. Pop, A.M. Pommer, M. Pop-Purceleanu, H.A. Wijnen, V. Bergink, F. Pouwer.
Development of the Tilburg Pregnancy Distress Scale: the TPDS.
[28]
F. Colom, E. Vieta, A. Martínez-Arán, M. Garcia-Garcia, M. Reinares, C. Torrent, et al.
Spanish version of a scale for the assessment of mania: validity and reliability of the Young Mania Rating Scale.
Med Clin (Barc), 119 (2002), pp. 366-371
[29]
J.A. Ramos-Brieva, A. Cordero.
A new validation of the Hamilton Rating Scale for Depression.
J Psychiatr Res, 22 (1988), pp. 21-28
[30]
M.L. McHugh.
Interrater reliability: the kappa statistic.
Biochem Med (Zagreb), 22 (2012), pp. 276-282
[31]
R. Kline.
Principles and practices of structural equation modeling.
2nd ed., Guilford, (2005),
[32]
L.T. Hu, P.M. Bentler.
Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives.
Struct Equ Modeling, 6 (1999), pp. 1-55
[33]
D. Borsboom, G.J. Mellenbergh, J. van Heerden.
The concept of validity.
Psychol Rev, 111 (2004), pp. 1061-1071
[34]
E.M. Christensen, A. Gjerris, J.K. Larsen, B.B. Bendtsen, B.H. Larsen, H. Rolff, et al.
Life events and onset of a new phase in bipolar affective disorder.
Bipolar Disord, 5 (2003), pp. 356-361
[35]
D.M. Quinn, S.R. Chaudoir.
Living with a concealable stigmatized identity: the impact of anticipated stigma, centrality, salience, and cultural stigma on psychological distress and health.
Stigma Health, 1 (2015), pp. 35-59
Copyright © 2018. Asociación Universitaria de Zaragoza para el Progreso de la Psiquiatría y la Salud Mental
Article options
Tools
es en pt

¿Es usted profesional sanitario apto para prescribir o dispensar medicamentos?

Are you a health professional able to prescribe or dispense drugs?

Você é um profissional de saúde habilitado a prescrever ou dispensar medicamentos