|
The
Impact of Stress on the BarOn EQ-i® Reported Scores and A
Proposed Model of Inquiry[1] High Performing Systems, Inc. Technical
Report #15-5 Henry
L. Thompson, Ph.D. June 20, 2005 |
|
Abstract This
study looked at the impact of a “normal” mindset versus a
“stressed” mindset on the reported scores of the BarOn EQ-i
instrument, a self-report instrument that purports to measure emotional
intelligence. The results
indicated that with a simple set of instructions asking respondents to
assume a very stressed mindset, significant downward changes in the total
emotional intelligence and all 15 subscale scores were observed.
The significant main effect for mindset has numerous implications,
the most obvious being that individuals should not complete the instrument
while in a stressed mindset. A
second implication is that the relationship between emotional intelligence
and stress might be such that stress actually reduces an individual’s
ability to use his/her full emotional intelligence capacity.
The dynamic relationship among emotional intelligence, stress and
leader performance might also be visualized and predicted through the use
of a catastrophe theory model. |
Stress is
one of the major factors leaders must contend with in today's workplace. Tangri
(2003) states:
Stress
costs American business more than $300 Billion annually in lost productivity,
absenteeism, accidents, employee turnover, and medical, legal and insurance
fees, and workers’ compensation awards. This is more than 15 times the cost of
all strikes combined. In Canada, the annual cost to business is $16 Billion,
which is equivalent to 14% of total net profits. Total costs to employers for
accidents and work-related ill health in the United Kingdom is £7.3 Billion.
Stress in
the workplace is not expected to become any less problematic in the near future.
Leaders will continue to contend with stressful work environments.
Thompson
(1983) identified stress management—the leader’s ability to cope with
his/her own stress as well as reduce stress in the work environment—as a core
leader competency in both military and civilian organizations. Since 1988
results of the Assessment of Basic Leader Effectiveness®, a
multi-rater instrument, continue to validate the role of stress management as a
leader competency.
Numerous
articles have been published on the influence of emotional intelligence (EI) on
successful leader effectiveness (Goleman, 1995; Goleman, 1998; Cherniss, 2004).
As EI and leadership research continues to accumulate, there appears to be a
fairly conclusive base of support for the hypothesis that leaders with high EI
tend to outperform leaders with low EI. Even so, anecdotal cases of leaders with
high EI tending to derail under stress are fairly common. These special cases of
high EI leadership failures raise the question of “Is EI—or at least the way
we purport to measure EI—susceptible to the influence of stress?”
Stress,
according to Hans Selye (1978), one of the foremost authorities on stress, is
the body’s non-specific reaction to any demand made upon it. That is, the
body produces predictable physiological and behavioral responses when any
exogenous or endogenous stimulus acts on it. For example, stressful situations
such as winning a million dollars, getting a divorce or a promotion produce the
same core physiological symptoms. Using Selye’s definition of stress would
result in many leadership situations having a high probability of being
categorized as stressful, even for senior executives.
Based
on a review of the stress and EI literature, it is reasonable to expect that
some or all EI scales should show a response to stress. For example, a
characteristic behavioral response to stress is withdrawal from social
interaction. Thus, one would expect to see a decrease in Interpersonal
Relationship scores when a leader is experiencing high levels of stress.
Other examples may include lower scores on Self-Regard, Happiness and
Optimism.
An
exercise developed by Schutz (1984) to demonstrate the impact of high and low
self-esteem on individual performance consists of having two groups of three
people each perform a work task in front of the class. The only difference in
the directions between the two groups was that members of one group were told to
think of a time they had very low self-esteem just prior to entering the
classroom to receive their task. The second group was told to think of a time
when they had very high self-esteem. The difference in task performance between
the two groups was dramatic with the high self-esteem group significantly
outperforming the low self-esteem group in both quality of task performance and
attitude. The power of thought-induced attitude change caused by a one-sentence
direction given 60 seconds prior to receiving task instructions was dramatic.
Along
this same line, the mindset of an individual completing a self-report has been
shown to influence how he/she responds to a questionnaire. The Myers-Briggs
Type Indicator® (MBTI®) Manual (McCaulley,
Quenk & Hammer, 1998) suggests that “reported” Type might be influenced
by external factors:
Some
people have trouble finding the right mind-set for answering the MBTI. The
setting in which they answer the questions may influence them to report their
“work self,” “school self,” “ideal self,” or some other self that is
specific to external demands (p. 108).
Thompson
and Walsh (2000) had respondents complete the MBTI instrument twice. The
instrument was completed once with directions designed to create a “job”
mindset (actually completed while at work). The instrument was completed a
second time, on a different day, at home, with instructions designed to create a
“home” mindset. The sequence of administrations was randomized within the
group. The findings revealed a significant main effect for mindset. Even though
the MBTI instrument appears to be relatively robust with high test-retest
reliability (r =.92; McCaulley, et al., 1998), the individual’s mindset
has a significant influence on the outcome of the self-report. Furthermore, the
mindset was created with a simple set of instructions.
Ware,
Rytting and Jenkins (1994) found that when respondents were instructed to place
themselves into a “stressed” mind-set and complete the MBTI instrument,
their scores moved from their validated type preferences toward I, S, and T. The
Ware, et al., findings suggest that self-report instruments can be easily
influenced by instruction-induced “stressed” mindsets.
In a similar study, Thompson (2001)
found that when people were asked to complete FIRO® Element B™
(a self-report instrument) with instructions designed to create “normal” and
“stressed” mindsets, the two sets of scores were significantly different.
The “stressed” mindset scores, although significantly lower in the
aggregated data, were not always lower at the individual level. Some individuals
did not change in the predicted direction. As a group, they showed a significant
drop in desire for social interaction (to include others or be included) and
desire to be open (share their own personal feelings or have others share their
personal feelings with them). It could be inferred from the Element B changes
and the MBTI changes described above that EI might change during stressful
situations.
The EQ-i,
a self-report instrument that purports to measure EI, reports a Stress Tolerance
subscale test-retest reliability coefficient dropping from 0.79 at one month to
0.55 at four months (Bar-On, 2002). There is speculation around why this
subscale is so low after only one month (0.79) and, particularly, why it drops
to the very low 0.55 three months later. Of the fifteen subscales, Stress
Tolerance appears to be the least reliable and stable. This lack of stability
suggests that Stress Tolerance is susceptible to variations in the environment
and/or mindset of the respondent.
The
purpose of this study was to examine the impact of mindset on EI as reported by
the BarOn EQ-i instrument. The studies cited above provide support for the
ability to create a “stressed” mindset through instructions. There is also
reason to expect that at least some of the subscales will be influenced by the
mindset of the respondent resulting in lowered subscale scores. If this
hypothesis is true, it may have many implications, one of which is an
explanation for why some high EI leaders derail.
The
participants in the study were 62 (53% male and 47% female) supervisor and
management level volunteers from the United States. Their ages ranged from 22 to
63. Each participant received feedback on both the “normal” and
“stressed” mindset version of the EQ-i (133).
Participants
completed the EQ-i twice, with 1 to 5 days between completions, using a
different mindset each time. In the Anormal@
mindset they responded to the questions following the standard (“normal”)
EQ-i instructions. In the “stressed” mindset they answered the questions
using the following instructions:
Complete the EQ-i pretending that you are very
stressed, and respond to the questions the way you think you would if you were
really this stressed.
Pretend that your evil twin Skippy has totally
taken over. You have passed the edge of the Crazy Threshold. Mentally visit a
situation (work or personal) where you were very stressed, and then complete the
EQ-i in this very stressed mindset.
The
instruments were processed online through Multi-Health Systems, Inc., publisher
of the EQ-i, and the reports were provided to the researchers.
The first
step in the data analysis was to create the basic statistics for each group.
Tables 1 and 2 show these statistics.
|
|
N |
Mean |
Min |
Max |
SD |
|
|
N |
Mean |
Min |
Max |
SD |
|
TEI |
62 |
101.1 |
75.0 |
117.0 |
9.4 |
|
S
TEI
|
62 |
80.6 |
10.0 |
111.0 |
22.5 |
|
SR |
62 |
100.9 |
69.0 |
121.0 |
12.3 |
|
S
SR |
62 |
88.9 |
51.0 |
116.0 |
16.9 |
|
ES |
62 |
98.7 |
69.0 |
124.0 |
12.4 |
|
S
ES |
62 |
91.8 |
38.0 |
125.0 |
18.5 |
|
AS |
62 |
101.9 |
52.0 |
126.0 |
13.0 |
|
S
AS |
62 |
92.2 |
39.0 |
123.0 |
19.0 |
|
IN |
62 |
103.9 |
69.0 |
126.0 |
12.4 |
|
S
IN |
62 |
95.1 |
32.0 |
126.0 |
20.3 |
|
SA |
62 |
101.4 |
66.0 |
121.0 |
12.2 |
|
S
SA |
62 |
82.3 |
18.0 |
117.0 |
21.0 |
|
EM |
62 |
96.5 |
62.0 |
123.0 |
16.0 |
|
S
EM |
62 |
81.5 |
9.0 |
116.0 |
22.0 |
|
RE |
62 |
99.4 |
72.0 |
122.0 |
11.8 |
|
S
RE |
62 |
82.5 |
5.0 |
124.0 |
22.6 |
|
IR |
62 |
95.0 |
70.0 |
120.0 |
12.6 |
|
S
IR |
62 |
79.1 |
30.0 |
114.0 |
17.3 |
|
ST |
62 |
103.9 |
62.0 |
126.0 |
11.8 |
|
S
ST |
62 |
89.1 |
45.0 |
123.0 |
19.1 |
|
IC |
62 |
102.6 |
78.0 |
122.0 |
10.6 |
|
S
IC |
62 |
91.2 |
48.0 |
124.0 |
16.7 |
|
RT |
62 |
102.9 |
76.0 |
122.0 |
10.5 |
|
S
RT |
62 |
90.7 |
21.0 |
128.0 |
21.5 |
|
FL |
62 |
101.3 |
62.0 |
127.0 |
12.8 |
|
S
FL |
62 |
85.8 |
35.0 |
123.0 |
18.4 |
|
PS |
62 |
101.9 |
78.0 |
130.0 |
11.0 |
|
S
PS |
62 |
86.7 |
29.0 |
122.0 |
20.6 |
|
OP |
62 |
100.4 |
72.0 |
119.0 |
10.7 |
|
S
OP |
62 |
83.6 |
19.0 |
118.0 |
20.9 |
|
HA |
62 |
100.2 |
65.0 |
117.0 |
11.2 |
|
S
HA |
62 |
79.2 |
31.0 |
113.0 |
19.4 |
|
IN |
60 |
4.1 |
0.0 |
12.0 |
2.4 |
|
SIN |
60 |
4.9 |
1.0 |
10.0 |
2.3 |
|
PI |
60 |
110.9 |
82.0 |
141.0 |
13.7 |
|
SPI |
60 |
105.2 |
79.0 |
141.0 |
15.2 |
|
NI |
60 |
96.1 |
87.0 |
126.0 |
9.8 |
|
SNI |
60 |
108.6 |
87.0 |
186.0 |
22.9 |
Table 1 Table 2
Normal
Means
Stressed
Means
Table
1 shows that the “normal” group was slightly above average on eleven of the
fifteen subscales and the average standard deviation (SD) was 12.4. The
instrument’s SD is 15. The Inconsistency Score average was 4.1 with a range of
0 to 12. The Positive Impression average score was 110.9 with a range of 82 to
141. The Negative Impression average score was 96.1 with a range of 87 to 126.
Table 2
shows that the “stressed” group was below average on all fifteen subscales.
The average SD was 20 compared to the instrument’s SD of 15. The SD range is
significantly higher than the “normal” group. The Inconsistency Score
average was 4.9 with a range of 1 to 10, which is similar to the “normal”
group. The Positive Impression average score was 105.2 with a range of 79 to
141. The Negative Impression average score was 108.6 with a range of 87 to 186.
The Negative Impression range is considerably higher than the “normal”
group.
T-tests
performed on the subscale means indicated that the change from a “normal” to
a “stressed” mindset was statistically significant for each subscale. Figure
1 shows these changes graphically.

Figure
1
EQ-i
Subscale Changes from Normal to Stressed Mindset
The most
dramatic change occurred with Happiness (-21), followed by Self-Actualization
(-19), Optimism (-17), Social Responsibility (-17), Interpersonal Relationship
(-16), Empathy (-15), Stress Tolerance (-15), Flexibility (-15) and Problem
Solving (-15). The smallest changes
occurred with Emotional Self-Awareness (-7), followed by Independence (-9) and
Assertiveness (-10) subscales.
Inter-scale
correlations (Tables 3-4) were generated for the 15 EQ-i subscales and the Total
Emotional Intelligence score. Inter-scale correlations in the “stressed”
mindset increased dramatically. The “normal” mindset had 50 pairs (out of
104) that were not significantly correlated. The “stressed” mindset had only
two pairs (Impulse Control—Self-Regard
and Impulse Control-Assertiveness) that were not correlated.
|
|
TEI |
SR |
ES |
AS |
IN |
SA |
EM |
RE |
IR |
ST |
IC |
RT |
FL |
PS |
OP |
|
SR |
0.71 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ES |
0.67 |
0.31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AS |
0.55 |
0.45 |
0.35 |
|
|
|
|