Regístrese
¿Aún no está registrado?
Información relevante

Consulte los artículos y contenidos publicados en éste medio, además de los e-sumarios de las revistas científicas en el mismo momento de publicación

Máxima actualización

Esté informado en todo momento gracias a las alertas y novedades

Promociones exclusivas

Acceda a promociones exclusivas en suscripciones, lanzamientos y cursos acreditados

Crear Mi cuenta
Buscar en
Revista de Psicología del Trabajo y de las Organizaciones
Toda la web
Inicio Revista de Psicología del Trabajo y de las Organizaciones Moderator effects of job complexity on the validity of forced-choice personality...
Journal Information
Vol. 33. Num. 3.
Pages 165-238 (December 2017)
Share
Share
Download PDF
More article options
Visits
3385
Vol. 33. Num. 3.
Pages 165-238 (December 2017)
DOI: 10.1016/j.rpto.2017.07.001
Open Access
Moderator effects of job complexity on the validity of forced-choice personality inventories for predicting job performance
Efectos moderadores de la complejidad del puesto sobre la validez de los cuestionarios de personalidad de elección forzosa para predecir el desempeño
Visits
3385
Jesús F. Salgado
Corresponding author
jesus.salgado@usc.es

Corresponding author: Faculty of Labour Relations. University of Santiago de Compostela. 15782 Santiago de Compostela, Spain.
University of Santiago de Compostela, Spain
This item has received
3385
Visits

Under a Creative Commons license
Article information
Abstract
Full Text
Bibliography
Download PDF
Statistics
Figures (2)
Tables (3)
Table 1. Predictor and Criterion Reliability Distributions and Range Restriction Distribution for the Three Levels of Job Complexity.
Table 2. Meta-analysis of the Validity of Normative FC Measures of the FFM for Managerial Occupations.
Show moreShow less
Abstract

Research has demonstrated that job complexity moderates the validity of general mental ability (GMA), the relationship between personality and job satisfaction, and the relationship between GMA and job satisfaction. However, no published research has investigated whether job complexity moderates the criterion validity of the Five-Factor Model (FFM) of personality for predicting job performance. This paper reports a meta-analytic examination of the moderator effects of job complexity on the criterion validity of the FFM of personality as assessed with forced-choice inventories. In accordance with the hypotheses, the results showed that job complexity moderates negatively the validity of conscientiousness and emotional stability and that it moderates positively the validity of openness. The implications for personnel selection research and practice are discussed.

Keywords:
Big Five
Job complexity
Meta-analysis
Forced-choice inventories
Personality
Resumen

La investigación ha demostrado que la complejidad del puesto de trabajo modera la validez de la capacidad mental general (CMG), la relación entre la personalidad y la satisfacción en el trabajo y las relaciones entre la CMG y la satisfacción en el trabajo. Sin embargo, no se ha publicado ninguna investigación que haya examinado si la complejidad del puesto de trabajo modera la validez de criterio del modelo de los cinco grandes factores (MCGF) de personalidad para predecir el desempeño en el trabajo. Este artículo presenta un metaanálisis sobre los efectos moderadores de la complejidad del puesto en la validez del MCGF de personalidad cuando se emplean cuestionarios de elección forzosa (CEF). De acuerdo con las hipótesis planteadas, los resultados muestran que la complejidad del puesto modera negativamente la validez de criterio de los factores de responsabilidad y de estabilidad emocional y positivamente la validez del factor de apertura a la experiencia. Finalmente, se plantean algunas posibles implicaciones para la teoría y la práctica de la selección de personal.

Palabras clave:
Los cinco grandes
Complejidad del puesto
Metaanálisis
Cuestionarios de elección forzosa
Personalidad
Full Text

Recent surveys have shown that personality inventories are popular instruments for making personnel decisions in the United States (US) and the European Union (EU) (Alonso, Moscoso, & Cuadrado, 2015; Tett, Christiansen, Robie, & Simonet, 2011; Zibarras & Woods, 2010) and research on personality at work has also shown they are very useful procedures for predicting important organizational criteria. For example, personality measures predict job performance, training proficiency, counter-productive behaviors, well-being, accidents, productivity data, salary, promotions, and occupational attainment, among other work criteria (Barrick & Mount, 1991; Barrick, Mount, & Judge, 2001; Clarke & Robertson, 2005; Gilar, De Haro, & Castejón, 2015; Ng, Eby, Sorensen, & Feldman, 2005; Ones, Viswesvaran, & Schmidt, 1993; Poropat, 2009; Raman, Sambasiva, & Kumar, 2016; Salgado, 1997, 1998, 2002, 2003; Salgado, Anderson, & Tauriz, 2015; Salgado & Tauriz, 2014). They also predict expatriate cross-cultural adjustment and effectiveness (AlDosiry, Alkhadher, AlAqraa, & Anderson, 2016; Mol, Born, Willemsen, & Van der Molen, 2005; Salgado & Bastida, 2017).

In the domain of personality at work, the Five-Factor Model (FFM) of personality (i.e., emotional stability, extraversion, openness to experience, agreeableness, and conscientiousness) has received more attention than any alternative model. The extant meta-analytic evidence has demonstrated that conscientiousness and emotional stability generalized validity across samples, criteria, occupations, and countries, and that the other three personality dimensions were valid predictors for specific criteria and specific occupations. For example, openness to experience predicted training proficiency, and extraversion and agreeableness predicted performance in occupations characterized by a large number of interpersonal relationships (e.g., Barrick et al., 2001; Judge, Rodell, Klinger, Simon, & Crawford, 2013).

Nevertheless, agreement is not unanimous about the relevance of personality measures for personnel selection. For example, Murphy and Dzieweczynski (2005) posited that the theories linking personality constructs and job performance were often vague and unconvincing, that little was known about how to match personality dimensions and occupations, and that some of the most valid personality-related measures (e.g., integrity tests) included poorly defined constructs. On the other hand, researchers suggested that the validity of personality measures was small and that the measures based on self-reports can be faked, independently of the administration mode (Grieve & Hayes, 2016; Morgeson et al., 2007a, 2007b; Salgado, 2016).

In part, these criticisms have been contradicted by recent research that showed that (1) the format of the personality inventories is an important moderator of the criterion-related validity of the Big Five dimensions (Salgado, Anderson et al., 2015; Salgado & Tauriz, 2014), (2) the facets of the Big Five do not show evidence of criterion-related validity for predicting job performance when the variance of the facets is residualized (Salgado, Moscoso, & Berges, 2013; Salgado, Anderson et al., 2015), and (3) there is robust evidence of the construct validity of the FFM (e.g., Judge et al., 2013). With regard to the first issue, Salgado and Tauriz (2014) and Salgado, Anderson et al. (2015) found that criterion-related validity increased noticeably when quasi-ipsative forced-choice (QIFC) formats are used. For example, the operational validity of conscientiousness was found to be .39 when a QIFC format was used. In addition, some empirical evidence showed that the forced-choice (FC) format can be more resistant to faking than the most frequently used formats, such as Likert's (Jackson, Wroblewski, & Ashton, 2000; Nguyen & McDaniel, 2000).

Therefore, there is currently empirical evidence that the FC personality inventories are valid predictors of job performance and that they are also widely used in organizations for making personnel decisions. However, no previous research has examined the potential moderator effects of job complexity on the FC inventories as a unique category, nor have the moderator effects for the particular types of FC inventories (i.e., normative, ipsative, and quasi-ipsative) been examined.

The objective of this study is to shed light on this issue that has been ignored in the meta-analytic research conducted to examine the validity of the FC personality inventories. Consequently, the main goal of this study is to meta-analytically examine whether job complexity is a moderator of the criterion validity of FC inventories. The second goal is to check whether job complexity has similar effects for the three types of FC personality scores which can be obtained from FC inventories. Thus, the main contribution of this paper lies in highlighting the role that job complexity plays in the validity of FC personality inventories for predicting job performance.

Forced-Choice Personality Inventories

The first FC personality inventories were developed during the 1940s and 1950s (Hicks, 1970) and the FC models used in those days have remained relatively unchanged until now. Usually, the FC method asks the individual to make a choice between several alternatives, most frequently three or four. In order to make the decision the individual must indicate what alternative he/she likes most and what alternative he/she likes least when those alternatives are applied to the individual. The alternatives are paired in terms of similar levels of social discrimination and preference. Therefore, the FC method distinguishes from the most typical personality assessment methods, such as Likert, True-False, Agree-Indecisive-Disagree (collectively called single-stimulus [SS] methods), in that the individual has to make a choice between two or more alternatives rather than to rate each single statement or phase as is typically done with SS personality inventories.

Even though the FC method always consists of a choice between alternatives, the FC inventories can produce three types of scores depending on how the choice is made (Cattell, 1944; Clemans, 1966; Hicks, 1970). The FC personality inventories can result in normative, ipsative, and quasi-ipsative scores (see Salgado, Anderson et al., 2015, and Salgado & Tauriz, 2014, for a detailed account of these three scores). This contrasts with the SS personality inventories which always produce normative scores. Therefore, it is important to take into account the score type produced by the FC inventory because each of them has important psychometric characteristics.

The normative scores allow comparisons among individuals and groups on each personality variable. Therefore, they are inter-individual scores. The ipsative scores are dependent on the individual level in the other variables included in the choice. Consequently, ipsative scores permit the comparison of one individual across different personality factors. In other words, the ipsative scores are intra-individual ones. The quasi-ipsative scores allow comparisons between individuals and between groups, but produce simultaneously some degree of dependence among the variables assessed.

Several characteristics of the FC personality inventories which are relevant for personnel assessment have to be mentioned. First, they appear to correlate with general mental ability (GMA) when individuals respond as job applicants (Vasilopoulos, Cucina, Dyomina, Morewitz, & Reilly, 2006), so they can be more cognitively loaded than the typical SS personality formats (e.g., Likert, Yes, No). Therefore, the validity of the FC personality measures might be moderated by job complexity, as this variable also moderates the validity of GMA. Second, the FC-based measures may produce gender differences in some cases and, consequently, equal opportunities may also be negatively affected (Anderson & Sleap, 2004). Third, FC personality inventories showed stronger resistance to faking than SS personality inventories, although they are not totally unaffected by faking (Jackson et al., 2000; Nguyen & McDaniel, 2000). Fourth, recent advances in IRT methodology have produced methods for recovering normative scores from ipsative scores (Brown & Maydeu-Olivares, 2011; Chernyssenko, Stark, Drasgow, & Roberts, 2007; Heggestad, Morrison, Reeve, & McCloy, 2006; Maydeu-Olivares & Brown, 2010; McCloy, Heggestad, & Reeve, 2005; Stark, Chernyshenko, & Drasgow, 2005; Stark, Chernyshenko, Drasgow, & Williams, 2006). Fifth, they are currently used in around 30% of organizations, according to a survey conducted by Tett et al. (2011).

Job Complexity

Hunter and Hunter (1984) defined job complexity as the cognitive difficulty of the requirements and demands of the occupation. This definition can be extended to include not only the number of complex tasks that should be solved, but also the degree to which these tasks are not repetitive, to what extent the goals are hard to define, the number of opportunities that exist for making personal decisions, and the degree to which the procedures of problem solving are not standardized. According to Hunter and Hunter, job complexity is to a great extent captured in the “data” dimension of Fine's (1955) Functional Analysis, which has defined three extensive occupational families. Other two smaller occupational families were defined by Fine's “things” dimension. Based on this scheme, Hunter and Hunter classified occupations in five big occupational families using the Dictionary of Occupational Titles (DOT; U.S. Department of Labor, 1977/1991). These occupational families were: design (I), feed (II), synthesize (III), coordinate, analyze/compile/calculate (IV), and compare/copy (V). According to their degree of complexity, the most complex would be family I; families III and IV would be of an intermediate level of complexity, and II and V would be of low complexity. The percentage of job positions that would exist in each complexity family would be 2.5, 2.4, 14.7, 62.7, and 17.7 percent for families I, II, III, IV, and V, respectively. This means that approximately 17.2% of the occupations would be of high complexity, 62.7% would be of intermediate complexity, and 20.1% would be of low complexity. Later, Hunter and Hunter's classification was reduced to three levels of complexity by Hunter, Schmidt, and their colleagues (Hunter, Schmidt, & Judiesch, 1990; Schmidt, Shaffer, & Oh, 2008)

Job complexity is a construct that has been shown to be relevant as a moderator of the relationships between a series of individual differences variables (e.g., intelligence and personality) and also organizational variables (e.g., job performance and job satisfaction). For example, Hunter and Hunter (1984) demonstrated that job complexity moderated the validity of GMA, so higher complexity was associated with larger validity coefficients of GMA for predicting both job performance and training proficiency. This finding was later replicated by other researchers (e.g., Hartigan & Wigdor, 1989; Salgado et al., 2003; Schmidt et al., 2008). Ganzach (1998) found that job complexity moderates the relationship between intelligence and job satisfaction. Wilk and Sackett (1996) demonstrated that there is a positive relationship between job complexity and cognitive ability for people in the process of labor mobility. Judge, Bono, and Locke (2000) found that job complexity moderates the relationship between personality and job satisfaction. The moderator effects of job complexity have also been examined for the criterion validity of situational interviews (SI) and behavior-description interviews (BDI) by Huffcut, Conway, Roth, and Klehe (2004), who found moderator effects of job complexity for SIs but not effects for BDIs. However, no meta-analysis has been published to examine whether job complexity moderates the validity of personality measures in general and of those FC inventories in particular.

Job Complexity-Personality Relationships: Reasons to Expect Moderator Effects

There are theoretical and empirical reasons to expect a moderator effect of job complexity on the validity of FC personality inventories. First, if the wide definition of job complexity mentioned above is used, i.e., the one that includes not only cognitive factors but also situational and personal ones, it could be argued that some personality factors could be related to job complexity and, therefore, job complexity could moderate the validity of these personality factors for predicting job performance. For example, Judge et al. (2000) have demonstrated that there is a moderator effect of job complexity on the relationship between personality and job satisfaction, which suggests that such moderator effects could be present in other relationships in which personality could be a determinant, such as for example job performance. In addition, some researchers have suggested that conscientiousness might not predict performance well for all occupations and situations. For example, it could be contraindicated in those occupations in which innovation, creativity, or leadership are important (Costa, Páez, Sánchez, Garaigordobil, & Gondim, 2015; Hülsheger, Anderson, & Salgado, 2009; Hough, 1997, 1998; Robertson, Baron, Gibbons, MacIver, & Nyfield, 2000; Robertson & Callinan, 1998). Given that creativity, innovation, and leadership are elements which would contribute to or reflect the complexity of a job, then job complexity would produce a negative effect on the validity of the conscientiousness dimension for predicting job performance. The implications of job complexity for emotional stability seems obvious if we take into account that the most cognitively complex jobs also tend to be characterized by their occupants having more control over and ability to decide on their behaviors and the consequences of their actions. This is the case, for example, for managers and professionals (e.g., physicians, attorneys). However, less complex jobs are more often subjected to unpredictable situations and external control. When control is associated with experiencing or not experiencing stress or having or not having emotional adjustments at work, the potential relationship between emotional stability and job complexity also seems clear. For example, the literature on “learned helplessness” is illustrative of this case (Abramson, Seligman, & Teasdale, 1978; Seligman, 1975). People who define situations as unpredictable and that believe that they do not control the outcomes show poorer performance, less motivation, and more negative emotional reactions. Finally, given that openness to experience shows some correlation with GMA (Judge, Jackson, Shaw, Scott, & Rich, 2007; McCrae, 1996) and that the cognitive difficulty of the tasks is an important element for defining job complexity, one would expect that job complexity moderates positively the relationship between openness and job performance, in contrast to what occurs with the dimensions of conscientiousness and emotional stability. With regard to extroversion and agreeableness, it does not seem that job complexity moderates its validity or it is at least conceptually difficult to speculate over possible relations.

Finally, as some authors (e.g., Vasilopoulos et al., 2006) have suggested that FC personality inventories can be more cognitively loaded than SS inventories, and due to the fact that job complexity moderates the relationships between GMA and job performance, some effects of job complexity on the validity of FC inventories can be expected because of their cognitive variance.

Taking all these reasons into account, the following two hypotheses can be posited:H1

Job complexity negatively moderates the validity of conscientiousness and emotional stability, so that their validity will be lower for occupations with higher complexity levels.

H2

Job complexity positively moderates the validity of the openness to experience dimension, so that the validity will be greater for the occupations with higher complexity level.

MethodLiterature Revision

Exhaustive manual and computer-assisted searches were carried out to identify validity studies in which FC personality inventories were used and in which job performance was the criterion. The examined period covers from January 1960 to December 2015. The search was done using three strategies. First, the name of the most popular FC personality inventories (e.g., MBTI, OPQ, GPPI, EPPS) was used as a keyword in the computer searches. Second, I examined a number of proprietary electronic databases of well-known journal publishers, including Academy of Management, Ammons, Sage, Wiley, Springer, ProQuest, and Elsevier. In these searches, the terms ipsative, normative, partially-ipsative, quasi-ipsative, forced-choice, job performance, as well as the acronyms of the most popular personality inventories were used. Third, exhaustive searches were also done in Google and Scholar Google in order to identify unpublished papers. Fourth, manual searches were done in a dozen of the most important journals in which validity studies are frequently published (e.g., Journal of Applied Psychology, Journal of Occupational Psychology, Personnel Psychology, etc.). Fifth, I examined the list of references of the most highly cited meta-analyses (e.g., Bartram, 2007; Judge et al., 2013; Salgado, 1997, 2003; Salgado, Anderson et al., 2015; Salgado & Tauriz, 2014; Tett, Rothstein, & Jackson, 1991) to identify articles and unpublished papers not identified in the previous searches. Sixth, I wrote to several researchers who have conducted research on FC personality inventories and asked for published and unpublished studies. Finally, I reviewed the technical manual of the most popular FC personality inventories (e.g., D5D, EPPS, GPPI, and OPQ, among others). Once a preliminary data base of the articles, unpublished papers, technical reports, manuals, doctoral dissertations, and papers presented at conferences was created, I separated the studies that reported the relationship between personality measures and job performance and excluded the studies that used other alternative criteria (e.g., academic performance, training success, salaries, and counterproductive behavior at work). In other words, I did not include studies that used grades, instructor ratings, salaries, and reports of counterproductive behaviors as criteria. Next, I classified the scales of the inventories into the Five-Factor Model using the classification scheme of Salgado and Tauriz (2014).

If available, I recorded the following information for each study: (1) sample size, (2) occupational title, (3) type of FC measure (i.e., ipsative, quasi-ipsative, and normative), (4) personality measures, (5) criterion type, (6) predictor reliability, (7) criterion reliability, (8) range restriction in the predictor, (9) correlation between predictor and criterion, and (10) correlations among the predictors if more than one was used. In the case of studies with conceptual replications (e.g., two or more scales or inventories were used to assess the same personality factor), I used Mosier's formula to form a linear composite (Schmidt & Hunter, 2015).

Job Complexity Coding

Once the characteristics of the studies were recorded, the next step was to classify the occupations according to their respective level of job complexity. After an inspection of the jobs included in the data base, I decided to create three levels of complexity only, in accordance with the analytic strategy used by Hunter et al. (1990), Salgado et al. (2003), and Schmidt et al. (2008). The highest level of complexity consists of occupations coded 0 and 1 in the “data” dimension of the DOT and the occupations coded 0 in the “things” dimension. The medium complexity level includes the occupations coded 2, 3 and 4 in the “data” dimensions of the DOT. The lowest level of job complexity included the occupations coded 5 and 6 in the “data” dimension and the occupations coded 6 in the “things” dimension. With this classification system, the jobs included in the occupational categories of engineers, counselors, managers, lawyers, pilots, military commanders, and professionals were included in the category of high complexity. The jobs of supervisors, police, sales, customer-service representatives, clerical, mechanics, officers, and qualified personnel were included in the category of medium complexity. Finally, jobs included in the occupational categories of unskilled workers, maintenance personnel, clerical assistants, and soldiers were classified in the category of low complexity level. The classification resulted in 56 coefficients for conscientiousness, 47 for emotional stability, 47 for extroversion, 42 for agreeableness, and 40 for openness. The studies included in each complexity level-FC format combination appear in the Appendix.

Meta-analysis Method and Artifact Distributions

After the studies were classified, the following step was to apply the psychometric meta-analysis method of Schmidt and Hunter (2015), implemented in a software program by Schmidt and Le (2014), which uses the correction for indirect range restriction (IRR). Sampling error, predictor reliability, criterion reliability, and range restriction (RR) were considered as artifacts that affect the validity size as well as the variance of the validity coefficients. For the criterion reliability, I used a mean value of .52 (SD=.09) which was reported by Salgado, Moscoso, and Anderson (2016; see also Salgado & Moscoso, 1996), that is also the same value found by Viswesvaran, Ones, and Schmidt (1996; see also Salgado, 2015). In the case of the reliability of the measures of the Big Five factors of personality, I used the estimates reported by Salgado and Tauriz (2014) and Salgado, Anderson et al. (2015) for the FC personality inventories.

With regard to RR, I created a distribution for each complexity level. There were two reasons for proceeding in this way. First, previous research revealed that the degree of RR is not the same across the three levels of job complexity (Salgado et al., 2003; Schmidt et al., 2008). The second reason is that the three complexity levels contain occupational categories which practically do not overlap, thereby they may have different distributions of the RR values. Therefore, if only one distribution of RR was to be used for all the jobs, then they might result in an underestimation of validity for the highly complex jobs and an overestimation of the validity for the medium and low complexity jobs. The average and the standard deviation of the distributions appear in Table 1. As can be seen in this table, the RR values of low complexity jobs are a bit lower than the values found for medium and high complexity levels. It must be noted here that RR values were practically the same for the five personality factors in each complexity level. For all the above reasons, I grouped all the coefficients of the Big Five for the same complexity level.

Table 1.

Predictor and Criterion Reliability Distributions and Range Restriction Distribution for the Three Levels of Job Complexity.

Dimension  Mean  SD 
Reliability
Emotional Stabilitya  .85  .10 
Extraversiona  .85  .09 
Opennessa  .82  .12 
Agreeablenessa  .82  .13 
Conscientiousnessa  .83  .15 
Job Performance Ratingb  .52  .09 
Range Restriction
High Complexity  .93  .10 
Medium Complexity  .93  .03 
Low Complexity  .77  .16 

Note.

a

internal consistency coefficient

b

interrater coefficient.

Results

The results of the meta-analysis of the relationships between the five personality dimensions and job performance for the FC personality inventories appear in Table 2, classified according to the degree of complexity of the occupations. From left to right, the first two columns show the number of independent validities and the total sample size. The next four columns show the observed validity, the observed standard deviation, the validity corrected for measurement error in predictor and criterion, and for IRR. The last four columns report the variance accounted for by the four statistical artifacts, the 90% credibility value, and the 95% confidence interval of ρ.

Table 2.

Meta-analysis of the Validity of Normative FC Measures of the FFM for Managerial Occupations.

Personality Dimension  N  rw  SDr  ρ  SDρ  %VE  90%CV  CIU  CIL 
High Complexity – Normative Forced Choice
Extraversion  1994  -.053  .039  -.089  .000  100  -.089  -.153  -.025 
Openness to Experience  1994  .060  .015  .101  .000  100  .101  .125  .076 
Agreeableness  1994  .055  .012  .092  .000  100  .092  .112  .072 
Conscientiousness  2297  .072  .067  .121  .076  51  .023  .218  .023 
High Complexity – Ipsative Forced Choice
Emotional Stability  20  4505  .008  .069  .013  .029  93  -.025  .063  -.037 
Extraversion  19  4437  .061  .078  .103  .068  73  .016  .162  .044 
Openness  19  4437  .049  .072  .082  .046  85  .023  .137  .028 
Agreeableness  19  4437  -.017  .082  -.028  .082  64  -.133  -.090  .034 
Conscientiousness  19  4437  .055  .083  .091  .081  65  -.013  .153  .028 
Medium Complexity – Ipsative Forced Choice
Emotional Stability  1459  .053  .070  .086  .015  98  .068  .171  .001 
Extraversion  1459  .078  .058  .132  .000  100  .132  .205  .060 
Openness  1027  .130  .095  .222  .094  65  .101  .352  .093 
Agreeableness  1058  .060  .088  .101  .089  62  -.013  .230  -.027 
Conscientiousness  1666  .115  .090  .190  .092  60  .072  .294  .087 
High Complexity – Quasi-Ipsative Forced Choice
Emotional Stability  1237  .028  .181  .046  .255  23  -.280  .237  -.145 
Extraversion  1066  .143  .067  .240  .000  100  .240  .339  .142 
Openness  1066  .205  .054  .341  .000  100  .341  .420  .262 
Agreeableness  1066  .068  .102  .114  .124  46  -.036  .263  -.036 
Conscientiousness  1113  .130  .100  .216  .108  56  .077  .348  .083 
Medium Complexity – Quasi-Ipsative Forced Choice
Emotional Stability  560  .124  .125  .203  .113  68  .058  .366  .040 
Extraversion  848  .145  .187  .239  .258  27  -.091  .451  .026 
Openness  625  -.066  .258  -.107  .381  25  .381  -.441  .227 
Agreeableness  674  .169  .141  .280  .159  52  .077  .453  .107 
Conscientiousness  11  1250  .220  .097  .363  .043  92  .307  .457  .268 
Low Complexity – Quasi-Ipsative Forced Choice
Emotional Stability  1540  .071  .071  .143  .078  69  .044  .269  .018 
Extraversion  1280  .144  .087  .293  .111  56  .151  .466  .121 
Agreeableness  1012  .002  .010  .004  .000  100  .004  .033  -.024 
Conscientiousness  1662  .223  .135  .429  .195  33  .181  .622  .236 

Note. K=number of independent samples; N=total sample size; rw=observed validity; SDr=standard deviation of observed validity; ρ = validity corrected for measurement error in X and Y and indirect range restriction in predictor; SDρ = standard deviation of ρ; %VE = percentage of variance accounted for by artifactual errors; 90%CV = 90% credibility value based on ρ; CIU = upper limit of the 95% confidence interval of ρ; CIL = lower limit of the 95% confidence interval of ρ.

In the case of the normative FC personality inventories, I found validity coefficients for the high complexity level only. Therefore, it was not possible to estimate the potential moderator effects of job complexity for this FC format. With very small differences, the results for the normative FC were practically the same ones reported by Salgado, Moscoso et al. (2015). The corrected validity is very small for the four personality factors included in the Table 2, although validity generalizes in the four cases, as the 90% credibility value is greater than 0.

With regard to the validity of the ipsative FC personality inventories, I found studies to compare the effects of job complexity for the occupations of high and medium complexity levels. The results indicate that validity is smaller for all the personality factors in the high complexity occupations than in the medium complexity ones. In other words, job complexity moderates validity negatively, so the larger the job complexity the lower the validity. In regard to the validity size, it is very small for the five personality factors in the case of high complexity occupations, with validity values ranging from -.028 for agreeableness to .091 for conscientiousness. There is evidence of validity generalization for extraversion and openness only. The validity size of the Big Five for the ipsative FC personality inventories in the case of medium complexity occupations is small, too, ranging from .086 for emotional stability to .222 for openness to experience. There is evidence of validity generalization for extraversion, openness, and conscientiousness, as the 90% credibility is greater than 0 in the three cases. These results partially supported Hypotheses 1 and 2.

In respect to the quasi-ipsative FC personality inventories, the meta-analytic findings show that job complexity moderates the validity, although the pattern of the results vary across the five personality factors. For emotional stability, the results show that the largest validity corresponds to the occupations of the medium complexity level, followed by the lower level, and with the smallest validity for the higher complexity level. Therefore, these findings partially supported Hypothesis 1. For the three levels of job complexity, the validity size is small, ranging from .046 (high complexity) to .203 (medium complexity). In the case of extraversion, the validity is practically the same for the occupations of high and medium complexity levels (ρ=.24), and is larger for the low complexity level (ρ=.29). Therefore, the relationship between job complexity and the validity for extraversion is negative, as the validity increases when job complexity decreases. In the case of openness, I found validity studies for occupations of high and medium levels of job complexity. For this last personality factor, the validity was larger for the occupation of the high complexity level than for the medium level. Furthermore, it must be noted that the validity is considerable for the high complexity level (ρ=.34) and small and negative for the medium complexity level (ρ=-.107). Consequently, these findings totally support Hypothesis 2. The results for agreeableness show, to a certain extent, a pattern similar to the one found for emotional stability. The validity was noticeably larger for the medium level of complexity than for the other two complexity levels, but for agreeableness the second largest value was for the higher level of complexity and the validity was 0 for the lower level.

Finally, the results for conscientiousness are the most interesting for three reasons. First, they confirm that conscientiousness is consistently a valid predictor of job performance. Second, the pattern of the results showed that job complexity is an important moderator of the criterion validity of conscientiousness. The validity size ranged from .22 for the high complexity level to .43 for the lower level of complexity. The validity for the medium level was in the middle of these two. Therefore, job complexity moderated the validity of conscientiousness negatively. In other words, the findings revealed that conscientiousness is a much better predictor of job performance for the low level of job complexity than for the medium and high levels. In fact, the validity size for the low complexity level is greater than the validity of many of the most commonly used procedures in personnel selection (Schmidt & Hunter, 1998). Moreover, these findings support Hypothesis 1.

As a whole, the findings of this meta-analytic effort showed that job complexity is a relevant moderator of the validity of the five personality factors assessed with FC inventories when they are used for predicting job performance. The results supported Hypotheses 1 and 2, particularly in the case of the quasi-ipsative FC inventories. In second place, the findings showed also that there is not a single pattern of moderator effects, as can be seen in Figures 1 and 2. Finally, as conscientiousness occupies a special place among the personality factors due to the fact that it has been found to be the only factor that consistently predicted job performance, a specific comment about conscientiousness is in order. For both ipsative and quasi-ipsative FC personality inventories, the effects of job complexity run negatively with respect to the validity size. As job complexity increases, the validity of conscientiousness decreases.

Figure 1.

Relations between Validity and Job Complexity for the FFM as Assessed with Ipsative Forced-Choice Inventories. HC: high complexity; MC: medium complexity; Es: emotional stability; Ex: extraversion; O: openness; A: agreeableness; C: conscientiousness.

(0.07MB).
Figure 2.

Relations between Validity and Job Complexity for the FFM as Assessed with Quasi-ipsative Forced-Choice Inventories. HC: high complexity; MC: medium complexity; LC: low complexity; Es: emotional stability; Ex: extraversion; O: openness; A: agreeableness; C: conscientiousness.

(0.08MB).
Discussion

This study was designed to test two hypotheses, according to which job complexity would have negative effects on the validity of conscientiousness and emotional stability (Hypothesis 1), and positive effects on the validity of openness to experience (Hypothesis 2). The results have supported Hypothesis 1, as the criterion validity of emotional stability and conscientiousness was larger for occupations of the lower levels of job complexity than for the occupations of high job complexity. The findings also supported Hypothesis 2 for both ipsative and quasi-ipsative FC personality inventories, as openness to experience was shown to be a better predictor of job performance for the occupations of high complexity level.

More specifically, in the case of conscientiousness, job complexity moderates largely and negatively the criterion validity, so that the size of the validity is smaller for the occupations of high and medium complexity in comparison with low complexity. Furthermore, the hypotheses were supported for both ipsative and quasi-ipsative FC inventories. These findings support those authors who have suggested that conscientiousness might not be such a good predictor of performance in those jobs where more flexibility, initiative, creativity and, clearly, more cognitive complexity are required (Da Costa et al., 2015; Hülsheger et al., 2009; Hough, 1997; Robertson & Callinan, 1998; Robertson et al., 2000). For both emotional stability and conscientiousness, the relationship between job complexity level and criterion validity is described by a negative linear shape.

With regard to openness to experience, the results indicated that this personality factor is a valid predictor for high complexity jobs, but that it is not a predictor for occupations of medium and low complexity level. Therefore, the relationship is described by a positive linear shape. This finding totally agreed with Hypothesis 2. Consequently, this supports the assumption that, due to the relationship between openness and GMA, the highest value for openness validity should be for high complexity level occupations.

In the case of extraversion, job complexity has no effect on its criterion validity, as for both the ipsative and the quasi-ipsative FC inventories the validity size is practically the same across the job complexity levels. The smaller differences are probably due to sampling error.

The results for agreeableness are particularly interesting and unexpected (as they were not hypothesized). Many previous meta-analyses of the FFM found that agreeableness showed very low validity or it was not a predictor at all (Barrick et al., 2001; Judge et al., 2013; Salgado & Tauriz, 2014). However, this meta-analysis shows that agreeableness can be a valid and relevant predictor of job performance for the occupations of medium complexity level, if this factor is assessed with a quasi-ipsative FC inventory. For agreeableness, the effects of job complexity on the validity take the shape of an inverted U.

In summary, the findings suggest two relevant conclusions. First, job complexity is a robust moderator of the validity of the FFM for predicting job performance of the ipsative and quasi-ipsative FC personality inventories, with the exception of extraversion. Second, the pattern (shape) of the job complexity effect is not the same for all the personality factors. Job complexity can have positive, negative, and inverted U consequences for the validity size of emotional stability conscientiousness, openness, and agreeableness, respectively. Future meta-analytic studies should be done to confirm or to refute these patterns of relationships. A third conclusion is that the average validity of the FFM reported in previous meta-analyses should be considered in the light of the present findings, as there are important differences in the validity size for the three levels of job complexity. The overall average validity used unreservedly can hide the relevant effect of job complexity for at least four of the five big personality factors.

The findings of this meta-analysis have implications for the research and practice of personnel selection and personnel decisions. The first implication for research is for the previous meta-analyses of the criterion validity of the FFM. The proportions of studies corresponding to the high, medium, and lower levels of job complexity should be examined and compared as variations in these proportions can explain the differences in the validities obtained. This fact, together with the effects of IRR (Hunter, Schmidt, & Le, 2006) and the imperfect measurement of the constructs (Salgado, 2003) can produce considerably differences in the size of the validity. From an applied point of view, when making personnel decisions practitioners should take into account the degree of job complexity to evaluate in what way and to what extent personality factors predict job performance. This implication is especially relevant with regard to agreeableness, as the results of this meta-analysis provide clues for a better understanding of how this factor works in the labor domain. Previous meta-analyses of the validity of the FFM assessed with both SS and FC personality inventories have concluded that agreeableness was a predictor that did not generalize validity across occupations in order to predict job performance (e.g., Barrick et al., 2001; Hurtz & Donovan, 2000; Salgado, 1997, 2003; Salgado & Tauriz, 2014). However, the results of the validity of agreeableness for the three levels of complexity indicate that this factor can be a valid predictor of performance in those jobs characterized by a medium level of job complexity.

There are several limitations that should be noted. The first limitation is that the number of studies has not permitted us to examine the moderator effect of job complexity for normative FC inventories. Therefore, primary studies are needed for this format. Studies are also needed for the occupations of low complexity level in the case of ipsative FC personalities. A second limitation is that the number of estimates of range restriction did not allow for the development of a specific distribution for each combination of FC format-job complexity level-personality factor. A third limitation is that a relevant number of the studies included in this meta-analysis were conducted over four decades, and it is impossible to know if the validity remained stable despite potential changes in the nature of the occupations and the measures of job performance in the last two decades. All the limitations mentioned suggest that new validity studies should be conducted, in particular taking into account that quasi-ipsative FC inventories were shown to be more valid predictors than SS personality inventories (see Barrick et al., 2001; Judge et al., 2013; Salgado, Moscoso et al., 2015), in spite of the fact that the latter are used more frequently for personnel decisions than the former.

Considering the results obtained as a whole, the final conclusion to be inferred is that job complexity is a strong moderator of the validity of personality measures. Job complexity moderates the size of validity coefficients and makes some of them (e.g. openness, agreeableness) valid predictors, when it was believed that they were not, and others were shown to have larger validity than the one obtained in previous meta-analyses, provided the analysis is based on the medium and low complexity levels (conscientiousness and emotional stability).

Conflict of Interest

The author of this article declares no conflict of interest.

Financial Support

The research reported in this manuscript was supported by Grant PSI2014-56615-P from the Spanish Ministry of Economy and Competitiveness and Grant 2016 GPC GI-1458 from the Consellería de Cultura, Educación e Orden, Xunta de Galicia.

Appendix

Validity Coefficients and Sample Size of the Studies Included in the Meta-analysis.

Study  Sample  ES  EX 
High Complexity – Ipsative Forced Choice
Bartram (2007)  366  .17  .21  .11  .13  .22 
  68  .02  -.07  .02  -.09  .04 
  86  -.04  .05  .09  .18  -.05 
McDaniel, Yost, Ludwick, Hense, and Hartman (2004)  384  -.06  .16  .09  -.04  .03 
Nelson (2008)  114  -.11  -.02  .07  -.21  .00 
Nyfield, Gibbons, Baron, and Robertson (1995)  503  .04  -.02  -.02  -.05  .04 
  103  -.01  .15  -.15  -.06  -.03 
Perkins and Corr (2005)  68  .00         
Robertson, Gibbons, Baron, MacIver, and Nyfield (1999)  114  -.03  -.02  -.05  .14  .03 
  68  .24  .01  .10  -.20  .20 
  90  -.09  .12  -.09  .15  -.12 
  131  -.02  -.03  -.16  .10  .25 
  34  .03  -.15  -.02  -.30  .03 
Salgado (1991)  189  .03  -.08  -.04  -.08  .09 
Saville, Sik, Nyfield, Hackston, and MacIver (1996)  440  -.03  .03  .07  .00  -.02 
  270  .03  .12  .12  -.02  .08 
Schippmann and Prien (1989)  148  -.02  .05  .09  -.05  -.09 
SHL (2006)  120  .03  .06  .14  -.05  .01 
Slocum and Hand (1971)  57  .17  .07  .05  .02  -.07 
Whetzel, McDaniel, Yost, and Kim (2010)  1152  -.02  .07  .08  -.04  .08 
Medium Complexity – Ipsative Forced Choice
Clevenger, Pereira, Wiechman, Schmitt, and Schmidt-Harvey (2001)  207          .16 
Francis-Smythe, Tinline, and Allender (2002)  225  .08  .08  .28    .16 
Furnham (1994)  176  .12  .10  .17    .23 
Rust (1999)  432  -.01  .09    .08  .02 
Salgado (1991)  118  -.05  .02  .02  -.12  -.02 
SHL (2006)  79  .06  -.13  .11  -.03  .24 
Witt and Jones (1999)  168  .01  .07  .01  .01  .03 
Young and Dulewicz (2007)  261  .16  .14  .11  .17  .20 
High Complexity – Normative Forced Choice
Conway (2000)  1567    .06  -.06  .06  .06 
Fineman (1975)  293          .21 
Furnhan and Stringfield (1993)  222    -.10  .09  .05  .01 
  148    .05  .02  .02  .12 
Slocum and Hand (1971)  57  .17  .07  .05  .02  -.17 
High Complexity – Quasi-ipsative Forced Choice
Antler, Zaretsky, and Ritter (1967)  30  .58         
Bennett (1977)  45  .40         
  49  .46         
Gordon (1993)  47  -.37        .26 
  200  .06  .22  .24  .06  .08 
  97  .06  .22  .26  -.09  .12 
  90  .19  -.04  .06  .20  .33 
  531  -.09  .13  .19  .13  .15 
Schippmann and Prien (1989)  148  .06  .15  .27  -.12  .14 
Medium Complexity – Quasi-ipsative Forced Choice
Gordon (1993)  78  -.09  .36  .24  .13  .30 
  158  .22  -.10  .04  .17  .22 
  146  .04  .18      .19 
  77  .30  .19      .19 
  72  .09  .21  .07  -.20  .23 
  29  .25  .51  .27  .41  .42 
Graham and Calendo (1969)  69          .02 
Hughes and Prien (1986)  49        .15  -.03 
Kriedt and Dawson (1961)  41    -.38  .31  .22  .37 
Neuman and Kickul (1998)  247    .23  -.37  .26  .17 
  284          .32 
Low Complexity – Quasi-ipsative Forced Choice
Christiansen et al. (2005)  60          .46 
  62          .17 
Gordon (1993)  99  .10  .18      .48 
  97  .33  -.02      .43 
Sommerfeld (1997)  332  .01        .32 
White (2002)  613  .06  .22    .01  .20 
  399  .07  .06    -.01  .04 

References11

References marked with an asterisk indicate studies included in the meta-analysis.

[Abramson et al., 1978]
L.Y. Abramson, M.E.P. Seligman, J. Teasdale.
Learned helplessness in humans: Critique and reformulation.
Journal of Abnormal Psychology, 20 (1978), pp. 217-252
[AlDosiry et al., 2016]
K.S. AlDosiry, O.H. Alkhadher, E.M. AlAqraa, N. Anderson.
Relationships between emotional intelligence and sales performance in Kuwait.
Revista de Psicología del Trabajo y de las Organizaciones, 32 (2016), pp. 39-45
[Alonso et al., 2015]
P. Alonso, S. Moscoso, D. Cuadrado.
Procedimientos de selección de personal en pequeñas y medianas empresas españolas.
Revista de Psicología del Trabajo y de las Organizaciones, 31 (2015), pp. 79-89
[Anderson and Sleap, 2004]
N. Anderson, S. Sleap.
An evaluation of gender differences on the Belbin Team Role Self-Perception Inventory.
Journal of Occupational and Organizational Psychology, 77 (2004), pp. 429-437
[Antler et al., 1967]
L. *Antler, H.H. Zaretsky, W. Ritter.
The practical validity of the Gordon Personal Profile among United States and foreign medical residents.
Journal of Social Psychology, 72 (1967), pp. 257-263
[Barrick and Mount, 1991]
M.R. Barrick, M.K. Mount.
The Big Five personality dimensions and job performance: A meta-analysis.
Personnel Psychology, 44 (1991), pp. 1-26
[Barrick et al., 2001]
M.R. Barrick, M.K. Mount, T. Judge.
Personality and performance at the beginning of the new millennium: What do we know and where do we go next?.
International Journal of Selection and Assessment, 9 (2001), pp. 9-30
[Bartram, 2007]
D. *Bartram.
Increasing validity with forced-choice criterion measurement formats.
International Journal of Selection and Assessment, 15 (2007), pp. 263-272
[Bennet, 1977]
M. *Bennet.
Testing management theories cross-culturally.
Journal of Applied Psychology, 62 (1977), pp. 578-581
[Brown and Maydeu-Olivares, 2011]
A. Brown, A. Maydeu-Olivares.
Item response modeling of forced-choice questionnaires.
Educational and Psychological Measurement, 71 (2011), pp. 452-460
[Cattell, 1944]
R.B. Cattell.
Psychological measurement: ipsative, normative and interactive.
Psychological Review, 51 (1944), pp. 292-303
[Chernyssenko et al., 2007]
O. Chernyssenko, S. Stark, F. Drasgow, B.W. Roberts.
Constructing personality scales under the assumption of an ideal point response process: towards increasing the flexibility of personality measures.
Psychological Assessment, 19 (2007), pp. 88-106
[Christiansen et al., 2005]
N.D. *Christiansen, G.N. Burns, G.E. Montgomery.
Reconsidering forced-choice item formats for applicant personality assessment.
Human Performance, 18 (2005), pp. 267-307
[Clarke and Robertson, 2005]
S. Clarke, I.T. Robertson.
A meta-analytic review of the Big Five personality factors and accidents involvement in occupational and non-occupational settings.
Journal of Occupational and Organizational Psychology, 78 (2005), pp. 355-436
[Clemans, 1966]
W.V. Clemans.
An analytical and empirical examination of some properties of ipsative measures.
Psychometric Monographs, 14 (1966),
[Clevenger et al., 2001]
J. Clevenger, G.M. Pereira, D. Wiechman, N. Schmitt, V. Schmidt-Harvey.
Incremental validity of situational judgment tests.
Journal of Applied Psychology, 86 (2001), pp. 410-417
[Conway, 2000]
J.M. *Conway.
Managerial performance development constructs and personality correlates.
Human Performance, 13 (2000), pp. 23-46
[Da Costa et al., 2015]
S. Da Costa, D. Páez, F. Sánchez, M. Garaigordobil, S. Gondim.
Personal factors of creativity: A second order meta-analysis.
Revista de Psicología del Trabajo y de las Organizaciones, 31 (2015), pp. 165-173
[Fine, 1955]
S.A. Fine.
A structure of worker functions.
Personnel and Guidance Journal, 87 (1955), pp. 309-316
[Fineman, 1975]
S. *Fineman.
The work preference questionnaire: a measure of managerial need for achievement.
Journal of Occupational Psychology, 48 (1975), pp. 11-32
[Francis-Smythe et al., 2002]
*Francis-Smythe, J., Tinline, G., & Allender, C. (2002). Identifying high potential police officers and role characteristics. Paper presentation at the Division of Occupational Psychology Conference, British Psychological Society. Bournemouth.
[Furnham, 1994]
A. *Furnham.
The Validity of the SHL Customer Service Questionnaire (CSQ).
International Journal of Selection and Assessment, 2 (1994), pp. 157-165
[Furnham and Stringfield, 1993]
A. *Furnham, P. Stringfield.
Personality and work performance: Myers-Briggs Type Indicator correlates of managerial performance in two cultures.
Personality and individual Differences, 14 (1993), pp. 145-153
[Gilar et al., 2015]
R. Gilar, J.M. De Haro, J.L. Castejón.
Individual differences in predicting occupational success: the effect of population heterogeneity.
Revista de Psicología del Trabajo y de las Organizaciones, 31 (2015), pp. 101-107
[Ganzach, 1998]
Y. Ganzach.
Intelligence and job satisfaction.
Academy of Management Journal, 41 (1998), pp. 526-539
[Gordon, 1993]
L.V. *Gordon.
Gordon Personal Profile-Inventory. Manual 1993 Revision.
Pearson-TalentLens, (1993),
[Graham and Calendo, 1969]
W.K. *Graham, J.T. Calendo.
Personality correlates of supervisory ratings.
Personnel Psychology, 22 (1969), pp. 483-487
[Grieve and Hayes, 2016]
R. Grieve, J. Hayes.
Employment testing online, offline, and over the phone: Implications for e-assessment.
Revista de Psicología del Trabajo y de las Organizaciones, 32 (2016), pp. 95-101
[Hartigan and Wigdor, 1989]
Fairness in employment testing. Validity generalization, minority issues, and the General Aptitude Test Battery,
[Heggestad et al., 2006]
E.D. Heggestad, M. Morrison, C.L. Reeve, R.A. McCloy.
Forced-choice assessments of personality for selection: Evaluating issues of normative assessment and faking resistance.
Journal of Applied Psychology, 91 (2006), pp. 9-24
[Hicks, 1970]
L.E. Hicks.
Some properties of ipsative, normative, and forced-choice normative measures.
Psychological Bulletin, 74 (1970), pp. 167-184
[Hough, 1997]
L.M. Hough.
The millennium for personality psychology: New horizons or good old daze.
Applied Psychology: An International Review, 47 (1997), pp. 233-261
[Hough, 1998]
L.M. Hough.
Effects of intentional distortion in personality measurement and evaluation of suggested palliatives.
Human Performance, 11 (1998), pp. 209-244
[Huffcutt et al., 2004]
A.I. Huffcutt, J.M. Conway, P.L. Roth, U.-C. Klehe.
The impact of job complexity and study design on situational and behavior description interview validity.
International Journal of Selection and Assessment, 12 (2004), pp. 262-273
[Hughes and Prien, 1986]
G.L. *Hughes, E.P. Prien.
An evaluation of alternate scoring methods for the mixed standard.
Personnel Psychology, 39 (1986), pp. 839-847
[Hülsheger et al., 2009]
Hülsheger, I. R., Anderson, N., & Salgado, J. F. (2009). Selecting for innovation: What's good for job performance doesn’t need to be good for innovative performance. Congress of the European Association of Work and Organizational Psychology. Santiago de Compostela, Spain.
[Hunter and Hunter, 1984]
J.E. Hunter, R.F. Hunter.
Validity and utility of alternative predictors of job performance.
Psychological Bulletin, 96 (1984), pp. 72-98
[Hunter et al., 1990]
J.E. Hunter, F.L. Schmidt, M.K. Judiesch.
Individual differences in output variables as function of job complexity.
Journal of Applied Psychology, 75 (1990), pp. 28-42
[Hunter et al., 2006]
J.E. Hunter, F.L. Schmidt, H. Le.
Implications of direct and indirect range restriction for meta-analysis methods and findings.
Journal of Applied Psychology, 91 (2006), pp. 594-612
[Hurtz and Donovan, 2000]
G.M. Hurtz, J.J. Donovan.
Personality and job performance: The big five revisited.
Journal of Applied Psychology, 85 (2000), pp. 869-879
[Kriedt and Dawson, 1961]
P.H. *Kriedt, R.I. Dawson.
Response set and the prediction of clerical job performance.
Journal of Applied Psychology, 45 (1961), pp. 175-178
[Jackson et al., 2000]
D.N. Jackson, V.R. Wroblewski, M.C. Ashton.
The Impact of Faking on Employment Tests: Does Forced Choice Offer a Solution?.
Human Performance, 13 (2000), pp. 371-388
[Judge et al., 2000]
T.A. Judge, J.E. Bono, E.A. Locke.
Personality and job satisfaction: The mediating role of job characteristics.
Journal of Applied Psychology, 85 (2000), pp. 237-249
[Judge et al., 2007]
T.A. Judge, C.L. Jackson, J.C. Shaw, B.A. Scott, B.L. Rich.
Self-efficacy and work-related performance: The integral roles of individual differences.
Journal of Applied Psychology, 92 (2007), pp. 107-127
[Judge et al., 2013]
T.A. Judge, J.B. Rodell, R.L. Klinger, L.S. Simon, E.R. Crawford.
Hierarchical representations of the Five-Factor Model of personality in predicting job performance: Integrating three organizing frameworks with two theoretical perspectives.
Journal of Applied Psychology, 98 (2013), pp. 875-925
[Maydeu-Olivares and Brown, 2010]
A. Maydeu-Olivares, A. Brown.
Item response modeling of paired comparison and ranking data.
Multivariate Behavioral Research, 45 (2010), pp. 935-974
[McCloy et al., 2005]
R. McCloy, E. Heggestad, C. Reeve.
A silk purse from the sow's ear, Retrieving normative information from multidimensional forced-choice items.
Organizational Research Methods, 8 (2005), pp. 222-248
[McCrae, 1996]
R.R. McCrae.
Openness to experience: Expanding the boundaries of Factor V.
European Journal of Personality, 8 (1996), pp. 251-272
[McDaniel et al., 2004]
M.A. *McDaniel, A.P. Yost, M.H. Ludwick, R.L. Hense, N.S. Hartman.
Incremental validity of a situational judgment test.
Paper presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, (2004),
[Mol et al., 2005]
S.T. Mol, M.P. Born, M.E. Willemsen, H.T. Van der Molen.
Predicting expatriate job performance for selection purposes: A quantitative review.
Journal of Cross-Cultural Psychology, 36 (2005), pp. 590-620
[Morgeson et al., 2007a]
F.P. Morgeson, M.A. Campion, R.L. Dipboye, J.R. Hollenbeck, K. Murphy, N. Schmitt.
Reconsidering the use of personality tests in personnel contexts.
Personnel Psychology, 60 (2007), pp. 683-729
[Morgeson et al., 2007b]
F.P. Morgeson, M.A. Campion, R.L. Dipboye, J.R. Hollenbeck, K. Murphy, N. Schmitt.
Are we getting fooled again? Coming to terms with limitations in the use of personality tests for personnel selection.
Personnel Psychology, 60 (2007), pp. 1029-1049
[Murphy and Dzieweczynski, 2005]
K.R. Murphy, J.L. Dzieweczynski.
Why don’t measures of broad dimensions of personality perform better as predictors of job performance?.
Human Performance, 18 (2005), pp. 343-358
[Nelson, 2008]
*Nelson, C. A. (2008). Job type as a moderator of the relationship between situational judgment and personality. (unpublished doctoral dissertation).
[Neuman and Kickul, 1998]
G.A. *Neuman, J.R. Kickul.
Organizational citizenship behaviors: achievement orientation and personality.
Journal of Business and Psychology, 13 (1998), pp. 263-279
[Ng et al., 2005]
T.W.H. Ng, L.T. Eby, K.L. Sorensen, D.C. Feldman.
predictors of objective and subjective career success: a meta-analysis.
Personnel Psychology, 58 (2005), pp. 367-408
[Nguyen and McDaniel, 2000]
Nguyen, N. T., & McDaniel, M. A. (2000). Faking and forced-choice scales in applicant screening: A meta-analysis. 15th Annual Meeting of the Society for Industrial & Organizational Psychology. New Orleans.
[Nyfield et al., 1995]
*Nyfield, G., Gibbons, P. J., Baron, H., & Robertson, I. T. (1995). The cross-cultural validity of management assessment methods. Paper presented at the 10th Annual SIOP Conference. Orlando, FL.
[Ones et al., 1993]
D.S. Ones, C. Viswesvaran, F.L. Schmidt.
Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance.
Journal of Applied Psychology, 78 (1993), pp. 679-703
[Perkins and Corr, 2005]
A.M. *Perkins, P.J. Corr.
Can worriers be winners?The association between worrying and job performance.
Personality and Individual Differences, 38 (2005), pp. 25-31
[Poropat, 2009]
A.E. Poropat.
A meta.analysis of the Five-Factor Model of personality and academic performance.
Psychological Bulletin, 135 (2009), pp. 322-338
[Raman et al., 2016]
P. Raman, M. Sambasiva, N. Kumar.
Counterproductive work behavior among frontline government employees: Role of personality, emotional intelligence, affectivity, emotional labor, and emotional exhaustion.
Revista de Psicología del Trabajo y de las Organizaciones, 32 (2016), pp. 25-37
[Robertson et al., 2000]
I.T. *Robertson, H. Baron, P. Gibbons, R. MacIver, G. Nyfield.
Conscientiousness and managerial performance.
Journal of Occupational and Organizational Psychology, 73 (2000), pp. 171-180
[Robertson and Callinan, 1998]
I.T. Robertson, M. Callinan.
Personality and work behaviour.
European Journal of Work and Organizational Psychology, 7 (1998), pp. 321-340
[Robertson et al., 1999]
I. *Robertson, P. Gibbons, H. Baron, R. MacIver, G. Nyfield.
Understanding management performance.
British Journal of Management, 10 (1999), pp. 5-12
[Rust, 1999]
J. *Rust.
The validity of the Giotto integrity test.
Personality and Individual Differences, 27 (1999), pp. 755-768
[Salgado, 1991]
*Salgado, J. F. (1991). Validity of the Preferences and Perception Inventory (PAPI) in a financial service company. (unpublished technical report). University of Santiago de Compostela. Department of Social Psychology.
[Salgado, 1997]
J.F. Salgado.
The five factor model of personality and job performance in the European Community.
Journal of Applied Psychology, 82 (1997), pp. 30-43
[Salgado, 1998]
J.F. Salgado.
The Big Five personality dimensions and job performance in army and civil occupations: A European perspective.
Human Performance, 11 (1998), pp. 271-288
[Salgado, 2002]
J.F. Salgado.
The Big Five personality dimensions and counterproductive behaviors.
International Journal of Selection and Assessment, 10 (2002), pp. 117-125
[Salgado, 2003]
J.F. Salgado.
Predicting job performance using FFM and non-FFM personality measures.
Journal of Occupational and Organizational Psychology, 76 (2003), pp. 323-346
[Salgado, 2015]
J.F. Salgado.
Estimating Coefficients of equivalence and stability for job performance ratings: The importance of controlling for transient error on criterion measurement.
International Journal of Selection and Assessment, 23 (2015), pp. 37-44
[Salgado, 2016]
J.F. Salgado.
A Theoretical Model of Psychometric Effects of Faking on Assessment Procedures: Empirical findings and implications for personality at work.
International Journal of Selection and Assessment, 24 (2016), pp. 209-228
[Salgado et al., 2003]
J.F. Salgado, N. Anderson, S. Moscoso, C. Bertua, F. De Fruyt, J.P. Rolland.
A meta-analytic study of GMA validity for different occupations in the European Community.
Journal of Applied Psychology, 88 (2003), pp. 1068-1081
[Salgado et al., 2015a]
J.F. Salgado, N. Anderson, G. Tauriz.
The validity of ipsative and quasi-ipsative forced-choice personality inventories for different occupational groups: A comprehensive meta-analysis.
Journal of Occupational and Organizational Psychology, 88 (2015), pp. 797-834
[Salgado and Bastida, 2017]
J.F. Salgado, M. Bastida.
Predicting Expatriate Effectiveness: The role of personality, cross-cultural adjustment, and organizational support.
International Journal of Selection and Assessment, 25 (2017), pp. 267-275
[Salgado and Moscoso, 1996]
J.F. Salgado, S. Moscoso.
Meta-analysis of interrater reliability of job performance ratings in validity studies of personnel selection.
Perceptual and Motor skills, 83 (1996), pp. 1195-1201
[Salgado et al., 2016]
J.F. Salgado, S. Moscoso, N. Anderson.
Correction for criterion reliability in validity generalization: The consistency of Hermes, the utility of Midas.
Revista de Psicología del Trabajo y de las Organizaciones, 32 (2016), pp. 17-23
[Salgado et al., 2013]
J.F. Salgado, S. Moscoso, A. Berges.
Conscientiousness, Its Facets, and the Prediction of Job Performance Ratings: Evidence against the narrow measures.
International Journal of Selection and Assessment, 21 (2013), pp. 74-84
[Salgado et al., 2015b]
J.F. Salgado, S. Moscoso, J.I. Sanchez, P. Alonso, B. Choragwicka, A. Berges.
Validity of the five-factor model and their facets: The impact of performance measure and facet residualization on the bandwidth-fidelity dilemma.
European Journal of Work and Organizational Psychology, 24 (2015), pp. 325-349
[Salgado and Tauriz, 2014]
J.F. Salgado, G. Tauriz.
The Five-Factor Model, forced-choice personality inventories, and job performance: A comprehensive meta-analysis of academic and occupational studies.
European Journal of Work and Organizational Psychology, 23 (2014), pp. 3-30
[Saville et al., 1996]
P. *Saville, G. Sik, G. Nyfield, J. Hackston, R. Maclver.
A demonstration of the validity of the Occupational Personality Questionnaire (OPQ) in the measurement of job competencies across time and in separate organizations.
Applied Psychology, 45 (1996), pp. 243-262
[Schippmann and Prien, 1989]
J.S. *Schippmann, E.P. Prien.
An assessment of the contributions of general mental ability and personality characteristics to management success.
Journal of Business and Psychology, 3 (1989), pp. 423-437
[Schmidt and Hunter, 1998]
F.L. Schmidt, J.E. Hunter.
The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.
Psychological Bulletin, 124 (1998), pp. 262-274
[Schmidt and Hunter, 2015]
F.L. Schmidt, J.E. Hunter.
Methods of meta-analysis.
Third edition, Sage, (2015),
[Schmidt and Le, 2014]
Schmidt, F. L., & Le, H. (2014). Software for the Hunter-Schmidt meta-analysis methods. Department of Management and Organizations. University of Iowa. Iowa City, IA.
[Schmidt et al., 2008]
F.L. Schmidt, J.A. Shaffer, I.-S. Oh.
Increased accuracy for range restriction corrections: implications for the role of personality and general mental ability in job and training performance.
Personnel Psychology, 61 (2008), pp. 827-868
[Seligman, 1975]
M.E.P. Seligman.
Helplessness. On development, depression and death.
Freeman, (1975),
[SHL, 2006]
*SHL.
OPQ32 Manual and User's Guide. Surrey.
SHL, (2006),
[Slocum and Hand, 1971]
J.W. *Slocum Jr., H.H. Hand.
Prediction of job success and employee satisfaction for executives and foremen.
Training and Development Journal, 25 (1971), pp. 28-36
[Sommerfeld, 1997]
D. *Sommerfeld.
Maintenance worker selection: High validity and low adverse impact. Michigan Municipal League.
Employment Testing Consortium Project, (1997),
[Stark et al., 2005]
S. Stark, O.S. Chernyshenko, F. Drasgow.
An IRT approach to constructing and scoring pairwise preference items involving stimuli on different dimensions: The multi- unidimensional pairwise-preference model.
Applied Psychological Measurement, 29 (2005), pp. 184-203
[Stark et al., 2006]
S. Stark, O. Chernyshenko, F. Drasgow, B. Williams.
Examining assumptions about Item responding in personality assessment: Should ideal point methods be considered for scale development and scoring?.
Journal of Applied Psychology, 91 (2006), pp. 25-39
[Tett et al., 2011]
Tett, R. P., Christiansen, N. D., Robie, C., & Simonet, D. V. (2011). International survey of personality test use: An American baseline. Paper presented at the 15th Conference of the European Association of Work and Organizational Psychology. Maastricht, The Netherlands.
[Tett et al., 1991]
R. Tett, M.G. Rothstein, D.J. Jackson.
Personality measures as predictors of job performance: A meta-analytic review.
Personnel Psychology, 44 (1991), pp. 703-742
[U.S. Department of Labor, 1991]
U.S. Department of Labor. (1977/1991). Dictionary of Occupational Titles. Fourth Edition Revised. Indianapolis, IN: JIST Works. Reprinted.
[Vassilopoulos et al., 2006]
N.L. Vassilopoulos, J.M. Cucina, N.V. Dyomina, C.L. Morewitz, R.R. Reilly.
Forced-choice personality tests: A measure of personality and cognitive ability?.
Human Performance, 19 (2006), pp. 175-199
[Viswesvaran et al., 1996]
C. Viswesvaran, D.S. Ones, F.L. Schmidt.
Comparative analysis of the reliability of job performance ratings.
Journal of Applied Psychology, 81 (1996), pp. 557-560
[Whetzel et al., 2010]
D.L. *Whetzel, M.A. McDaniel, A.P. Yost, N. Kim.
Linearity of personality-performance relationships: a large-scale examination.
International Journal of Selection and Assessment, 18 (2010), pp. 310-320
[White, 2002]
L.A. *White.
A quasi-ipsative temperament measure for assessing future leaders.
44th Annual Conference of the International Military Testing Association, (2002),
[Wilk and Sackett, 1996]
S.L. Wilk, P.R. Sackett.
Longitudinal analysis of ability-job performance fit and job change.
Personnel Psychology, 49 (1996), pp. 937-967
[Witt and Jones, 1999]
*Witt, L. A., & Jones, J. W. (1999). Very particular people quit first. Paper presented at the Annual Conference of the Society for Industrial and organizational.
[Young and Dulewicz, 2007]
M. *Young, V. Dulewicz.
Relationship between emotional and congruent self-awareness and performance in the British Royal Navy.
Journal of Managerial Psychology, 22 (2007), pp. 465-478
[Zibarras and Woods, 2010]
L.D. Zibarras, S.A. Woods.
A survey of UK selection practices across different organization sizes and industry sectors.
Journal of Occupational and Organizational Psychology, 83 (2010), pp. 499-511

References marked with an asterisk indicate studies included in the meta-analysis.

Article options
Tools
es en pt
Política de cookies Cookies policy Política de cookies
Utilizamos cookies propias y de terceros para mejorar nuestros servicios y mostrarle publicidad relacionada con sus preferencias mediante el análisis de sus hábitos de navegación. Si continua navegando, consideramos que acepta su uso. Puede cambiar la configuración u obtener más información aquí. To improve our services and products, we use "cookies" (own or third parties authorized) to show advertising related to client preferences through the analyses of navigation customer behavior. Continuing navigation will be considered as acceptance of this use. You can change the settings or obtain more information by clicking here. Utilizamos cookies próprios e de terceiros para melhorar nossos serviços e mostrar publicidade relacionada às suas preferências, analisando seus hábitos de navegação. Se continuar a navegar, consideramos que aceita o seu uso. Você pode alterar a configuração ou obter mais informações aqui.