﻿

Multitrait-multimethod matrix

The multitrait-multimethod (MTMM) matrix is an approach to examining Construct Validity developed by Campbell and Fiske(1959)[1]. There are six major considerations when examining a construct's validity through the MTMM matrix, which are as follows:

1. Evaluation of convergent validity — Tests designed to measure the same construct should correlate highly amongst themselves.

2. Evaluation of discriminant (divergent) validity — The construct being measured by a test should not correlate highly with a different constructs.

3. Trait-method unit- Each task or test used in measuring a construct is considered a trait-method unit; in that the variance contained in the measure is part trait, and part method. Generally, researchers desire low method specific variance and high trait variance.

4. Multi-method/trait — More than one trait and more than one method must be used to establish (a) discriminant validity and (b) the relative contributions of the trait or method specific variance. This tenet is consistent with the ideas proposed in Platt's concept of Strong inference (1964).[2]

5. Truly different methodology — When using multiple methods, one must consider how different the actual measures are. For instance, delivering two self report measures are not truly different measures; whereas using an interview scale or a psychosomatic reading would be.

6. Trait characteristics — Traits should be different enough to be distinct, but similar enough to be worth examining in the MTMM.

Multitrait

Multiple traits are used in this approach to examine (a) similar or (b) dissimilar traits, as to establish convergent and discriminant validity amongst traits.

Multimethod

Similarly, multiple methods are used in this approach to examine the differential effects (or lack thereof) caused by method specific variance.

Example

The example below provides a prototypical matrix and what the correlations between measures mean. The diagonal line is typically filled in with a reliability coefficient of the measure (e.g. alpha coefficient).

Test Beck Depression Inv Beck Anxiety Inv Hepner Depression Interview Hepner Anxiety Interview
BDI (Reliability Coefficient)
BAI Mono Method, Hetero Trait (Reliability Coefficient)
HDIv Hetero Method, Mono Trait Hetero Method, Hetero Trait (Reliability Coefficient)
HAIv Hetero Method, Hetero Trait Hetero Method, Mono Trait Mono Method, Hetero Trait (Reliability Coefficient)

In this example the first row and the first column display the trait being assessed (i.e. anxiety or depression) as well as the method of assessing this trait (i.e. interview or survey as measured by fictitious measures). The term Hetero Method indicates that in this cell the correlation between two separate methods is being reported. Mono Method indicates the opposite, in that the same method is being used (e.g. interview, interview). Hetero Trait indicates that the cell is reporting two supposedly different traits. Mono Method indicates the opposite- that the same trait is being used.

In evaluating an actual matrix one wishes to examine the proportion of variance shared amongst traits and methods as to establish a sense of how much method specific variance is induced by the measurement method, as well as provide a look at how unique the trait is, as compared to another trait.

Analysis of the MTMM Matrix

A variety of statistical approaches have been used to analyze the data from the MTMM matrix. The standard method from Campbell and Fiske can be implemented using the MTMM.EXE program available at: http://gim.med.ucla.edu/FacultyPages/Hays/util.htm One can also use [confirmatory factor analysis]])[3] due to the complexities in considering all of the data in the matrix. The Sawilowsky I test,[4][5] however, considers all of the data in the matrix with a distribution-free statistical test for trend.

The test is conducted by reducing the heterotrait-heteromethod and heterotrait-monomethod triangles, and the validity and reliability diagonals, into a matrix of four levels. Each level consists of the minimum, median, and maximum value. The null hypothesis is these values are unordered, which is tested against the alternative hypothesis of an increasing ordered trend. The test statistic is found by counting the number of inversions (I). The critical value for alpha = 0.05 is 10, and for alpha = .01 is 14.

References

1. ^ Campbell, D.T., & FiskeD.W. (1959) Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105 "
2. ^ John R. Platt (1964). "Strong inference". Science 146 (3642).
3. ^ Figueredo, A., Ferketich, S., Knapp, T. (1991). Focus on psychometrics: More on MTMM: The Role of Confirmatory Factor Analysis. Nursing & Health, 14, 387-391
4. ^ Sawilowsky, S. (2002). A quick distribution-free test for trend that contributes evidence of construct validity. Measurement and Evaluation in Counseling and Development, 35, 78-88.
5. ^ Cuzzocrea, J., & Sawilowsky, S. (2009). Robustness to non-independence and power of the I test for trend in contruct validity. Journal of Modern Applied Statistical Methods, 8(1), 215-225.

Wikimedia Foundation. 2010.

Look at other dictionaries:

• Multitrait-Multimethod-Matrix — Der Begriff Multitrait Multimethod Matrix MTMM (engl. viele Eigenschaften und viele Methoden) ist ein Konzept der Psychologischen Diagnostik und der Theorie psychologischer Tests, das statistisch ausdrückt, in wie weit unterschiedliche Methoden… …   Deutsch Wikipedia

• Multitrait-multimethod matrix — Dieser Artikel oder Abschnitt bedarf einer Überarbeitung. Näheres ist auf der Diskussionsseite angegeben. Hilf mit, ihn zu verbessern, und entferne anschließend diese Markierung. Die Multitrait Multimethod Matrix (MTMM) ist das Hauptthema der… …   Deutsch Wikipedia

• Donald T. Campbell — Donald Thomas Campbell (November 20, 1916 May 5, 1996) was an American social scientist. He is noted for his work in methodology. He coined the term evolutionary epistemology and developed a selectionist theory of human creativity. Conte …   Wikipedia

• Valid — Mit Validität (von lat. validus: kräftig, wirksam; engl. „validity“, Gültigkeit) wird in erster Linie das argumentative Gewicht einer (vornehmlich wissenschaftlichen) Feststellung, Aussage, Untersuchung, Theorie oder Prämisse bezeichnet. Wird… …   Deutsch Wikipedia

• Valide — Mit Validität (von lat. validus: kräftig, wirksam; engl. „validity“, Gültigkeit) wird in erster Linie das argumentative Gewicht einer (vornehmlich wissenschaftlichen) Feststellung, Aussage, Untersuchung, Theorie oder Prämisse bezeichnet. Wird… …   Deutsch Wikipedia

• Construct validity — In science (e.g. social sciences and psychometrics), construct validity refers to whether a scale measures or correlates with the theorized psychological scientific construct (e.g., fluid intelligence ) that it purports to measure. In other words …   Wikipedia

• Donald T. Campbell — Donald Thomas Campbell (* 20. November 1916; † 5. Mai 1996) war ein US amerikanischer Psychologe. Campbell prägte den Begriff der evolutionären Erkenntnistheorie und entwickelte eine selektionsbasierte Theorie der Kreativität auf Basis der… …   Deutsch Wikipedia

• Effekte der sozialen Entkontextualisierung — Der Effekt der sozialen Entkontextualisierung bezeichnet einen Methodeneffekt in der empirischen Online Forschung (z. B. den Online Umfragen), der zu systematischen Verzerrungen führt. Die Qualität der online erhobenen Antworten kann dadurch… …   Deutsch Wikipedia

• Persönlichkeitsmerkmal — Eine Persönlichkeitseigenschaft (engl. trait), auch „Persönlichkeitsmerkmal“ genannt, ist eine relativ überdauernde (zeitstabile) Bereitschaft (Disposition, Variable), die bestimmte Aspekte des Verhaltens einer Person in einer bestimmten Klasse… …   Deutsch Wikipedia

• Diskriminanzvalidität — (engl. discriminant validity) bezeichnet in der multivariaten Statistik einen Teilaspekt der Konstruktvalidität und liegt vor, wenn sich die Messungen verschiedener Konstrukte unterscheiden. Inhaltsverzeichnis 1 Geschichte 2 Feststellung 3 Kritik …   Deutsch Wikipedia