Specification searches in multilevel structural equation modeling: A Monte Carlo investigation

2006 2006

Other formats: Order a copy

Abstract (summary)

Sample data obtained via cluster sampling rather than simple random sampling requires the use of specialized multilevel statistical analysis techniques, such as multilevel structural equation modeling, to model within-cluster and between-cluster variation appropriately. Properly modeling both within-cluster and between-cluster variation could be of substantive interest in numerous applied research settings. However, applied researchers typically test only a within-cluster (i.e., individual difference) theory; specifying a between-cluster model in the absence of theory involves a specification search.

Consistent with previous specification search studies, this dissertation manipulated the following independent variables: starting model, search method, and method of Type-I error control as independent variables. Further, consistent with previous multilevel research studies, this dissertation also manipulated the number of clusters, cluster sample size, and intraclass correlation magnitude as independent variables. The main dependent variable of interest was which combination of start model, search type, and method of Type-I error control best recovered the population between-cluster model. Additional dependent variables were also examined to assess the precision of specification search efforts.

Results showed that a "saturated" start model, univariate specification search, and no Type-I error control best recovered the population between-cluster model. However, this specification search method recovered the population model in less than one in five attempts at the largest sample size. A majority of the specification searches recovered the population model in less than five percent of all attempts, and the remaining specification search efforts failed to recover the population model under any conditions. Overall, specification search efforts were more likely to produce a notably misspecified model with biased parameter estimates, an under-identified model, or an inadmissible solution.

Model complexity, non-normally distributed data, and within-cluster model misspecification were not manipulated as independent variables in this dissertation. Further, the current results were based on a multilevel path model that may or may not generalize to other multilevel designs, such as confirmatory factor analyses and full structural equation models. Model complexity, non-normally distributed data, within-cluster model misspecification, and advanced analysis designs could be incorporated in future multilevel specification search studies by adapting the models used in previous non-multilevel specification search investigations.

Indexing (details)

Educational psychology
0463: Statistics
0525: Educational psychology
Identifier / keyword
Education; Pure sciences; Specification searches; Structural equation modeling
Specification searches in multilevel structural equation modeling: A Monte Carlo investigation
Peugh, James L.
Number of pages
Publication year
Degree date
School code
DAI-B 67/08, Dissertation Abstracts International
Place of publication
Ann Arbor
Country of publication
United States
Enders, Craig K.
The University of Nebraska - Lincoln
University location
United States -- Nebraska
Source type
Dissertations & Theses
Document type
Dissertation/thesis number
ProQuest document ID
Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works.
Document URL
Access the complete full text

You can get the full text of this document if it is part of your institution's ProQuest subscription.

Try one of the following:

  • Connect to ProQuest through your library network and search for the document from there.
  • Request the document from your library.
  • Go to the ProQuest login page and enter a ProQuest or My Research username / password.