Volume 39, Issue 2 p. 155-164

A Psychometric Toolbox for Testing Validity and Reliability

Holli A. DeVon

Holli A. DeVon

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Michelle E. Block

Michelle E. Block

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Patricia Moyle-Wright

Patricia Moyle-Wright

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Diane M. Ernst

Diane M. Ernst

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Susan J. Hayden

Susan J. Hayden

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Deborah J. Lazzara

Deborah J. Lazzara

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Suzanne M. Savoy

Suzanne M. Savoy

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
Elizabeth Kostas-Polston

Elizabeth Kostas-Polston

Holli A. DeVon, RN, PhD, Alpha Beta , Associate Professor, Niehoff School of Nursing, Loyola University Chicago, Chicago, IL; Michelle E. Block, RN, MS, Mu , Omega , Assistant Professor, Purdue University Calumet, Hammond, IN; Patricia Moyle-Wright, RN, MSN, Theta Phi , Instructor, College Misericordia, Dallas, PA; Diane M. Ernst, RN, MSN, Alpha Kappa , Assistant Professor, Regis University, Denver, CO; Susan J. Hayden, RN, MSN, Iota Theta , Instructor, Troy University, Troy, AL; Deborah J. Lazzara, RN, MS, CCRN, Alpha Lambda , Staff Nurse, University of Chicago Hospitals, Chicago, IL; Suzanne M. Savoy, RN, MN, APRN, Theta Chi , Assistant Professor, Saginaw Valley State University, Saginaw, MI; Elizabeth Kostas-Polston, MSN, APRN, WHNP-C, Theta Lambda , Assistant Professor, Southwest Baptist University, Bolivar, MO. Correspondence to Dr. DeVon, Loyola University Chicago, Niehoff School of Nursing, 2160 S. First Ave. Bldg. 105, Maywood, IL 60153. E-mail: [email protected]

Search for more papers by this author
First published: 23 May 2007
Citations: 1,121

Abstract

Purpose: To review the concepts of reliability and validity, provide examples of how the concepts have been used in nursing research, provide guidance for improving the psychometric soundness of instruments, and report suggestions from editors of nursing journals for incorporating psychometric data into manuscripts.

Methods: CINAHL, MEDLINE, and PsycINFO databases were searched using key words: validity, reliability, and psychometrics. Nursing research articles were eligible for inclusion if they were published in the last 5 years, quantitative methods were used, and statistical evidence of psychometric properties were reported. Reports of strong psychometric properties of instruments were identified as well as those with little supporting evidence of psychometric soundness.

Findings: Reports frequently indicated content validity but sometimes the studies had fewer than five experts for review. Criterion validity was rarely reported and errors in the measurement of the criterion were identified. Construct validity remains underreported. Most reports indicated internal consistency reliability (α) but few reports included reliability testing for stability. When retest reliability was asserted, time intervals and correlations were frequently not included.

Conclusions: Planning for psychometric testing through design and reducing nonrandom error in measurement will add to the reliability and validity of instruments and increase the strength of study findings. Underreporting of validity might occur because of small sample size, poor design, or lack of resources. Lack of information on psychometric properties and misapplication of psychometric testing is common in the literature.