Reliabilty, Validity, & Research

Reliability refers to the consistency of an assessment in its method of measurement. Cronbach’s alpha is a type of reliability that indicates the degree of internal consistency – the level of agreement among items of an assessment. Reliability is evaluated as a correlation coefficient (.00 to 1.00) where a higher value indicates a stronger consistency of measurement outcomes. The Care Profiler maintains strong reliability across scales and indices.

The Care Profiler:

• .86 Entire Questionnaire

• .79-.83 on Indices

• .76-.89 on Scales

Validity refers to the degree to which an assessment accurately measures what it is purported to measure. There are several types of validity that each describe a separate aspect.

Convergent validity is a type of construct validity – the extent to which an assessment accurately measures the construct it was created to measure. The level of concordance with measures of the same constructs is an indicator of convergent validity. As a personality-based assessment, the Care Profiler is highly correlated with other measures of personality constructs and work styles.

Significant correlations with:

• Accurate Self Presentation

• Accurate Self Assessment

• Measures of Stress Tolerance

• Big Five Personality Factors and Facets

Content validity is the degree to which an assessment is representative of the work domain. The greater the relativity, the more content validity an assessment holds. The content of each item on the Care Profiler is derived directly from comprehensive job analyses of caregivers.

Items written from Job Analyses of healthcare workers and applicants in the following healthcare sectors:

• Hospitals & Nursing Homes

• Assisted Living Facilities

• Residential Care Homes

• Home Care Agencies

• Norm group of over 3000 current employees & applicants

Criterion-related validity is perhaps the most important type of validity in terms of hiring decisions. It represents the relationship between a predictor and a performance-related criterion. As a predictor, the Care Profiler demonstrates strong correlations with job-related outcomes.

The Care Profiler:

• .28-.36 (p<.05) correlations with case load

• .29-.39 (p<.05) correlations with display of empathy/bedside manners

• .18-.37 (p<.05) correlations with overall job performance

• .38-.42 (p<.05) correlations with employee tenure

• .28-.37 (p<.05) correlations with time to train