Alignment Table for Plan Components

Describes the type or types of analyses that will be conducted (e.g., quantitative, qualitative, mixed methods) and procedures that will be used for examining results and ensuring their trustworthiness, such as:

• training that will be conducted to ensure reliable coding and scoring of data
• systematic checks of the data to remove errors
• procedures for reducing and summarizing the data

Describes in general terms what procedures will be taken to analyze numeric data:

• organizing the data
• verifying it
• summarizing it
• examining relationships among variables (e.g., Pearson Product Moment correlations, multiple regression, factor analyses)
• inferential statistical techniques that will be used to test for significant differences between comparison groups (e.g., t-tests, analyses of variance, analyses of covariance)

The proposed quantitative analysis procedures should be appropriate to the evaluation questions being addressed and the characteristics of the information being analyzed. The practical significance (e.g., effect sizes) and replicability, as well as statistical significance, should be considered when drawing inferences and formulating conclusions from quantitative analyses. Analyses of effects for identifiable subgroups should be planned, as appropriate, because a program may have differential effects for them.

Potential weaknesses in the quantitative data analysis, along with their possible influence on interpretations and conclusions, should be explained.

A8 Analysis of Quantitative Information
Quantitative information in an evaluation should be appropriately and systematically analyzed so that evaluation questions are effectively answered.

A7 Systematic Information
The information collected, processed, and reported in an evaluation should be systematically reviewed, and any errors found should be corrected.

Describes the qualitative analysis procedures that will be used to compile, analyze, and interpret the data in order to find themes, patterns, and trends.

The proposed qualitative analysis procedures should be appropriate to the evaluation questions being addressed and the characteristics of the information being analyzed. As the evaluation progresses, the accuracy of findings from qualitative data will need to be confirmed by gathering evidence from more than one source and by subjecting inferences to independent verification.

Potential weaknesses in the qualitative data analysis, along with their possible influence on interpretations and conclusions, should be described.

A9 Analysis of Qualitative Information
Qualitative information in an evaluation should be appropriately and systematically analyzed so that evaluation questions are effectively answered.

A7 Systematic Information
The information collected, processed, and reported in an evaluation should be systematically reviewed, and any errors found should be corrected.