AJHP DataBase Section

Research Rating Methodology

Research must address one of these seven research questions as listed in Table 1

The measurement tools are described using standard measurement categories as listed in Table 2

Within the context of the research design, the internal validity of each study is also rated as listed in Table 3 

Research design is rated using a five-point system as listed in Table 4

The size of each experimental/control group(s) is included (e.g., ne1 = , ne2 =, nc =, etc.)

The total study duration in months and/or years is included. Cross-sectional studies are identified as such.

A brief summary of key methods and results is also included.

Table 1
Research Questions

1. 1. What behaviors, health signs, and health conditions are associated with positive underlying health conditions, productivity, health care costs, and other positive outcomes?
    
2. What behaviors, health signs, and health conditions are associated with negative underlying health conditions, productivity, health care costs, and other negative outcomes?
    
3. To what extent do changes in behaviors, health signs, and symptoms occur after health promotion programs are provided? Are the changes correlational or causal?
    
4. To what extent do people who change their behaviors, health signs, and symptoms as a result of being involved in health promotion programs also change their underlying health conditions, productivity, health care costs, and other positive outcomes?
    
5. How long lasting are the changes in behaviors, health signs, and symptoms that result from health promotion programs
    
6.  How long lasting are the changes in underlying health conditions, productivity, health care costs, and other positive outcomes that result from health promotion programs?
    
7. What are the characteristics of health promotion programs that produce the behaviors, health signs, and symptoms that produce positive outcomes?

Table 2
Measurement Tools – Standard Categories

• Financial analysis
• Biometric analysis
• Standardized self-report
• Nonstandardized self-report
• Retrospective analysis of data
• Other

Table 3
Rating Internal Validity

All studies given 2-star (**) through 5-star (*****) Research Ratings should also be assigned an Internal Validity rating, which is a rating of how well the study was conducted in terms of providing support for its hypotheses. Studies should be given an Internal Validity rating of Good, Fair, or Poor based on how well the study meets the criteria listed below for its Study Design category (i.e., Star Rating).

Good:    Study meets all criteria relevant for the study design.
Fair:       Study does not meet all criteria but has no fatal flaw that invalidates results.
Poor:     Study contains fatal flaws that invalidate results.

Table 4
Research Design Rating Categories