Project Duration: 2011-2015
Evaluates MIECHV expansion and enhancement of Evidence-based Home Visitation programs in four Oklahoma counties.
This page contains the products from the 2011 funded proposal, HRSA/ACF D89MC23154: “OUHSC CCAN Independent Evaluation of the State of Oklahoma Competitive Maternal, Infant, and Early Childhood Home Visiting (MIECHV) Project.”
Understanding of this proposal may benefit from the following resources:
Oklahoma’s Maternal, Infant, Early Childhood Home Visitation (MIECHV) Expansion project has two primary branches of evaluation, the internal evaluation conducted by the Oklahoma State Dept. of Health (OSDH) and the external evaluation conducted by the OU Health Sciences Center, Center on Child Abuse and Neglect (CCAN). This summary report describes the progress to date for the external evaluation which uses a mixed-method (quantitative/qualitative) approach to inform and evaluate change in five specific targeted areas identified for improvement.
These five targeted aims of the evaluation intersect with all four of the national MIECHV areas of relevance. The data obtained and evaluated will inform program planning and implementation (aims 1, 2, 3, 4, & 5), will evaluate effectiveness of planned strategies that are intended to enhance and sustain implementation (aims 1, 2, 3, & 5), will evaluate the capacity to support and monitor quality of scaled up evidence-based (EB) home visitation service continuum (aim 1), and will assess the effectiveness of home visitation on key outcomes that overlap with the national MIECHV benchmarks and constructs (aim 5).
The overall analysis is progressing from a set of general inquiries to a set of focused protocol subaims. Our current reports do not map 1-to-1 to our protocol subaims. Our intermediate reporting structure allows us to communicate better with stakeholders and other researchers (because the organization of issues can be different from their perspective). The reports are currently structured so that we can approach others with a single document, instead of several scattered documents. Consequently, the following subaims are frequently addressed by several reports, and multiple subaims can refer to a common report. By the conclusion of our external evaluation, each subaim will be addressed by a single, exclusive report.
We use a literate programming framework and code repository that facilitates agile and reproducible research. We invite readers to view the analysis code and resulting documents housed in this GitHub repository. However, we ask that you not pass the GitHub username and password to anyone who did not received it from us. If you know someone who would like to review the repository, please have them contact us and we likely will grant them permission. (Even with the username, no PHI is accessible from the repository; an authorized OUHSC user account is required.)
Evaluate coordination between home visitation programs and other support services
A: Reduction in duplication of services for any particular client
B: Develop timeline and analytic covariates that chronicle major program events
C: Evaluate the frequency of referrals coming into EBHV agencies
C1 Activity Methods Description: Detailed description of methods in the C1 activity analyses. (Draft.) [pdf]
C1 Models: Longitudinal Models of the MIECHV Effectiveness and Statewide Trends. [html]
Evaluate outreach effort of MIECHV-funded marketing strategies
A: Survey large sector of eligible population for knowledge, use, and appeal of EBHV services
B: Identify marketing successes/failures among client focus group participant responses
MIECHV Qualitative: MIECHV Qualitative Data. [pdf]
C1 Qualitative: C1 Qualitative Data. [pdf]
Evaluate engagement and retention of clients in EBHV services
A: Continually evaluate the flow of clients served per county
Aim 3A: Continually evaluate the flow of clients served per county. [pdf]
Aim 3A Univariate: Continually evaluate the flow of clients served per county. (Further univariate details.) [html]
C1 Activity Methods Description: Detailed description of methods in the C1 activity analyses. (Draft.) [pdf]
C1 Models: Longitudinal Models of the MIECHV Effectiveness and Statewide Trends. [html]
B: Identify reasons for low engagement in services
MIECHV Qualitative: MIECHV Qualitative Data. [pdf]
C1 Qualitative: C1 Qualitative Data. [pdf]
C: Examine provider barriers to program implementation with families that do not engage
MIECHV Qualitative: MIECHV Qualitative Data. [pdf]
C1 Qualitative: C1 Qualitative Data. [pdf]
D: Evaluate effectiveness of new engagement enhancement strategies
Aim 3D and 3F: Evaluate effectiveness of new engagement enhancement strategies and new retention strategies. (The report is under development.) [html]
C1 Models: Longitudinal Models of the MIECHV Effectiveness and Statewide Trends. [html]
E: Identify reasons for attrition from services
MIECHV Qualitative: MIECHV Qualitative Data. [pdf]
C1 Qualitative: C1 Qualitative Data. [pdf]
F: Evaluate effectiveness of new retention strategies
Evaluate overall need for child and family services among disadvantaged early childhood populations within each community
A: Epidemiologic assessment of home visitation services need
Aim 4A: Epidemiologic assessment of home visitation services need. [pdf]
Aim 4A: Epidemiologic assessment of home visitation services need. [png]
B: Epidemiologic assessment of developmental delays
C: Epidemiologic assessment of child sexual behavior problems
D: Epidemiologic assessment of child abuse and neglect potential
Establish a quality improvement and control system and evaluate effectiveness of the home visitation and early childhood services continuum
A: Compare EBHV and Community for targeted MIECHV benchmarks and constructs from EBHV clients
B: Identify system improvements and necessary quality controls through client focus groups, staff and leadership qualitative interviews, and expert systems consultations
MIECHV Qualitative: MIECHV Qualitative Data. [pdf]
C1 Qualitative: C1 Qualitative Data. [pdf]
C: Implement and evaluate system of quality improvements and controls
There was a need to examine other questions and distribute the reports to stakeholders. The reports in this collection do not fit cleanly in the investigation’s five formal aims.
A: Show spatial-temporal conditions
OSDH Maps: Show the geographical relationships and patterns in administrative and demographic variables. (Optimized for paper.) [pdf]
OSDH Maps: Show the geographical relationships and patterns in administrative and demographic variables. (Optimized for monitors.) [html]
