Overview

Project Duration: 2011-2015

Evaluates MIECHV expansion and enhancement of Evidence-based Home Visitation programs in four Oklahoma counties.

This page contains the products from the 2011 funded proposal, HRSA/ACF D89MC23154: “OUHSC CCAN Independent Evaluation of the State of Oklahoma Competitive Maternal, Infant, and Early Childhood Home Visiting (MIECHV) Project.”



Resources and Files

Understanding of this proposal may benefit from the following resources:



Aims of the External Evaluation

Description

Oklahoma’s Maternal, Infant, Early Childhood Home Visitation (MIECHV) Expansion project has two primary branches of evaluation, the internal evaluation conducted by the Oklahoma State Dept. of Health (OSDH) and the external evaluation conducted by the OU Health Sciences Center, Center on Child Abuse and Neglect (CCAN). This summary report describes the progress to date for the external evaluation which uses a mixed-method (quantitative/qualitative) approach to inform and evaluate change in five specific targeted areas identified for improvement.

Impact

These five targeted aims of the evaluation intersect with all four of the national MIECHV areas of relevance. The data obtained and evaluated will inform program planning and implementation (aims 1, 2, 3, 4, & 5), will evaluate effectiveness of planned strategies that are intended to enhance and sustain implementation (aims 1, 2, 3, & 5), will evaluate the capacity to support and monitor quality of scaled up evidence-based (EB) home visitation service continuum (aim 1), and will assess the effectiveness of home visitation on key outcomes that overlap with the national MIECHV benchmarks and constructs (aim 5).

Reporting Strategy

The overall analysis is progressing from a set of general inquiries to a set of focused protocol subaims. Our current reports do not map 1-to-1 to our protocol subaims. Our intermediate reporting structure allows us to communicate better with stakeholders and other researchers (because the organization of issues can be different from their perspective). The reports are currently structured so that we can approach others with a single document, instead of several scattered documents. Consequently, the following subaims are frequently addressed by several reports, and multiple subaims can refer to a common report. By the conclusion of our external evaluation, each subaim will be addressed by a single, exclusive report.

We use a literate programming framework and code repository that facilitates agile and reproducible research. We invite readers to view the analysis code and resulting documents housed in this GitHub repository. However, we ask that you not pass the GitHub username and password to anyone who did not received it from us. If you know someone who would like to review the repository, please have them contact us and we likely will grant them permission. (Even with the username, no PHI is accessible from the repository; an authorized OUHSC user account is required.)

Aim 1

Evaluate coordination between home visitation programs and other support services

A: Reduction in duplication of services for any particular client

B: Develop timeline and analytic covariates that chronicle major program events

  • Aim 1B: Develop timeline and analytic covariates that chronicle major program events. [html]

C: Evaluate the frequency of referrals coming into EBHV agencies

Aim 2

Evaluate outreach effort of MIECHV-funded marketing strategies

A: Survey large sector of eligible population for knowledge, use, and appeal of EBHV services

  • Aim 2A: Survey large sector of eligible population for knowledge, use, and appeal of EBHV services. [pdf]

B: Identify marketing successes/failures among client focus group participant responses

Aim 3

Evaluate engagement and retention of clients in EBHV services

A: Continually evaluate the flow of clients served per county

  • Aim 3A: Continually evaluate the flow of clients served per county. [pdf]

  • Aim 3A Univariate: Continually evaluate the flow of clients served per county. (Further univariate details.) [html]

  • C1 Activity Methods Description: Detailed description of methods in the C1 activity analyses. (Draft.) [pdf]

  • C1 Models: Longitudinal Models of the MIECHV Effectiveness and Statewide Trends. [html]

B: Identify reasons for low engagement in services

C: Examine provider barriers to program implementation with families that do not engage

D: Evaluate effectiveness of new engagement enhancement strategies

  • Aim 3D and 3F: Evaluate effectiveness of new engagement enhancement strategies and new retention strategies. (The report is under development.) [html]

  • C1 Models: Longitudinal Models of the MIECHV Effectiveness and Statewide Trends. [html]

E: Identify reasons for attrition from services

F: Evaluate effectiveness of new retention strategies

  • Aim 3D and 3F: Evaluate effectiveness of new engagement enhancement strategies and new retention strategies. (The report is under development.) [html]

Aim 4

Evaluate overall need for child and family services among disadvantaged early childhood populations within each community

A: Epidemiologic assessment of home visitation services need

  • Aim 4A: Epidemiologic assessment of home visitation services need. [pdf]

  • Aim 4A: Epidemiologic assessment of home visitation services need. [png]

B: Epidemiologic assessment of developmental delays

  • Aim 4B: Epidemiologic assessment of developmental delays. [html]

C: Epidemiologic assessment of child sexual behavior problems

  • Aim 4C: Epidemiologic assessment of child sexual behavior problems. [html]

D: Epidemiologic assessment of child abuse and neglect potential

  • Aim 4D: Epidemiologic assessment of child abuse and neglect potential. (The report is under development.) [html]

Aim 5

Establish a quality improvement and control system and evaluate effectiveness of the home visitation and early childhood services continuum

A: Compare EBHV and Community for targeted MIECHV benchmarks and constructs from EBHV clients

  • Aim 5A: Compare EBHV and Community for targeted MIECHV benchmarks and constructs from EBHV clients. (The report is under development.) [html]

B: Identify system improvements and necessary quality controls through client focus groups, staff and leadership qualitative interviews, and expert systems consultations

C: Implement and evaluate system of quality improvements and controls

  • Aim 5C: Implement and evaluate system of quality improvements and controls. (The report is under development.) [html]

  • C1 Models: Longitudinal Models of the MIECHV Effectiveness and Statewide Trends. [html]

Auxiliary Aims

There was a need to examine other questions and distribute the reports to stakeholders. The reports in this collection do not fit cleanly in the investigation’s five formal aims.

A: Show spatial-temporal conditions

  • OSDH Maps: Show the geographical relationships and patterns in administrative and demographic variables. (Optimized for paper.) [pdf]

  • OSDH Maps: Show the geographical relationships and patterns in administrative and demographic variables. (Optimized for monitors.) [html]



Collaborators and Stakeholders



Additional Information