Skip Navigation
acfbanner  
ACF
Department of Health and Human Services 		  
		  Administration for Children and Families
          
ACF Home   |   Services   |   Working with ACF   |   Policy/Planning   |   About ACF   |   ACF News   |   HHS Home

  Questions?  |  Privacy  |  Site Index  |  Contact Us  |  Download Reader™Download Reader  |  Print Print      

Office of Planning, Research & Evaluation (OPRE) skip to primary page content
Advanced
Search

 Table of Contents | Previous | Next

IV. EARLY HEAD START INFLUENCES ON CHILDREN'S DEVELOPMENT

One of the central goals of Early Head Start is to improve the cognitive, social, and emotional development of infants and toddlers in low-income families. Programs may seek to support children's development directly by working with the child in center-based settings, during home visits, or both. Programs may also support children's development indirectly by working with parents to support stronger parent-child relationships, which in turn are expected to nurture and enhance the development of infants and toddlers over the long-term. Some programs focus almost exclusively on working with children directly or working with parents to affect child development, while others give equal focus to both pathways. In addition to pursuing these pathways to child development, programs also focus to some degree on improving family well-being, which may constitute a third, but more indirect, influence on child outcomes. Programs may seek to improve family functioning, and they may help parents move toward self-sufficiency (as discussed in Chapter VI). This chapter presents the impacts of Early Head Start on children's cognitive, social, and emotional development.

A. HYPOTHESES AND BRIEF SUMMARY OF INTERIM FINDINGS

Although Early Head Start programs adopted different approaches, they shared a common goal of improving children's development across all domains, including cognitive and language, social-emotional, and health. As a result, we expect that Early Head Start will have a positive impact overall on the cognitive, social, and emotional development of infants and toddlers. We expect Early Head Start to have a positive influence on children's health and so we included a number of measures of young children's health outcomes. These are primarily based on parent report.1

The interim findings reported in this chapter suggest that Early Head Start had modest beneficial impacts on children's cognitive, language, and social-emotional development by the time children were 2 years old. Children's cognitive and language development were significantly enhanced by Early Head Start at 24 months. Early Head Start children scored higher on average on the Bayley Mental Development Index (MDI), and a smaller proportion of Early Head Start children than control group children scored below 85 on the Bayley MDI, which is a cutoff often used to indicate the need for special services. Early Head Start children had larger spoken vocabularies and used more grammatically complex phrases in speech than control group children at 24 months of age. In the domain of social-emotional development, Early Head Start significantly reduced levels of aggressive behavior problems at 24 months of age. In other areas of social-emotional development at that age, however, Early Head Start did not appear to have an overall impact. These included negativity toward parents, engagement with parents, and sustained attention with objects in parent-child interaction, as well as emotional regulation, and orientation/engagement in a cognitive task.

Children spending time in high-quality child care with skilled caregivers are likely to have greater cognitive and language stimulation than they would otherwise, and this may lead to developmental gains in those areas. In addition, children in high-quality child care, with supervision by trained adults, will have opportunities to socialize with their peers and obtain regular feedback about their interactions with peers. Children who might have a tendency to behave aggressively may learn to take turns, regulate their emotional responses, and use verbal rather than physical responses to express themselves. As a result, we would expect children in center-based Early Head Start programs to show more positive social behavior and less negative behavior.

Home-based Early Head Start services may lead to increases in parents' emotional support and responsiveness to the child, which in turn may lead children to exhibit more positive social behavior, such as engagement in an interaction with the parent, and a reduced incidence of negative behavior, such as aggressive behavior. Parents receiving parent education and home-based services may learn the importance of frequent talk with children, develop strategies for encouraging their infants and toddlers to communicate with them, read books regularly to their young children, and engage in other parent-child activities that may stimulate early language and cognitive development. If programs have these effects on parents' behavior, we would expect children to benefit by having greater language skills and cognitive development.

Nevertheless, because the routes some programs adopted were more direct than those taken by others, we expect that the timing of impacts on child development may be somewhat different, depending on the program's approach. We expect impacts on the development of children in center-based programs and in mixed-approach programs with center-based services to occur earlier, because staff worked directly with children in these programs to stimulate development. We expect impacts on the development of children in home-based programs to take longer to emerge, because staff work part of the time with the child and part of the time with parents to strengthen the parent-child relationship, enhance parenting skills, and support their efforts to provide an educationally stimulating and emotionally responsive home environment. Effects on mixed-approach programs may depend on whether the services are predominantly center-based or home-based.

Our interim findings suggest that programs providing a mix of center-based and home-based services had relatively strong, positive impacts on children's language and social-emotional development at 24 months of age. Programs providing primarily center-based services had positive impacts on children's cognitive development, but no pattern of impacts on language or social-emotional development. Programs providing only home-based services had a modest positive impact on language development by 24 months of age.

Early Head Start programs also varied in the degree to which they had fully implemented the Head Start Program Performance Standards early in the evaluation period (see Chapter I). We expect that programs that are more successful in meeting the Head Start performance standards for the types, quantity, and quality of services to families will have stronger impacts on children's development than programs that did not completely meet these implementation standards during the evaluation period.

The interim findings suggest that early, full implementation of the Head Start Program Performance Standards does promote positive impacts on children's development. Programs that were rated as "fully implemented" overall at an early stage, and that sustained that implementation over time, had the broadest and most consistent set of positive impacts on a range of children's cognitive, language, and social-emotional development.

B. MEASURES OF INFANT-TODDLER DEVELOPMENT

Measuring the development of young children is more challenging than measuring the development of older children, because direct assessments must be limited in time and scope. Infants and toddlers can neither respond reliably to questions about their development nor endure lengthy assessments. Therefore, we used a variety of methods and sources to measure children's development at 14 and 24 months of age, including direct assessments, parent reports, interviewer observations, and videotaped parent-child interactions, which expert researchers later coded. Where possible, we have used multiple methods of measuring outcomes within a single domain to avoid excessive reliance on any method that may have particular biases or inaccuracies. The measures are described briefly in Boxes IV.1 and IV.2, and in more detail in Appendix C.

BOX IV.1

MEASURES OF COGNITIVE AND LANGUAGE DEVELOPMENT

Bayley Mental Development Index (MDI) - measures the cognitive, language, and personal-social development of children under age 3½. Children were directly assessed by the Interviewer/Assessor following a standardized protocol.

The MDI is one of three component scales of the Bayley Scales of Infant Development - Second Edition (Bayley 1993). At 24 months, the child is assessed on his/her ability to follow simple spoken directions and on his or her spoken vocabulary during the assessment.

For example, the child is asked to build a tower of cubes; point to a block and a key; point to objects in pictures when the assessor names them; name three objects in a picture book; match three colors; imitate vertical and horizontal strokes; understand directions that include prepositions; and recall geometric forms.

The Bayley MDI was normed on a nationally representative sample of children of various ages so that raw scores can be converted to standardized scores with a mean of 100 and a standard deviation of 15.

The percentage of children with Bayley MDI below 100 measures the proportion with scores below average for their age in the nationally representative, standardization sample.

The percentage of children with Bayley MDI below 85 measures the proportion with delayed performance, or scores one standard deviation or more below the standardized mean.

MacArthur Communicative Development Inventories (CDI) - measures the language development of infants and toddlers by parent report (Fenson, Bates, Dale, Goodman, Reznick, et al. 2000; Jahn-Samilo, Goodman, Bates, and Sweet 2001). Parents completed the Toddler Form at 24 months. Three measures were derived from this form:

Vocabulary Production - measures the number of words in the child's spoken vocabulary. Parents are asked whether the child says each of 100 common early spoken words, such as "moo," "kitty," "cookie," "up," or "big." Scores range from 0, if the child is not yet speaking, to 100, if the child has used all of the words in speech.

Combining Words - indicates whether the child has begun to use two or more words together to express ideas.

Sentence Complexity - measures the extent to which the child is beginning to combine spoken words in grammatically correct ways. The parent is asked which of two phrases sounds more like the way the child currently speaks. Examples include "kitty sleep" versus "kitty sleeping," and (talking about something that already happened): "doggie kiss me" versus "doggie kissed me." Scores range from 0 if the child is not yet combining words to 37 if he or she always uses the grammatically correct phrase.

 

BOX IV.2

MEASURES OF SOCIAL-EMOTIONAL DEVELOPMENT

Child Behavior During Parent-Child Structured Play - measures the child's behavior with the parent during a structured play task. The parent and child were given three bags of interesting toys and asked to play with the toys in sequence. The structured play task was videotaped, and child and parent behaviors were coded on a 7-point scale by child development researchers according to strict protocols (see Appendix C). Three aspects of children's behavior with the parent were rated on a 7-point scale:

Engagement - measures the extent to which the child interacts with the parent and communicates positive regard and/or positive affect. Very high engagement receives a 7.

Negativity Toward Parent - measures the child's anger, rejection, or negative reactions to the parent's behavior. Very high negativity receives a 7. Sustained Attention with Objects - measures the duration of the child's focus on an object or set of objects during play. Very high sustained attention receives a 7.

Bayley Behavioral Rating Scale (BRS) - measures the child's behavior during the Bayley MDI assessment. The BRS is one of three component scales of the Bayley Scales of Infant Development - Second Edition (Bayley 1993).

Emotional Regulation - measures the child's ability to change tasks and test materials; negative affect; and frustration with tasks during the assessment.

Orientation/Engagement - measures the child's cooperation with the interviewer during the assessment; positive affect; and interest in the test materials.

The interviewer assesses the child's behavior by scoring items on a 5-point scale, with 5 indicating more positive behavior (for example, less frustration and more cooperation). Scores are the average of the items in the subscale.

Child Behavior Checklist - Aggressive subscale - measures the incidence of 15 child behavior problems that tend to occur together and constitute aggressive behavior problems. Parents completed the Aggressive subscale of the Child Behavior Checklist for Ages 2-3 Years (Achenbach 1993; Achenbach, Edelbrock, and Howell 1987). Some behaviors asked about include, "Child has temper tantrums," "Child hits others," and "Child is easily frustrated." For each of the possible behavior problems, the parent was asked whether the child exhibits this behavior often, sometimes, or never. Scores range from 0, if all of the behavior problems are "never" observed by the parent, to 30, if all of the behavior problems are "often" observed.

C. GLOBAL IMPACTS ON CHILDREN'S DEVELOPMENT

1. Global Impacts on Cognitive and Language Development

a. Cognitive Development

Early Head Start had a positive impact on children's cognitive development at 24 months of age. Children in Early Head Start programs scored higher on the Bayley Mental Development Index than children in the control group, on average. The difference in average Bayley MDI scores was 2 scale points, which represents an effect size of 15 percent (Table IV.1). The difference in average scores reflected a decrease in the percentage of children scoring in the lower portion of the distribution. Children from low-income families typically score below average on standardized cognitive tests, and in the control group, nearly 80 percent of the children scored below 100, the standardized mean of the distribution. Early Head Start had a beneficial impact on the development of children scoring below the standardized mean-it reduced the proportion of Early Head Start children scoring below 100 by nearly five percentage points.

Early Head Start also reduced the percentage of children scoring below 85 on the Bayley MDI (one standard deviation below the standardized mean), a threshold considered to be indicative of need for special education services. At 24 months of age, Early Head Start children were significantly less likely than control group children to have MDI scores that fell below 85. In the control group, 40 percent of the 2-year-old children scored below 85. For children in this at-risk group, Early Head Start reduced the proportion scoring below 85 by 6.6 percentage points, or about 16 percent (see Figure IV.1).

When the data on 3-year-olds are available next year, the cross-site research will investigate mediators of child impacts. Some of the local researchers have conducted preliminary analyses with existing data that may suggest useful strategies. Box IV.3 illustrates one approach taken by the New York University researchers, investigating father-child interaction variables as predictors of children's Bayley performance. The Kansas analysis (Box IV.4) examined program engagement in relation to children's cognitive (Bayley scores), as well as language, development. In a slightly different vein, the Utah State University team has examined the interaction of age and the Early Head Start intervention in relation to children's developmental changes in the first 18 months of life (Box IV.5).

b. Language Development

Early Head Start had a positive impact on children's language development, as reported by parents, at 24 months of age (Table IV.1). Children in Early Head Start programs were using a larger number of words in speech and were more likely to use grammatically-complex phrases in speech than were children in the control group at 2 years. Scores on an index of vocabulary production, or common early words that the parent has heard the child say, were higher by 2 points (an effect size of about 11 percent). Scores on a sentence complexity scale, which measures whether the child is putting words together in a way that indicates he or she is learning more complex rules of grammar, were higher by nearly 1 point (an effect size of about 11 percent).

Kansas researchers explored language development in bilingual children. A summary of their findings appears in Box IV.6.

The impacts on cognitive development and language are promising. The reduction in the percentage of children with Bayley MDI scores below 85 is particularly important, because if this impact is sustained, Early Head Start may reduce cognitive delay in children from low-income, high-risk families, perhaps reducing their need for expensive special services later on. Moreover, the impacts on cognitive competence and language development, if sustained, can provide an important foundation for later reading and improved performance in school.

 

TABLE IV.1
IMPACTS ON COGNITIVE AND LANGUAGE DEVELOPMENT

Outcome

Program Group Participantsa

Control
Groupb

Estimated Impact Per Participantc

Effect
Sized

COGNITIVE DEVELOPMENT

Bayley Mental Development Index (MDI) 90.1 88.1 2.0*** 14.9
Percent with Bayley MDI Below 100 74.6 79.4 -4.8** 11.7

Percent with Bayley MDI Below 85

33.6 40.2 -6.6** 13.5

LANGUAGE DEVELOPMENT

MacArthur Communicative Development Inventory (CDI): Vocabulary Production Score

56.3 53.9 2.4** 10.8

MacArthur CDI: Percent Combining Words

81.0 77.9 3.1 7.4

MacArthur CDI: Sentence Complexity Score

8.6 7.7 0.9** 11.4
Sample Size Parent Interview
Bayley
1,092
910
1,021
829
2,113
1,739
 
SOURCE: Parent interview and child assessments conducted when children were approximately 24 months old.

NOTE: All impact estimates were calculated using regression models, where each site was weighted equally.

aA participant is defined as a program group member who received more than one Early Head Start home visit, met with an Early Head Start case manager more than once, received at least two weeks of Early Head Start center-based care, and/or participated in Early Head Start group parent-child activities.(back)

bThe control group mean is the mean for the control group members who would have participated in Early Head Start if they had instead been assigned to the program group. This unobserved mean was estimated as the difference between the program group mean for participants and the impact per participant.(back)

cThe estimated impact per participant is measured as the estimated impact per eligible applicant divided by the proportion of program group members who participated in Early Head Start services (which varied by site). The estimated impact per eligible applicant is measured as the difference between the regression-adjusted means for all program and control group members.(back)

dThe effect size was calculated by dividing the estimated impact per participant by the standard deviation of the outcome measure for the control group times 100 (that is, it is the impact expressed as a percentage of the standard deviation).(back)

*Significantly different from zero at the .10 level, two-tailed test
**Significantly different from zero at the .05 level, two-tailed test.
***Significantly different from zero at the .01 level, two-tailed test.

 

FIGURE IV.1

IMPACTS PER PARTICIPANT ON CHILDREN'S COGNITIVE DEVELOPMENT

Figure 4.1: Impacts Per Participant on Children's Cognitive Development[D]

 

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test.

 

BOX IV.3

BEYOND ROUGH AND TUMBLE: FATHERING AND COGNITIVE
DEVELOPMENT IN 24-MONTH-OLDS

Jacqueline Shannon, Catherine S. Tamis-LeMonda, Kevin London, Mark Spellmann, and Natasha Cabrera New York University and the National Institute of Child Health and Human Development

The Early Head Start Fathers workgroup emerged out of a need to understand the nature and meaning of father involvement in low-income families. In New York City, we focused on positive aspects of low-income fathers' interactions with their toddlers and examined whether fathers' interactions predict the cognitive development of their toddlers.

Participants were 45 father-child dyads (23 boys) taken from the first wave of participants in the 24-month cohort in New York City. Fathers' average age was 26 years (SD=7.23), and children were between 23 and 30 months old. Forty-two percent of the fathers were living with their children. Father-child interactions were videotaped during semistructured free play. Bayley Mental Development Index (MDI) scores were obtained on the children. Father-child interactions were assessed using the Caregiver-Child Affect, Responsive and Engagement Scale. The C-CARES measures parent-child interactions on 23 parent and 16 child behaviors. Each item was rated on a 5-point Likert scale ranging from 1 "not observed" to 5 "constantly observed."

Factor analyses on father items indicated a three-factor solution (explaining 66 percent of the variance). The first factor, Responsive-Didactic (loading on eight items), reflects paternal behaviors that are positive, responsive, emotionally attuned, and didactic. The second factor, Negative- Unresponsive-Intrusive (loaded on seven items), reflects paternal behaviors that are parent-driven and achievement-oriented through use of highly structured, negative verbal reinforcement, unresponsive, intrusive, and inflexible behaviors. The third factor, Inflexible-Teasing (loaded on two items), reflects paternal behaviors that are inflexible with high levels of teasing. Due to poor reliability, this factor was deleted from further analyses.

The factor analysis on child items revealed a three-factor solution (explaining 72 percent of the variance). The first factor, Cognitive-Playful (loaded on five items), reflects child behaviors that were positive in affect, sophisticated in language and play skills, and highly involved with the toys. The second factor, Social (loaded on four items), reflects child behaviors that are positive, participatory, responsive, and emotionally attuned toward their father. The third factor, Regulated-Persistent (loaded on four items), reflects child behaviors that are highly regulated and persistent.

Children's mean score on the Bayley MDI was 86.13 (SD=11.87). Twenty-five of the children were not developmentally delayed (MDI>85), and 20 were (MDI<85). A binary logistic regression analysis was performed with children's MDI scores (not delayed/delayed) as the outcome variable, and three predictor variables: Cognitive-Playful and Social child behaviors and Responsive-Didactic father behaviors.

In the logistic regression model, child Cognitive-Playful and Social behaviors were not significant predictors of delayed status (social: p = .18, play-language: p = .82). Only father Responsive-Didactic behaviors retained its unique significance as a predictor of delayed status (p = .01). Based on the nonsignificance of child behaviors, a second model was then run, including only father responsive-didactic behaviors as a predictor, to eliminate spurious expansion effects. This model yielded an odds ratio of 10:1, p = .001. The Nagelkerke R2 indicated that this model explained 33 percent of the variance of children's delayed status.

In summary, this investigation of fathers playing with their 24-month-olds indicated two distinct parental styles of engagement: Responsive-Didactic and Negative-Unresponsive-Intrusive. Fathers scoring higher on the Responsive-Didactic style were 10 times less likely to have children who scored in the delayed range of the Bayley MDI. Responsive-Didactic behaviors in fathers contributed unique variance to Bayley scores, over and above child behaviors during the interaction. Although this suggests the relevance of fathers to the cognitive status of their toddlers, the concurrent nature of the study still leaves the question of causal relationship open.

 

BOX IV.4

RELATIONSHIPS BETWEEN SERVICES AND CHILD OUTCOMES IN AN
URBAN EARLY HEAD START PROGRAM

Jane Atwater, Judith Carta, Jean Ann Summers, and Martha Staker
University of Kansas and Project EAGLE

A primary mission of the Kansas Early Head Start Partnership has been to identify program features and services that are most effective in promoting optimal outcomes for children and families. This mission is fundamental to improving our local program and to contributing to the national knowledge base on effective intervention practice. As a first step in that effort, our interim analyses sought to determine whether differences in service across individual families are related to child progress within Early Head Start. The results of these analyses highlight the importance of active parent engagement to the success of Early Head Start services for young children at risk and suggest that a constellation of services, including quality child care, may support parents' efforts to be actively engaged in services for their young children.

The analysis sample included 77 Early Head Start families in an ethnically diverse, urban community. All families received home-based intervention services. Those with child care needs also received developmentally appropriate, community-based child care.

To track developmental progress, analyses focused on growth over time in children's cognitive development (performance on the Bayley Mental Development Scale) and language development (children's verbal communication during typical activities at home). Child assessments were conducted every four to six months from 8 to 24 months of age.

Program service measures included (1) child's age at enrollment; (2) program model-home visiting only or home visiting plus child care services; (3) duration of services; (4) intensity of home-based services; and (5) parent engagement in the program-a composite based on staff ratings of the consistency in participation over time, active engagement during home visits, and follow-through on individual goals between visits.

In cognitive development, the key result was that children's 24-month outcomes were significantly higher when programs successfully engaged parents as active participants in home-based services. For example, for families in the lowest quartile for engagement, Bayley MDI scores at 24 months averaged 78.46, indicating developmental delay. In contrast, for the most highly engaged families, the mean MDI was 92.74, well within the typical range. For language development, the key result was that, in more highly engaged families, children talked more during home observations and had more rapid increases in verbal communication over time.

As for predictors of engagement, duration of services was positively related to the level of parent engagement. Furthermore, active parent engagement during home-based services was significantly higher in families that also received child care services than in families that had home visits only.

 

BOX IV.5

KEEPING KIDS ON TRACK: INTERACTIVE EFFECTS OF AGE AND INTERVENTION

L.A. Roggman, L.K. Boyce, and G.A. Cook
Utah State University

The goal of Utah's Bear River Early Head Start program is to improve outcomes for infants and toddlers by helping parents support early development. To test whether these Early Head Start children are more on track than non-program children, it is essential to look at the interactive effects of Early Head Start and age with regard to developmental change over time. Using a different approach than that of the cross-site study, we included both age and intervention group in our analyses to compare the developmental track for Early Head Start versus the control group children in two critical outcomes: attachment security and cognitive skills.

Results of between-group repeated measures (by age) analysis of variance showed statistically significant interactions between age and group for both attachment security and cognitive skills. For security F (1,137) = 8.9, p = .003; for cognitive skills F (1, 115) = 4.2, p = .04). For attachment security, only Early Head Start toddlers showed a statistically significant increase in their security scores from 14 to 18 months (simple effects test for Early Head Start group, F (1, 137) = 8.2, p = .005). For cognitive skills, Early Head Start toddlers maintained stable standardized test scores, while control group toddlers, similar to others in poverty, began to lose ground as indicated in a statistically significant decrease in their standardized cognitive skills scores (simple effects test for control group, F [1, 115] = 9.4, p = .003).

In summary, toddlers in Utah's Bear River Early Head Start are staying on track, becoming increasingly secure and maintaining progress in cognitive skills, while toddlers in the control group are beginning to get off track. These differences are likely to become greater with time, favoring those on a more favorable developmental trajectory.


BOX IV.6

FACTORS AFFECTING LANGUAGE OUTCOMES OF YOUNG LATINO CHILDREN IN BILINGUAL ENVIRONMENTS

Judith Cruzado-Guerrero and Judith Carta
University of Kansas

Latino children growing up in bilingual households in inner-city communities are affected by a range of factors that influence their language outcomes. Among these factors are environmental risks, families' degree of acculturation and their expectations for language use related to culture, and amount of exposure to language in and outside the home. This report focuses on these factors in a subsample of 20 children in an urban community from bilingual English/Spanish environments who were involved in the larger Early Head Start national evaluation and whose parents characterized them as being raised in English- or Spanish-dominant bilingual environments.

Bilingual children's language outcomes were measured in both English and Spanish using the MacArthur Communicative Development Inventory. The relative proportion of children's exposure to English and Spanish was estimated based on parents' report of primary and secondary caregivers who regularly spoke English and/or Spanish to the child. Direct observations of the interaction of children with their parents or other primary caregivers were gathered in typical situations in the home. Data were recorded regarding the percent of intervals parents and children spoke in English and/or Spanish. Other parent measures included their language dominance, their degree of acculturation, and their levels of environmental risk.

Here, we present children's outcomes and their relationships to families' characteristics.

  • Vocabulary outcomes showed that, on average, when children's vocabulary sizes in English and Spanish were combined, English-dominant children's vocabularies (M = 478.71) were larger than those of the Spanish-dominant children (M = 392.43).

  • Not surprisingly, children in English-dominant families were estimated to have greater relative exposure to English in their environments.

  • English-dominant children were observed to spend more time being spoken to in English and to verbalize in English.

  • Families who were more likely to verbalize in either language had fewer risks or were more likely to have an Anglo orientation.

  • In general, English-dominant families had lower levels of risk and higher levels of acculturation.

 

2. Global Impacts on Children's Social-Emotional Development

Early Head Start had no significant impacts on the child's behavior in a structured play interaction with the mother at 24 months of age. The child's engagement of the parent, negativity toward the parent, and sustained attention with objects during play were not significantly changed by participation in Early Head Start (Table IV.2).

Early Head Start had no significant impacts on the interviewer's rating of children's social-emotional behavior during the Bayley assessment. Children in the Early Head Start and control groups received the same scores, on average, on a measure of emotional regulation during tasks and a measure of orientation or engagement toward the interviewer.

Early Head Start did lead to a reduction in the incidence of parent-reported problems with aggressive behavior at 24 months of age. Parents' responses to the behavior problems scale are partly based on the child's behavior but are also influenced by their views of what constitutes normal child behavior. If Early Head Start influences parents' perceptions of normal behavior, then this could partly explain any impact on measured behavior problems. Children participating in Early Head Start received aggressive behavior-problem scores that were 0.6 percentage points lower, on average, than the scores received by children in the control group (effect size of 10 percent). Achieving lower aggressive behavior problem scores is important, because higher aggression at an early age is a precursor to poor behavioral adjustment in school and subsequent poor academic performance (McKinney and Speece 1986; and Sroufe and Egeland 1989). If a reduction in aggressive behavior problems is sustained, then later school performance may be improved.

 

TABLE IV.2
IMPACTS ON SOCIAL-EMOTIONAL DEVELOPMENT FOR THE FULL SAMPLE
Outcome
Program Group Participantse
Control Groupf
Estimated Impact Per Participantg
Effect Sizeh
Parent-Child Structured Play: Engagement of Parenti 4.3 4.2 0.1 7.6
Parent-Child Structured Play: Negativity toward Parenti 1.7 1.8 0.1 8.0
Parent-Child Structured Play: Sustained Attention with Objectsi 5.0 5.0 -0.1 6.8
Bayley Behavior Rating Scale (BRS): Emotional Regulation in a Cognitive Task (average score)j 3.6 3.6 -0.0 -1.4
Bayley Behavior Rating Scale (BRS): Orientation/ Engagement in a Cognitive Task (average score)j 3.7 3.6 0.0 0.5
Child Behavior Checklist: Aggressive Behavior Problems (average score) 9.9 10.5 -0.6** -10.2
Sample Size 1,092 1,021 2,113  
SOURCE: Parent interviews, child assessments, interviewer observations, and assessments of semi-structured parent-child interactions conducted when children were approximately 24 months old.

NOTE: All impact estimates were calculated using regression models, where each site was weighted equally.

eA participant is defined as a program group member who received more than one Early Head Start home visit, met with an Early Head Start case manager more than once, received at least two weeks of Early Head Start center-based care, and/or participated in Early Head Start group parent-child activities.(back)

fThe control group mean is the mean for the control group members who would have participated in Early Head Start if they had instead been assigned to the program group. This unobserved mean was estimated as the difference between the program group mean for participants and the impact per participant.(back)

gThe estimated impact per participant is measured as the estimated impact per eligible applicant divided by the proportion of program group members who participated in Early Head Start services (which varied by site). The estimated impact per eligible applicant is measured as the difference between the regression-adjusted means for all program and control group members.(back)

hThe effect size was calculated by dividing the estimated impact per participant by the standard deviation of the outcome measure for the control group times 100 (that is, it is the impact expressed as a percentage of the standard deviation).(back)

iBehaviors are observed during the videotaped Parent-Child Structured Play task and coded on a seven-point scale.(back)

jBehaviors are observed during the Bayley assessment and rated on a five-point scale by the Interviewer/Assessor.(back)

*Significantly different from zero at the .10 level, two-tailed test
**Significantly different from zero at the .05 level, two-tailed test.
***Significantly different from zero at the .01 level, two-tailed test.

 

D. VARIATIONS IN IMPACTS ON CHILDREN'S DEVELOPMENT, BY PROGRAM APPROACH2

The Early Head Start programs adopted different basic approaches to providing child development services. At the time of our 1997 implementation visits to the 17 research programs, we found that four programs offered only center-based services to families; seven offered only home-based services to families; and six offered services of both types, which provided some flexibility in determining the services that families would receive to best meet their needs. The 1997 site visits correspond to the period in which most of the infants and toddlers in the sample were 14 months old, so the 1997 program approaches are relevant to understanding the child impacts measured in this report.

1. Cognitive and Language Development

Early Head Start had a positive impact on the average Bayley MDI scores of children in center-based programs at 24 months of age (Figure IV.2), but the impacts on average Bayley MDI scores for children in home-based and mixed programs were not significant. Previous evaluations of center-based, early childhood interventions have also found positive impacts on Bayley scores by 24 months of age, as noted in Chapter I. For Early Head Start children in center-based programs, Bayley MDI scores were higher by nearly 3 points, for an effect size of 22 percent.

Children in center-based Early Head Start programs were also significantly less likely than children in the control group to score below 85 on the MDI at 24 months. The proportion of children in center-based Early Head Start programs scoring below 85 on the Bayley MDI was 30 percent, compared with 42 percent of the control group, a reduction of 28 percent in the proportion of more seriously at-risk children (and an effect size of 24 percent).

Impacts on language development occurred within a different subgroup of programs. Children in mixed-approach Early Head Start programs had significant, positive gains in language development at 24 months of age. Children in Early Head Start programs that adopted a mixed approach had larger spoken vocabularies at 24 months than did children in the control group. They also were more likely to be combining words at 24 months, and they were using more grammatically complex phrases. Children in home-based Early Head Start programs also had gains in spoken vocabulary at 24 months, but there were no impacts on the proportion combining words or on the grammatical complexity of their speech. There were no impacts on language development in center-based programs.

We explored whether the findings on language impacts by program approach were biased by the fact that parents were reporting about their children's language skills. To examine this issue, we factor-analyzed the Bayley items at 24 months and identified a set of language items that have good psychometric properties. We used these items to create a Bayley "language score" that would enable us to compare the maternal report measure to one based on direct assessment. (Information about the scale is included in Appendix C.)

The pattern of impacts suggests that there is consistency across the three program approaches between parent reports of language and children's language ability as measured by the Bayley Language score. We found impacts on the Bayley Language score in the mixed programs, where we had also found positive impacts on the parent-reported language measures. We found no impacts on the Bayley Language score in center-based programs, where we also found no impacts on parent-reported language measures. We also found no impact on the Bayley Language score in home-based programs, where we had found a positive impact on only one of the parent-reported language scores (vocabulary).

FIGURE IV.2

IMPACTS PER PARTICIPANT ON COGNITIVE AND LANGUAGE DEVELOPMENT,
BY PROGRAM APPROACH

Figure 4.2: Impacts Per Participant on Cognitive and Language Development by Program Approach[D]

 

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test.

 

2. Social-Emotional Outcomes

Early Head Start programs that were mixed-approach in 1997 had positive impacts on children's behavior at 24 months (Figure IV.3). During parent-child structured play, Early Head Start children in these programs showed more engagement with the parent and more sustained attention with objects than did children in the control group. Moreover, mixed-approach Early Head Start programs reduced aggressive behavior problems at 24 months of age. Early Head Start center-based and home-based programs had no pattern of statistically significant impacts on measures of social-emotional development at 24 months of age.

 

FIGURE IV.3

IMPACTS PER PARTICIPANT ON SOCIAL-EMOTIONAL DEVELOPMENT,
BY PROGRAM APPROACH

Figure 4.3: Impacts per Participant on Social-Emotional Development, by Program Approach[D]

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test.

 

3. Summary

The pattern of child development findings by program approach was not completely expected. However, program approaches are not randomly determined, but instead, Early Head Start programs chose program approaches and an array of services to provide the best match for their community contexts and the population of families they expected to serve. In fact, as we note in Chapter II, the characteristics of families differed by program approach, as did community characteristics and implementation levels. Thus, the pattern of results does not tell us about the effectiveness of a particular type of program in sites that chose a different program approach, because of other differences in the characteristics of these sites. We can conclude, however, that each of the approaches chosen by the programs had important impacts on children's development by 24 months of age.

E. VARIATIONS IN IMPACTS ON CHILDREN'S DEVELOPMENT, BY PROGRAM IMPLEMENTATION LEVEL

As part of the implementation study, Early Head Start programs were rated on their overall implementation of the major program elements in both fall 1997 and fall 1999 (see Chapter I and Appendix C). Six programs were rated as fully implemented in fall 1997 (early implementers), six programs were rated as not fully implemented in fall 1997 but were rated as fully implemented overall in fall 1999 (late implementers), and five programs were rated as not fully implemented at either time (incomplete implementers). The incomplete implementers either emphasized family support (thus placing less emphasis on child development) or faced difficult implementation challenges (such as early staff turnover in leadership positions or partnerships that did not work out well). Programs that were rated as fully implemented in both periods cut across all program approaches.

1. Cognitive and Language Outcomes

Early Head Start programs that were early implementers and later implementers had a statistically significant impact on children's cognitive functioning as measured by the Bayley MDI at 24 months (Figure IV.4). In both cases, the difference in scores between Early Head Start children and those in the control group was 2 points, and the effect size was 16 percent. There were no impacts on children's Bayley scores in the programs that were rated as not fully implemented in either period (incomplete implementers).

Early Head Start programs that were early implementers also had statistically significant impacts on key aspects of children's language development. At 24 months, compared with children in the control group, Early Head Start children in these programs (1) scored significantly higher on vocabulary production, (2) were more likely to be combining words rather than using one-word phrases (not shown), and (3) used phrases that were grammatically more complex. There were no statistically significant impacts on language development for Early Head Start children in programs that were later implementers or for children in programs that were incomplete implementers.

FIGURE IV.4

IMPACTS PER PARTICIPANT ON COGNITIVE AND LANGUAGE DEVELOPMENT,
BY PATTERN OF IMPLEMENTATION

Figure 4.4: Impacts per Participant on Cognitive and Language Development by Pattern of Implementation[D]

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test

 

2. Social-Emotional Outcomes

Early Head Start programs that were early implementers had statistically significant impacts on several important aspects of children's social-emotional development at 24 months (Figure IV.5). Early Head Start children in these programs received significantly higher scores than control group children on aspects of their interactions with parents during parent-child structured play. Early Head Start children were more engaged with the parent and showed greater sustained attention with objects. Early Head Start children in these programs were rated as showing significantly greater emotional regulation than control group children during the Bayley assessment at 24 months of age with an effect size of 14 percent (not shown). Early Head Start children in these programs had significantly lower aggressive behavior problems scores than did control group children at 24 months of age.

Early Head Start programs that were later or incomplete implementers did not have a pattern of consistent positive impacts on children's social-emotional development. Measures of the child's interactions with the parent during parent-child structured play were for the most part not significantly different. Only engagement of the parent was higher for Early Head Start children in programs that became fully implemented later. There was no difference between Early Head Start and control group children in aggressive behavior problems reported by the parent in either later-implemented programs or incompletely implemented programs.

FIGURE IV.5

IMPACTS PER PARTICIPANT ON SOCIAL-EMOTIONAL DEVELOPMENT,
BY PATTERN OF IMPLEMENTATION

Figure 4.5: Impacts per Participant on Social-Emotional Development, by Pattern of Implementation[D]

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test.

 

F. VARIATIONS IN IMPACTS ON CHILDREN'S DEVELOPMENT, BY WELFARE-RELATED WORK REQUIREMENTS

Characteristics of the communities in which Early Head Start programs operate may make it more challenging for programs to serve families and may influence the level and types of services families in the control group receive. In about 40 percent of the research-site communities, parents receiving welfare were required to work when their children were under 12 months of age (although most of these communities exempted parents from work if the child was under 3 months old). Early Head Start programs in these communities may face the challenge of serving many families in which the mothers are trying to meet the work requirements while parenting a young infant. Helping parents navigate welfare-related work requirements and find high-quality child care may take time away from helping them build supportive relationships with their children. On the other hand, if programs help parents manage their welfare-related work requirements, the parents may experience less stress than in the absence of the program, thus enabling them to focus on building a supportive relationship with their child. Moreover, if programs help parents find better-quality child care, this may further enhance children's outcomes.

Early Head Start programs in sites in which parents receiving welfare are required to engage in work activities while the child is an infant had a positive impact on children's cognitive development but no impact on language development (Figure IV.6). Bayley MDI scores were higher in the Early Head Start group by 2.6 percentage points (effect size of nearly 20 percent), and the proportion of children scoring below 85 on the Bayley MDI fell by 6.3 percentage points.

 

FIGURE IV.6

IMPACTS PER PARTICIPANT ON COGNITIVE AND LANGUAGE DEVELOPMENT,
BY WELFARE-RELATED WORK REQUIREMENTS

Figure 5.6: Impacts per Participant on Cognitive and Language Development, by Welfare Related Work Requirements[D]

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test.

 

FIGURE IV.7

IMPACTS PER PARTICIPANT ON SOCIAL-EMOTIONAL DEVELOPMENT,
BY WELFARE-RELATED WORK REQUIREMENTS

Figure 4.7: Impacts per Participant on Social-Emotional Development, by Welfare-Related Work Requirements[D]

Source: Parent interviews, child assessments, and assessments of parent-child interactions during semi-structured tasks conducted when children were approximately 24 months old.

Notes: All percentages are regression-adjusted means estimated using models that weight each site equally.

* Program impact is significantly different from zero at the .10 level, two-tailed test.
** Program impact is significantly different from zero at the .05 level, two-tailed test.
***Program impact is significantly different from zero at the .01 level, two-tailed test.

 

In social-emotional development, only the child's engagement of the parent during parent-child structured play was favorably influenced by Early Head Start in this subgroup of programs (Figure IV.7).

Early Head Start programs in sites in which parents receiving welfare are deferred from work requirements until the youngest child is 1 year old improved language development and reduced the proportion scoring below 85 on the Bayley MDI. In this subgroup of programs, vocabulary production and sentence complexity scores were higher for Early Head Start children, but there were no impacts on social-emotional development.

The findings suggest that Early Head Start programs are having important impacts on children's development regardless of the site's welfare-related work requirements for parents of infants. The specific pattern of impacts on children's development is difficult to explain, but is broadly related to the program approaches found within each subgroup. Three of the four center-based programs are in the subgroup of sites in which parents of infants are required to work under welfare policies, while the majority of home-based and mixed-approach programs are found in the subgroup that allows welfare recipients to defer work for the child's first year. Nevertheless, these impacts may best be viewed as interactive effects of policies, program approach, and other site features, rather than stemming mainly from the program approach found within each welfare-related subgroup. Early Head Start programs adopted program features given their community contexts and eligible populations, so these features of the sites are not fully separable in the analysis. Thus, we can conclude that within subgroups of sites defined by the different welfare-related work requirements, Early Head Start programs chose models and provided an array of services that had an impact on children's development by 2 years of age.



 


1The evaluation has also included measures of health services obtained for the child, and these services are relatively easy for families to access in the community, as discussed in Chapter III. In addition, some of the local research projects have focused on children's health. A special report that focuses on children's health and disabilities will be available in winter 2002.(back)

2In this chapter, we present figures with the subgroup findings from the targeted analyses. For details of subgroup means, effect sizes, sample sizes, and the significance of the differences across subgroup impacts, see tables in Appendix E.IV.(back)

 

 Table of Contents | Previous | Next