Resource Home| Documents Home

Evaluation of the 2001 Summer Enrichment Program

Gregg Cannon, Ph.D.

July 24, 2001

Executive Summary

The District’s Core Curriculum Standards Assessment (CCSA) was administered to all elementary and high school students on the first and last day of the Summer Enrichment Program (SEAS). Middle school students were administered a specifically designed test based on the Summer Enrichment curriculum. All pretests and posttests were identical with the exception of the middle school math assessment. The middle school math assessments, while appearing to be parallel, were different tests.

All comparisons were based on same student cohorts. Students were matched on their matriculation numbers in order to calculate gain scores (post – pre). All test scores were expressed as percent correct, while gain scores were expressed as the percent correct gain from pretest to posttest. The match rate between pretest and posttest was 59%. This match rate is not as low as it appears given that 15% of the loss was due to attrition. Had there been no loss due to attrition the match rate would have been closer to 74%. The bulk of the loss (44%) was due to missing or partial matriculation numbers.

Elementary Schools

Of the 26 elementary schools participating in the Summer Enrichment Program 18, or 69% showed gains in reading, writing, and mathematics for at least one grade. Only two schools Erickson and Tully showed losses in all three content areas. The losses found at Tully were based on only three fourth grade students and therefore may not be representative of the summer program at Tully in a broader sense. Based on the average gain across all elementary schools the greatest gain was demonstrated for mathematics followed closely by writing and then reading.

Middle Schools

Twelve of the 13 middle schools participating in the Summer Enrichment Program demonstrated gains in mathematics. However, only five of those schools showing gains in mathematics demonstrated gains across all grade levels. On the other hand, all thirteen middle schools demonstrated overall gains in reading. Only two middle schools showed small losses in reading at grades 6 and 8.

High Schools

All high schools in the Summer Enrichment Program showed gains in mathematics. The gains in math were not as dramatic as those found for middle schools 5.8% compared to 33%. On the other hand, all high schools showed losses from pretest to posttest in reading. The writing gains were split; half the schools showing gains while the other half showed losses. Comparing high schools in reading may not be valid given that there were no reading classes offered at the high school level and a number of the poor posttest scores were due to students only answering a fraction of the reading items.

Pretest – Posttest Comparison on the
CCSA for Matched Elementary School Students

School

Grade

Mathematics

Reading

Writing

N

 

 

Pre

Post

Gain

Pre

Post

Gain

Pre

Post

Gain

 

Tully

4

52.40

48.57

-3.83

61.90

60.00

-1.90

62.87

40.93

-21.93

3

Blenman 

2

73.85

76.48

2.64

70.54

72.29

1.75

65.04

77.13

12.09

13

Blenman 

4

65.30

62.72

-2.58

56.32

56.47

.15

56.87

60.40

3.53

21

Davis Bilingual

2

80.00

81.23

1.23

72.64

84.91

12.27

68.57

75.50

6.93

7

Davis Bilingual

4

48.86

50.58

1.72

50.29

40.27

-10.02

59.72

50.87

-8.85

10

Manzo

2

56.52

64.10

7.58

58.39

56.39

-2.00

52.17

55.03

2.86

23

Manzo

4

44.09

47.76

3.67

40.80

49.39

8.59

51.43

53.87

2.44

7

Schumaker

2

72.27

77.65

5.38

68.74

84.20

15.46

65.87

78.48

12.61

17

Schumaker

4

56.43

59.27

2.85

53.55

67.88

14.33

42.15

65.70

23.55

4

Ochoa

2

54.07

60.66

6.59

67.68

62.63

-5.05

66.82

66.60

-.22

13

Cavett

2

60.55

60.95

.40

55.10

51.96

-3.14

42.04

40.27

-1.77

21

Cavett

4

43.14

43.42

.28

23.72

37.14

13.42

26.29

33.41

7.12

10

Myers/Ganoung

2

61.63

64.72

3.09

58.76

62.36

3.60

59.02

66.84

7.82

23

Myers/ Ganoung

4

56.42

57.62

1.21

55.73

56.43

.71

51.90

50.00

-1.90

12

Grijalva

2

57.14

58.73

1.59

45.70

46.98

1.28

39.36

45.40

6.04

9

Grijalva

4

37.10

20.00

-17.10

28.60

42.90

14.30

11.40

25.70

14.30

1

Davidson

2

72.46

74.29

1.83

68.79

75.50

6.71

73.46

75.11

1.65

14

Davidson

4

49.53

56.50

6.97

58.08

62.22

4.14

39.06

53.64

14.59

9

Kellond 

2

75.36

73.30

-2.05

71.69

72.67

.98

68.57

76.17

7.60

32

Kellond 

4

60.71

61.66

.95

58.93

64.17

5.25

57.02

62.51

5.48

24

Kellond 

6

37.10

42.90

5.80

57.10

48.60

-8.50

48.60

71.40

22.80

1

Fort Lowell

2

66.47

73.60

7.13

67.07

72.47

5.41

64.73

67.82

3.08

38

Fort Lowell

4

57.14

63.99

6.85

59.08

60.11

1.03

61.26

61.49

.23

25

Borton

2

27.63

45.70

18.07

28.57

47.63

19.07

40.97

41.90

.93

3

Booth

2

70.13

83.09

12.96

72.26

83.80

11.54

70.00

81.78

11.78

24

Booth

4

54.29

55.30

1.01

55.62

59.00

3.38

50.77

61.01

10.24

17

Jefferson

2

68.08

72.78

4.70

81.52

85.37

3.85

74.29

78.32

4.02

17

Jefferson

4

67.42

70.30

2.88

52.58

58.86

6.28

61.70

71.42

9.72

5

Cragin

2

56.30

75.13

18.82

58.69

58.22

-.47

61.54

62.73

1.19

24

Cragin

4

48.76

52.19

3.43

48.19

53.33

5.15

42.29

45.71

3.43

15

Wheeler 

4

43.58

49.28

5.70

52.85

52.13

-.73

54.28

45.73

-8.55

4

Roberts 

2

43.42

41.14

-2.28

42.28

68.58

26.30

33.72

33.14

-.58

5

Roberts 

4

51.04

55.11

4.07

39.79

36.34

-3.45

38.36

39.19

.84

14

Lynn/Urquides

2

59.04

65.24

6.19

50.16

49.52

-.64

43.17

52.21

9.04

18

Lynn/Urquides

4

40.88

39.67

-1.21

44.06

39.45

-4.61

30.01

32.52

2.51

26

Brichta 

2

77.40

73.90

-3.51

79.35

80.78

1.43

74.81

77.27

2.46

22

Brichta 

4

45.14

44.58

-.56

40.87

44.56

3.69

34.85

35.16

.31

10

Richey

2

63.43

68.58

5.15

76.29

76.28

-.01

61.99

64.85

2.86

10

Richey

4

43.58

51.06

7.49

57.15

54.29

-2.86

44.30

46.41

2.11

8

Menlo Park

2

55.32

68.32

13.00

78.71

65.97

-12.74

57.65

58.69

1.05

11

Menlo Park

4

43.18

47.31

4.13

32.38

38.74

6.37

48.24

46.36

-1.89

9

Tolson

2

34.64

43.56

8.93

37.14

46.79

9.65

28.95

45.35

16.40

8

Tolson

4

35.73

34.66

-1.06

31.43

28.59

-2.84

28.93

29.29

.36

8

Dunham

2

65.29

71.42

6.14

58.00

67.00

9.01

66.57

70.00

3.43

20

Dunham

4

58.91

53.94

-4.98

55.00

52.15

-2.85

51.08

55.00

3.93

8

Bonillas

2

68.60

82.90

14.30

77.10

77.10

0.00

62.90

80.00

17.10

1

Howell

2

65.99

80.37

14.38

71.60

80.18

8.58

70.51

73.64

3.14

31

Pretest – Posttest Comparison on the
CCSA for Matched Elementary School Students

School

Grade

Mathematics

Reading

Writing

N

 

 

Pre

Post

Gain

Pre

Post

Gain

Pre

Post

Gain

 

Howell

4

56.82

54.93

-1.89

42.86

52.07

9.21

42.21

51.11

8.90

9

Erickson

2

79.53

75.24

-4.30

66.92

64.53

-2.39

76.66

74.76

-1.90

24

All Elementary

 

60.29

64.35

4.06

59.39

62.21

2.82

56.73

60.79

4.05

688

Pretest – Posttest Comparison
For Matched Middle School Students

School

Grade

Mathematics

Reading

N

 

 

Pre

Post

Gain

Pre

Post

Gain

 

Valencia

6

2.00

39.00

37.00

27.65

38.15

10.50

2

Valencia

7

2.00

48.00

46.00

57.90

76.30

18.40

1

Carson

6

46.44

43.56

-2.87

52.97

58.96

5.99

32

Carson

7

58.72

61.79

3.08

56.49

63.71

7.22

39

Carson

8

64.00

60.00

-4.00

63.20

63.20

0.00

1

Roskruge

6

56.43

47.71

-8.71

55.64

60.16

4.53

14

Roskruge

7

47.25

47.25

0.00

56.74

57.40

.66

16

Roskruge

8

41.00

26.00

-15.00

47.40

53.95

6.55

2

Hohokam 

6

37.37

38.32

.95

46.26

51.12

4.86

38

Hohokam 

7

40.00

38.40

-1.60

43.68

52.10

8.42

5

Hohokam 

8

27.00

27.00

0.00

36.85

44.70

7.85

2

Dodge

6

62.59

64.51

1.92

63.57

66.48

2.91

105

Dodge

7

74.80

70.64

-4.16

63.79

67.18

3.38

25

Dodge

8

87.00

83.00

-4.00

67.15

68.45

1.30

2

Doolen

6

48.06

53.31

5.25

54.20

55.92

1.73

32

Doolen

7

44.53

54.88

10.35

55.80

59.84

4.04

34

Doolen

8

55.00

61.60

6.60

57.90

62.11

4.21

10

Utterback

6

52.94

50.08

-2.86

55.43

59.78

4.35

49

Utterback

7

52.95

59.10

6.14

58.16

61.10

2.95

42

Utterback

8

51.71

56.00

4.29

54.91

55.64

.73

7

Gridley 

6

55.40

59.50

4.10

58.42

63.17

4.74

20

Gridley 

7

66.00

68.92

2.92

64.48

65.90

1.42

26

Gridley 

8

74.91

76.00

1.09

69.15

65.08

-4.06

11

Fickett 

6

46.17

63.33

17.17

59.23

63.38

4.16

24

Fickett 

7

56.29

69.24

12.94

58.13

62.93

4.80

34

Fickett 

8

70.00

80.15

10.15

63.58

65.39

1.82

13

Townsend

6

55.50

53.90

-1.60

52.38

55.01

2.63

20

Townsend

7

47.33

52.83

5.50

50.44

61.19

10.75

12

Townsend

8

61.00

75.00

14.00

56.55

60.55

4.00

2

Naylor

6

47.75

50.75

3.00

54.29

57.25

2.96

8

Naylor

7

54.50

51.33

-3.17

48.01

50.66

2.65

12

Naylor

8

52.00

49.69

-2.31

54.65

56.68

2.02

13

Pistor

6

47.56

46.73

-.83

54.83

53.93

-.90

41

Pistor 

7

44.67

44.93

.27

58.43

58.95

.52

15

Pistor 

8

34.00

26.00

-8.00

60.55

55.25

-5.30

2

Safford 

6

44.75

42.42

-2.33

51.00

54.39

3.39

24

Safford 

7

54.69

54.31

-.38

51.83

58.11

6.28

26

All Middle Schools

 

53.64

56.14

2.50

56.76

60.26

3.50

761

Pretest – Posttest Comparison on CCSA
Math for Matched Middle School Students

School

Mathematics

N

 

Pre

Post

Gain

 

Pueblo

39.67

43.88

4.21

48

Catalina

30.68

44.32

13.63

38

Cholla

31.74

34.17

2.43

47

Sahuaro

39.89

41.78

1.89

18

Santa Rita

37.60

50.16

12.56

50

Palo Verde

39.24

41.36

2.11

87

Rincon

44.59

48.67

4.07

27

Sabino

41.15

47.69

6.54

52

All High School

37.92

43.73

5.80

367

Pretest – Posttest Comparison on CCSA
Reading for Matched Middle School Students

School

Reading

N

 

Pre

Post

Gain

 

Catalina

50.30

47.50

-2.80

20

Cholla

55.68

49.42

-6.26

38

Santa Rita

65.57

59.52

-6.04

46

Palo Verde

56.93

46.65

-10.28

43

Rincon

64.55

57.64

-6.91

11

Sabino

42.00

24.00

-18.00

4

All High School

58.42

51.25

-7.17

162

Pretest – Posttest Comparison on CCSA
Writing for Matched Middle School Students

School

Writing

N

 

Pre

Post

Gain

 

Catalina

49.46

53.16

3.70

5

Cholla

49.59

50.10

.51

25

Santa Rita

61.85

54.87

-6.98

46

Palo Verde

59.12

53.38

-5.74

56

Rincon

60.29

62.93

2.64

11

Sabino

50.65

28.95

-21.70

4

All High School

57.88

53.33

-4.55

147

High school data was not broken out by grade since all high school students took the ninth grade test and there was no way to indicate the grade of the student on the form.

Top of Page

Last updated 2/15/06