Friday, November 13, 2009

Debating College for All

It's easy to get lost in the excitement over what appears to be a New Deal for higher education. This was an exciting year, what with the nation's president stepping forward with substantial goals to increase college attainment, heavily invest in community colleges, and reform the financial aid system. The message is loud and quite clear: more Americans should be thinking about college and moving towards enrollment.

But is the message the right one? The Chronicle Review recently tackled the issue by asking a variety of experts to weigh in on this question: are too many students going to college? The answers from folks ranging from Richard Vedder to Sandy Baum were varied and thoughtful, but some of the most difficult questions and concerns weren't raised. Perhaps it's because even saying some things feels like opening Pandora's box. By articulating questions we don't have easy answers to, we create the possibility that policymakers will too-quickly address them, without engaging in the really hard prerequisite discussions. Even so, there's more that needs to be said-- so here forgive me as I close my eyes and throw more fuel on the fire:

Q: "Are too many students going to college?"

1. The question implies a focus on a critical threshold, an approach that seems appropriate only if one believes the ultimate goal is to produce a college-educated workforce of a certain absolute size or proportion of the population. This belies an assumption that the purpose of college attendance is primarily economic. Think about how the question (and the answer) changes if we instead ask: Are there meaningful disparities in college-going, and if so why?

2. Consider your reaction to #1, and then ask yourself: Why are we (the public) more attracted to (and/or comfortable with) justifications for college-going based on economic competitiveness and return on investment than with justifications based on social mobility and inequality?

3. On the other hand: Why are we pushing everyone to become part of the middle-class by attending college? What does that say about how we value the working class?

4. If we're really concerned with inequality in higher education, are we trying to ensure equality of opportunity (access) or equality of outcomes (degree completion)? If it's the latter, what are we willing to tolerate in order to achieve that goal?

5. Are we moving towards a societal embrace of college-as-privilege to college-as-right? If so, how does that change the debate about who should pay for higher education?

6. Given massive increases in college-going and changes in the composition of college-goers, could our current completion rates be interpreted as an achievement, rather than a failure? What completion rate should we expect, and tolerate, in an even more broadly open system?

These are tough questions, and based on some recent conversations I can tell you that at least a segment of the population is pondering them. But we're pondering quietly, perhaps because where the places these concerns take us are dark ones-- cobwebbed-corners of ambiguity and self-doubt. To make the best policy judgments, however, we need to find our way there and linger, at least a little longer.

Thursday, November 12, 2009

Race To The Top: Under The Hood

My colleagues and I at the New Teacher Center submitted revised language during the public comment period to strengthen proposed Race to the Top (RttT) regulations. (8/28/2009: "RttT: Redefining Teacher Effectiveness".) I am delighted that most of our suggestions were adopted. Specifically, three changes I am pleased to see in the final RttT regulations and state application released by the U.S. Department of Education today are:

(1) A focus on multiple measures in teacher evaluation.

We have defined effective teacher to mean “a teacher whose students achieve acceptable rates (e.g., at least one grade level in an academic year) of student growth (as defined in this notice). States, LEAs, or schools must include multiple measures, provided that teacher effectiveness is evaluated, in significant part, by student growth (as defined in this notice). Supplemental measures may include, for example, multiple observation-based assessments of teacher performance.”

We have revised criterion (D)(2)(ii) to read, “Design and implement rigorous, transparent, and fair evaluation systems for teachers and principals that (a) differentiate effectiveness using multiple rating categories that take into account data on student growth (as defined in this notice) as a significant factor, and (b) are designed and developed with teacher and principal involvement.”

(2) A stronger focus on school leaders and the inclusion of positive teaching and learning conditions in the definition of effective principal.

We have changed the definition of effective principal as follows: (a) replaced “States may supplement this definition as they see fit” with “States, LEAs, or schools must include multiple measures;” (b) added ”Supplemental measures may include, for example, high school graduation rates and college enrollment rates, as well as evidence of providing supportive teaching and learning conditions, strong instructional leadership, and positive family and community engagement;” and (c) replaced “so long as principal effectiveness is judged, in significant measure by student growth” with “provided that principal effectiveness is evaluated, in significant part, by student growth.”

(3) Greater attention to the need for high-quality teacher induction, mentoring and professional development.

We agree that induction programs and coaching by accomplished teachers and principals can be important and effective strategies for supporting novice teachers and principals upon their entering the profession. We are revising the criterion to clarify that States’ plans in response to this criterion should provide for coaching and induction programs as supports for teachers and principals. Changes: We have revised criterion (D)(5)(i) to clarify that plans should include providing effective, data-informed “coaching” and “induction.”

We agree that professional development, including mentoring and coaching, are important aspects of teacher effectiveness. For this reason, criterion (D)(2)(iv)(a) focuses on using evaluations to inform decisions regarding developing effective teachers and principals, including by providing relevant coaching, induction support, and/or professional development. Criterion (D)(5) also provides for evaluation of the extent to which a State has a high-quality plan for its participating LEAs to provide effective, data-informed professional development, coaching, induction, and common planning and collaboration time to teachers and principals.

Sources of great analysis on the final RttT regulations here:
  • Education Week (Michele McNeil): "Rules Set for $4 Billion 'Race to Top' Contest"
  • New York Times (Sam Dillon): "After Criticism, The Administration Is Praised for Final Rules on Education Grants"
  • Teacher Beat: "Teacher Elements of Final Race to the Top Guidelines"
  • Eduflack: "Just The Race Facts"
  • Eduflack: "The Race Officially Begins ... Now"
  • Eduwonk: "Racing To The Top"

On Your Marks, Get Set ... Go!

The U.S. Department of Education this morning posted final regulations and the state application for the Race to the Top program. Have at it.

More analysis later hopefully ... but a generally positive set of changes to the proposed criteria originally released by the Department over the summer.

Monday, November 9, 2009

Can Baby Steps Win the Race To The Top?

It looks like the state of Wisconsin may become the canary in the coal mine with regard to data firewalls and the Race to the Top (RttT) competition. Last week, the State Legislature passed legislation, signed today by the Governor, that theoretically removes Wisconsin's statutory firewall restricting the use of student achievement data in teacher evaluations. I say theoretically because the bill prevents student test data from being used to discipline or dismiss teachers. And it requires that any changes to teacher evaluation systems be bargained separately in each of the state's 426 school districts.

A quote (included in the Wisconsin State Journal's editorial criticizing the legislation) from John Ashley, executive director of the Wisconsin Association of School Boards, is damning:
"The language that's being presented is more interested in protecting teachers," Ashley said. "It doesn't seem to be in the spirit of what the secretary and the president were talking about."
It seems like the state made the fewest number of changes possible to at least try to create the appearance of reform without actually guaranteeing any real reform will take place. Perhaps it was done with legislative vote counting in mind. Perhaps it was done due to an honest disagreement with the teacher evaluation requirement of RttT. Perhaps it was done because the Wisconsin Education Association Council (WEAC) -- the state teacher's union -- likely would have opposed greater changes and its support was needed to get Democratic votes. The biggest cynics might say that the state is guilty of racing to the trough, chasing money without abandoning the status quo, and that WEAC could decide to recommend that its locals oppose ANY use of student achievement data in teacher evaluation.

Personally, I am not opposed to evaluation being subject to collective bargaining. Getting teachers' buy-in to any evaluation system and, even more ideally, jointly designing a system with teachers is preferable to subjecting them to an undesired one. At the same time, I believe that student learning must come into play as one of multiple factors in teacher evaluation and that states are the appropriate actors to draw that line in the sand. This, too, is what the U.S. Department of Education's proposed RttT regulations require. Wisconsin's bill does not guarantee it. What would have made this bill meaningful would have been the inclusion of an affirmative requirement (a 'shall' rather than a 'may') that student learning be a factor in teacher evaluation. To not go that far statutorily suggests that Wisconsin's baby steps may not help it reach the Top.

The Education Department will soon have its say when it evaluates the first round of RttT applications in early 2010. Final RttT regulations could be issued as early as mid-week.

See Teacher Beat's post here. (Great seeing Stephen at APPAM in DC last week!)

See background from the Education Optimists here, here, here, here, and here.

UPDATE (Wisconsin State Journal, 11/10/2009): Let the controversy erupt...

Friday, November 6, 2009

Using Value Added to Assess Teacher Effectiveness

The Association for Public Policy Analysis and Management -- an organization not widely known outside of academia and technical policy circles -- puts on truly meaty conferences. I've attended three APPAM conferences to date, including the Annual Fall Research Conference going on in Washington, DC this week.

Education is merely one strand at APPAM, but the sessions feature some of the biggest names in educational research addressing some very policy relevant issues. The current conference features sessions on value-added modeling, school choice, teacher certification and teacher induction, teacher performance pay, financial aid, college persistence, and more.

The session I attended yesterday on "Using Value Added To Assess Teacher Effectiveness" was excellent. It featured four papers each of which I will undoubtedly oversimplify in this brief blog post. (I encourage you to seek out the papers and read them closely -- below I've linked to those that are available.) One by Dan Goldhaber and Michael Hansen (University of Washington) suggests that year-to-year correlations in value-added teacher effects are modest, but that pre-tenure estimates of teacher job performance do predict estimated post-tenure performance in both math and reading. A second by Julian Betts (UCSD) and Cory Koedel (University of Missouri-Columbia) suggests that bias does exist in value-added models due to student sorting, but that it can be overcome through the use of multiple years of value-added data; further, the study suggests that data from the first year or two of classroom teaching may be insufficient to make reliable judgments about teacher quality. A third by Michael Weiss of MDRC suggests that that teacher variability carries implications for measuring program effects within randomized controlled trials when those teachers are not randomly assigned. And a fourth by John Tyler (Brown University) and Tom Kane (Harvard University) found that teacher assessments made using classroom observation rubrics (such as Charlotte Danielson's) are closely aligned with value-added ratings of teachers.

Tuesday, November 3, 2009

A Little Obama Effect

This is awkward. My 2 1/2 year old son is paying attention to politics and presidents, and as his parents we couldn't be more proud. Except for one problem. He's begun to call every non-white male he sees, "Obama!" As in (pointing) "Look Mama, there's Obama!"

Awkward. Sometimes the man is African-American, or in some cases Indian, or even Latino. In not a single instance has he actually been Barack Obama. (Yes, Obama comes to Madison tomorrow-- but Conor will be on his way to Washington so the two will miss each other.) But that doesn't stop Conor from being ever-so-proud to identify his neighbor, fellow airplane passenger, or even my co-worker as our current president.

Now what? (Seriously, now what?)

There's been plenty of talk about a positive "Obama effect" on America's children, the effect of a highly accomplished role model from a non-majority group. The President himself aspired to this when he decided to run for the country's highest office, telling his advisory team that this is what distinguished him from other candidates:

"When I take that oath of office, there will be kids all over this country who don't really think that all paths are open to them, who will believe they can be anything they want to be...and I think the world will look at America a little differently."

Well, as a white child of privilege (including two parents with graduate degrees and full employment) I have no doubt my son would've come up believing he could be or do anything-- regardless of who was president. But, living where we do-- in near lily-white Stoughton, Wisconsin-- I do worry about his lack of non-white role models. Sure, he'll be indoctrinated as a card-carrying liberal (after all my husband's a former executive director of Vermont's Democratic Party), but so what? Even the most hopeful and tolerant adults tend to have stereotypes formed by an absence of figures, as well as the presence of others.

Raised on the East Coast in a community full of Vietnamese and Latino families, it's often occured to me that my decision to work in Madison and live in Stoughton affects the quality of our life. In so many ways, it's completely a joy-- this place is affordable, quiet, and pretty. But when Conor shouts "Obama" I have to wonder...now what?

Monday, November 2, 2009

The Prison-Education Connection

An article in today's Chronicle Review covers a surge of scholarly interest in "prison studies." The author does a nice job of capturing key areas of research on this topic, though coverage of work by Bruce Western, Chris Wildeman, Alice Goffman, Nikki Jones, and Devah Pager would have deepened the portrait. For example, a discussion of Goffman's recent ethnography of men in Philadelphia could have illustrated how prison life (and the threat of life in prison) is intimately connected with how daily life--outside prison--is experienced by many of today's young urban men.

I just hope educators are paying attention. It's far too easy (and common) for scholars to focus on a single societal institution (like schools) to the exclusion of all others. But anyone committed to democratizing education must connect to the conversation on prison reform.

For example, here are two reasons why higher education researchers, practitioners, and policymakers should follow the debates over prisons:

(1) We want to find ways to broaden access to new populations and spread opportunities. Just 2% of those in state prisons and 8% of those in federal prisons have attained any form of college degree.

At least one study has found that after prison, African-American men are more likely to attend college, perhaps because they hope it will protect them from future participation in undesirable activities.

(2) College attendance during prison is associated with lower rates of recidivism (though evidence has not yet established the relationship as a causal one).

It is thus highly disconcerting that several recent education policies have made it more-- not less-- difficult to use prison time to enroll in postsecondary education and to access college after leaving prison. Consider the following

--Since the reauthorization of the Higher Education Act in 2000, the "aid elimination penalty" has blocked access to aid for adults with drug convictions. By one estimate, this rule has made over 200,000 students ineligible for federal grants, loans, and work study. While the penalty has since been reformed (currently, only students who receive drug convictions during college enrollment and do not pass two unannounced drug tests are ineligible for aid), some suggest that even in its current form it discourages college enrollment (because the financial aid application includes a question about drugs) and perpetuates dropout among vulnerable populations. Wheelock and Uggen write that "relative to whites, racial and ethnic minorities are significantly more likely to be convicted of disqualifying drug offenses and significantly more likely to require a Pell Grant to attend college...It is therefore plausible that tens of thousands have been denied college funding solely on the basis of their conviction status."

--Since 1994, Pell Grants may not be used to support college course-taking that occurs while in prison, a change that has made college much less affordable for that population. Yet at the same time, the number of state prison systems offering postsecondary education is rising (from 30 in 2002 to 43 in 2003-2004)--in Texas and North Carolina more than 10 percent of all inmates participate in some form of college coursework, typically offered by community colleges.

It's time for educators to start thinking hard about who isn't enrolled in their schools, and why. Looking to the ever-growing prison state in this country is a good place to start.