Friday, November 2, 2012

A LYSer Writes... Accountability, A Reasonable Plan - Part 1


In response to the 8/31/2012 post, “Accountability – A Reasonable Plan,” an old school LYSer writes:

As with any plan, the devil is in the details, which are not discussed in the Cain Plan.  Nonetheless, some initial observations.

1. That is still a lot of testing.  In fact, there is no significant difference in your testing strategy than the one the State already uses.  The current State testing protocol destroys 45 days of instruction. I do not consider 45 days of testing in the school year as "reasonable" or anywhere in the vicinity of reasonable.  The days of testing required for the amount of tests in your plan do not include the "mandatory" field tests, i.e., the process where our children provide free labor to Pearson.  Nor do the days include ACT, SAT, AP, ASVAB, summer retests, or any other test commonly given.

2. The Cain Plan still tests a high school curriculum that is largely irrelevant to the majority of children.  There is no reason on Earth for every child (or even the majority of children) to learn advanced algebra, advanced physics, and advanced chemistry concepts.  Of course the Cain Plan does use the phrase "teach the appropriate content," so maybe the content is flexible?

3. Although not stated, the Cain Plan implies that the once a year test will remain the standard by which schools are measured.  This ignores the fact that the child may indeed pass the exam on the very next administration.  The Cain Plan takes the poor design of teacher grades discussed in literature (and indeed, Cain himself discusses it), and assigns the poor design to the accountability plan proposed.  Rating schools on one test at the end of the school is a grade on how fast the children learn, not what they learn.  Granted, schools can't take years to get children through each grade, so there has to be some standard of time, but the "on a given day" premise is not reasonable.

4. I have no particular issue with the 2% number given, although it seems arbitrary.  I suppose it comes from a Gaussian distribution where basically ~98% of students are encompassed within two standard deviations to the left (or right) of the mean?   

5. The Cain Plan has high standards indeed.  The Acceptable rating requires performance that very few high schools ever accomplished under TAKS, much less STAAR.  I remember counting the number of Exemplary high schools in the state several years ago.  Of the traditional public, open enrollment, non-magnet high schools in the state, there were fewer than 10.  The Cain Plan also has a standard of 70%.  Now I know for a fact Sean is well versed in mathematics.  To get 70% of the questions correct on a standardized test is indeed a high standard.  Since standardized test are by definition "standardized", meaning the distribution is analyzed and adjusted, sticking to the arbitrary tried and true 70% does not seem reasonable.  We will need some other testing design.  Pearson will love it. Not reasonable.

6. Finally, although not stated, it is certainly implied in Cain's Plan that school's ratings would remain 100% determined by a single day test score AND the school can not be rated any higher than the lowest performing sub-population.  Again, that is not significantly different (indeed it is no different) than what we already have, and I don't find it reasonable. This design leads to a severely skewed school rating, which gives parents and the general public a confusing, non-useful metric of schools.

SC Response
This was an awesome, reasoned response.  Let me address your issues, point by point.

Point 1 – Too Much Testing: Agreed, we spend entirely too much time testing, to the detriment of teaching (note: we also self-inflict a lot of other activities to the detriment of teaching). The current testing calendar in Texas is a joke.  In other states, the summative test is administered at the beginning of the year.  I have no idea how that was ever decided on. I'm a proponent of end of the course, summative assessment.  I believe that most of these tests could be scheduled during a two-week window in May.   At the HS level, if electronic testing would be adopted, you could test at the end of the course, at any time (trimester or semester).

Point 2 – An Irrelevant Curriculum: If the state mandates the course and articulates the standard, we are accountable to teaching it.  If the state believes that an adequate education can be provided without teaching Algebra II, advanced science, etc., my personal opinion on the matter is irrelevant.

Point 3 – The One-Shot, High Stakes Test: One thing that Texas did correctly (early on, since abandoned), was allowing elementary students two chances to pass the reading test and the math test, without penalty. I believe the retest option is critical and schools and students should get full credit for a second attempt pass.  This would go a long way in reducing some of the pressure that students and adults have to deal with in the current, one shot for all the marbles testing environment. It would give credence to the fact that the speed of learning is less important than actually learning.

Point 4 – An Arbitrary Exemption: Agreed, 2% is an arbitrary cutoff. But as you point out, 2% fits into a reasonable distribution pattern.  I can live with 4%. But what I cannot condone is testing a student who is multiple standard deviations from the mean.  This borders on cruel and it is certainly unreasonable.

Point 5 – The Standardized Test: There's the rub, I'm not advocating a "Standardized" test. The using of a “standardized” test for accountability purposes is inherently unfair.  As those who work in the most adverse of education settings can attest. What I'm advocate for is an assessment that is based entirely on the content that was supposed to have been taught. Essentially, a final exam composed of valid assessment items.  If we teach the content we are suppose to teach and students cannot get 70% of the answers correct, then we have either a teaching or learning issue occurring in the classroom, that must be addressed. As a professional educator, all I'm searching for is an indicator of instructional quality and concept mastery.

Point 6 – You are Only as Good as Your Weakest Link: I also struggle with the reality of this.  The one low performing sub-pop rubric is tough.  But you and I both know that when a sub-pop doesn't count, those students are consistently underserved and not one adult loses a wink of sleep.  On the other hand, I've yet to see an accountability system that pushes an affluent schools to step up its game.  What I want is a system that pushes everyone to get to strive for the highest accountability levels.  

Notice that we haven't even begun to address equitable funding, the effect of "cherry-picking" enrollment practices, alternative schools, and other attempts to game the system. That's when the discussion really begins to sting.

Think. Work. Achieve.
Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Call Jo at (832) 477-LEAD to order your campus set of “Look at Me: A Cautionary School Leadership Tale” Individual copies available on Amazon.com!  http://tinyurl.com/lookatmebook 
  • Now at the Apple App Store: Fun 5 Plans (Fundamental 5 Lesson Plan Tool); PW Lite (Basic PowerWalks Tool); PW Pro (Mid-level PowerWalks Tool) 
  • Upcoming Presentations: Region 10 ESC Fall Leadership Conference (Keynote), TASSP Assistant Principals’ Workshop (Featured Speaker), American Association of School Administrators Conference (Multiple Presentations), National Association of Secondary School Principals Conference (Multiple Presentations)
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation

No comments:

Post a Comment