Showing posts with label Data Analysis. Show all posts
Showing posts with label Data Analysis. Show all posts

Thursday, February 9, 2017

Just Measure It

A lot of the school leaders and educators that I work with are new to concept of constant, incremental growth. 

Quick side notes: 1) Slow and steady progress beats the “Lightning Bolt” nine times out of ten. 2) Lighting bolts happen once. If you get one, great! That gives slow and steady a head start.

Central to the slow and steady growth construct is measuring results for the purpose of honing process.  Easy is theory, harder in practice.  Because what trips everyone up is the problem of what to measure?  In many cases the initial answer to the problem is, “who knows?”

In this situation, follow the advice of Jim Collins (Good to Great). 

When you don’t know what to measure, make your best guess. Measuring something poorly or even measuring the wrong thing is first step in understanding how to measure it better in the future. 

Think. Work. Achieve.
Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Upcoming Conference Presentations: TASSP Aspiring Principal Workshop (Multiple Presentations 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Friday, November 4, 2016

A Reader Asks... The Timed Checkpoint

A reader asks the following:

SC,

We are new to using the LYS Short-term Trend Analysis Form in our PLCs.  At our last meeting there was much debate over the time allotted to giving the quick 10-question checkpoint. We allow 30 minutes for the checkpoint, but the instructional leaders at campuses feel that many of their students need 40-minutes or more to complete.  They believe that taking up an assessment before students have had time to complete it is "demoralizing" to some of our students.  

Please explain the significance of keeping with the time limit, or is it okay to extend?

SC Response
What you describe is common and predictable pushback.

First, let me line out an assessment schedule for you:

Week 3: Checkpoint (30 minutes or less) (campus use)
Week 6: Checkpoint (30 minutes or less) (campus use)
Week 9: Mid-term (45 minutes or less) (district and campus use)
Week 12: Checkpoint (30 minutes or less) (campus use)
Week 15: Checkpoint (30 minutes or less) (campus use)
End of Semester: Final (90 minutes or less) (district and campus use)

Week 21: Checkpoint (30 minutes or less) (campus use)
Week 24: Checkpoint (30 minutes or less) (campus use)
Week 27: Mid-term (45 minutes or less) (district and campus use)
Week 30: Checkpoint (30 minutes or less) (campus use)
Week 33: Checkpoint (30 minutes or less) (campus use)
End of Course: Final (90 minutes or less) (district and campus use)

Notes: (a) If a STAAR test is administered in the course the week before, or the week of a checkpoint, SKIP the checkpoint. (b) A practice STAAR test can be substituted for the week 27 mid-term. (c) If it is a STAAR tested class, skip the second semester final and replace it with a final checkpoint.

Second, ask just enough questions that can reasonably be answered in the time frame of the assessment.  Which means for: (a) Checkpoints, it will generally be 10 of fewer questions. (b) Mid-terms, it will generally be 20 or fewer questions. (c) Finals, it will be 30 or fewer questions.

Third, in the STAAR environment, test taking fluency and pacing are critical. Adhering to the allotted testing time hones student processing skills and gives teachers critical information on student problem solving fluency.  If the issue is too many questions for the time frame, reduce the number of questions.  If the issue is inadequate student processing speed, that is instructional information that is vital for the teacher.  

Additionally, the short, timed checkpoint protects instructional time.  Teachers argue that they do not have enough time to teach the required content.  If this is the case, then in the classroom the best solution is to teach a lot, assess quickly, adjust, and repeat. 

Finally (and this upsets teachers), demoralized students are more a function of the teacher, not the student.  If the teacher communicates that the uses of checkpoints are progress gauges and growth indicators, then the “grade” has less significance. If the teacher communicates that the highest score (grade) is the goal, then “low” scores are bad.  What are your teachers communicating?

Implementing the checkpoint process correctly is hard work.  If it were easy, everyone would do it.  It boils down to this question, “Do you want to use your checkpoints to sort kids (traditional practice) or improve adult practice (exceptional practice)?”

I hope this better clarifies the process.

Think. Work. Achieve.
Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Upcoming Conference Presentations: TASSP Aspiring Principal Workshop (Multiple Presentations), Learning for a Change Spring Summit (Keynote and Multiple Presentations)
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Wednesday, August 24, 2016

Use Your Data Better This Year

Most schools and educators use student performance data to sort students.  The students take some sort of assessment (it doesn’t matter at what level, classroom to entire state), the school gets the results and teachers start sorting.  You know the groups... Super Stars, Above Average, Average, Below Average, Maybe With Devine Intervention.

Here’s the thing, if performance data is only used to sort students there is only one predictable outcome.  The group of students who don’t meet standard will continue to grow over time.

Exceptional schools don’t use student performance data to sort students (at least it is not the main activity). Instead, exceptional schools use student performance data to drive adult practice.  Once you understand that it is adult practice that drives student performance then you realize that the analysis of student performance data provides educators with four critical pieces of information.

1. Is classroom instruction aligned with the pace of the district’s scope and sequence?

2. Is classroom instruction aligned with the rigor  of the district’s scope and sequence?

3. Which instructional practices seem to work best with the school’s students?

4. Which instructional practices are seemingly less effective with the school’s students?

Use your students performance data to determine the answers to the above questions and then adjust accordingly and your students will begin to outperform the students of the sorters.

Think. Work. Achieve.
Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: LYS / TASSP Advanced Leadership Academy (Keynote); The 2016 Texas Charter School Conference (Multiple Presentations); The 4th Annual Fundamental 5 National Summit (Keynote) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Tuesday, March 1, 2016

Top LYS Tweets From the Week of February 21, 2016

If you are not following @LYSNation on Twitter, then you missed the Top 10 LYS Tweets from the week of February 21, 2016 when they were first posted.  And if you are on Twitter, you might want to check out the Tweeters who made this week’s list.

1. To the principal who has the school take benchmarks for 4 days straight to get good data, here's some data for you. You're now four days behind. (By @LYSNation)

2. Leadership is a service. Service comes with sacrifice. No sacrifice, no service, no leader. (By @JohnSchu76)

3. Perfection is not attainable, but if we chase perfection we can catch excellence. (By @CoachKWisdom)

4. The secret to success is doing the stuff other people won't do, and doing it for a really long time. - John Jantsch (By @JReynaldHebert)

5. "Assessments are only as good as the actions that arise from them." (By @norskireader)

6. Kids can't write what they have never read. READ. Then, read more. And, for good measure, read a little more. (By @KyleneBeers)

7. "Readers get good at reading when they read a lot!” says Lucy Calkins. (By @EvanPayneGCISD)

8. People of mediocre ability sometimes achieve outstanding success because they don't know when to quit. - George Allen (By @CoachMotto)

9. Legacies aren’t born; they’re built. (By @UHouston)

10. Just got the notice that, The Fundamental 5 (Cain & Laird), has officially passed 82,000 copies sold! Thank you, LYS Nation!! (By @LYSNation)

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: Texas Association of Secondary School Principals Conference (Multiple Presentations); Texas Elementary Principals and Supervisors Association Conference (Multiple Presentations); LYS / TASSP Advanced Leadership Academy (Keynote) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook


Thursday, December 10, 2015

Lose the Battle, Win the War

With 3-week checkpoints, if they are administered correctly, the assumption should be that performance will be lacking.  After all we are asking high rigor questions almost immediately after students have been first exposed to the content.  As long as the poor performance is not due to being off pace, everything else can (and generally will) be corrected over the course of the school year. 

There are of course ways to “cheat” at checkpoints.  Most prevalent are to review for the checkpoint, extend time on the checkpoint, or not count the questions that were missed due to pacing setbacks. This gives the illusion of success when the reality is not as rosy.

Our advice to schools is “Lose the Battle. Win the War.” The battle being the checkpoint, the war being the state accountability test.

When we don’t “cheat” the checkpoint, we are able to determine if we are on pace, what is working, and what is not. With this information, we problem solve and adjust, putting us in a better position to meet the requirements of the state accountability tests.

When we “cheat” the checkpoint, we believe that everything is working as it should.  We don’t adjust and then we are sandbagged by the state tests.  So play it honest. Lose the Battle, Win the War. And if you doubt the strategy, it worked for both Sam Houston and George Washington.

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: American Association of School Administrators Conference; National Association of Secondary School Principals Conference (Multiple Presentations) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Thursday, November 19, 2015

A Reader Asks... Better Checkpoint Implementation

A LYS Principal asks the following questions. I will embed my answers after each question for easier reading.

SC,

I love the daily e-mails addressing improving schools (The LYS Nation Blog) and love The Fundamental 5 (Cain & Laird) and The Foundation Trinity (Cain).  As you know I have moved to a new district and I have a couple of questions about the 3-week Checkpoints we are implementing on my new campus this year.

1.  My teachers are having a difficult time "creating" their mini-assessments (Checkpoints) for each 3-week period.  We admit that we are not test writers.  We have lots of resources but finding stems with answer choices over the TEKS taught to that point has caused difficulties for us.  This is especially true in the area of Reading. 

SC: This is the most difficult part of the assessment process.  The easiest way to tackle this is to:

A. Map the curriculum in 3-week increments, identifying the critical TEKS that must be taught in the 3-week window. The YAG provides too broad of a brushstroke.

B. Identify questions that assess the identified TEKS.  STAAR release tests, district benchmark tests, TEKS Resource System unit tests (if you saved them), and test banks are the place to start.  A teacher actually writing checkpoint questions is the last resort. 

C. With reading assessments, identifying good reading passages is the first step.  Look for passages that can be used for numerous questions on a given assessments and used on multiple assessments.  Remember, with a hot read (a passage a student has seen before) you can ask more questions and more difficult questions in a given testing time.

2.  What are your suggestions for review of the mini-assessments while maintaining the pace of the YAGs (Year At A Glance pacing guide)?

SC: Do not review for an assessment.  To do so means that the Checkpoints are actually assessing the quality of the review, not the quality of first instruction.  Do not review after the assessment.  Instead re-teach the deepest holes over the course of the next 3-weeks.   

3.  Do you recommend DMAC (a data analysis tool) for data analysis for each mini-assessment (Checkpoint)?  If not, what should we use?

SC: No. In-depth data analysis of 3-week assessment data is a waste of time. The data sample is inherently unstable.  Instead, do a quick 1-page trend analysis, adjust, and move forward (LYS has a process it trains campuses to use).  Save the heavy data analysis for the Fall Finals and EOC / Spring Finals.

4.  What do you recommend for transparency of student/teacher data and do you have recommendations on how to keep it meaningful but not losing the valuable instructional time.

SC: There should be team transparency of assessment data.  However this should be implemented in a purposeful and methodical manner.  Doing it too early, when the data is overwhelmingly invalid destroys trust.

5. Thank you for you input.  I realize these are loaded questions.

SC: Yes, I realize these were loaded questions.  I do suggest that you schedule a LYS Coach to come to your campus and meet with your leadership team and lead teachers and walk them thru the process.  The LYS Coach will let your team know where they are on the right track, what corrections need to be made, and if the adversity you are dealing with is normal or unique.

I hope to hear from you soon.

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: American Association of School Administrators Conference; National Association of Secondary School Principals Conference (Multiple Presentations) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Friday, October 23, 2015

A Reader Writes... Data Crunching - Part 1

In response to the 10/15/15 post, “A Reader Asks... Data Crunching – Now What,” a LYS Principal writes:

SC,

Really, the administrator should be coaching the teacher on what to look for...

Just sayin'.

The conversations should grow to be teacher-led and occur collaboratively within the content team. Over time, the administrator (hopefully sooner rather than later) becomes the guide on the side. Highlighting (if necessary) the trends to not be missed, guiding discussion points, and keeping the focus on using data to drive instructional decision making. 

If a principal thinks she is the sole source for data analysis, she needs to get past that quickly and distribute that leadership throughout the team and “coach” the analysis process.

But bottom line, “Do – Dig - or Die Trying”....

SC Response
I like your answer better than mine. So... “What she said.”

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: The Fundamental 5 National Summit (Multiple Presentations); American Association of School Administrators Conference; National Association of Secondary School Principals Conference (Multiple Presentations) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook