Showing posts with label Checkpoints. Show all posts
Showing posts with label Checkpoints. Show all posts

Wednesday, March 15, 2017

A Principal's Field Report... It's Happening!!!

A LYS Principal share the following:

SC,

I just completed a formal observation on one of my teachers.  I’m darn near giddy! The teacher embedded the Fundamental 5 throughout her lesson. This wasn’t for show, it was completely natural.

In our PLC meeting teachers are talking about their two deepest holes. Not as a complaint about the checkpoint, but looking for instructional causes that can be addressed. 

The district is introducing some Novice Reduction training where they explain to teachers the differences between direct instruction (DI) vs explicit direct instruction (eDI).   We just tell our teachers, “Keep getting better at The Fundamental 5 and you’ll exceed the District expectation.”

And our teachers get it! They can see that what we’re doing is now in front of the district. It’s awesome! We still have much to do, but progress…. Yay!!!

Visit Classrooms…  Beat Cancer!













Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Upcoming Conference Presentations: The National Principals Conference; The Fundamental 5 National Summit (Keynote)
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Friday, November 18, 2016

A School Asks... Common Assessments 101

A campus implementing the LYS Common Assessment model sent in the following implementation questions:

SC,

We have some concerns with the 30-minute time limit on common assessments.  For ELAR, there is a fair amount of reading a piece of text or multiple pieces of text before reaching the ten questions on the assessment.  As a department, we are ready to embrace the ten questions for an assessment.  Thirty minutes is not adequate time to read and annotate the text and then answer and justify/prove the answers.  Our question is can the students spend 20-minutes reading and annotating the passages and then give them the 30-minutes to answer the ten questions?  Additionally, how does this concept work with students who have IEPs stating that they receive extra time on assessments?

SC Response
Fantastic questions, and questions that prove the campus is really committed to making the common assessment process a valuable tool for monitoring and adjusting instructional practices.

The questions you have concerning ELAR checkpoints are not unusual.  You are correct, there can be a lot of reading involved and reading takes time.  Which means for an ELAR checkpoint the passage selection is the driving consideration.  Reading passages that lend themselves to multiple questions are significantly more useful than ones that do not.  Then it has to be decided if a “hot” or “cold” read will be used.  A hot read is a passage that the student has seen before, which means that they can process it more quickly and have time to answer more questions.  A cold read is a passage that the student has not seen before. These passages take longer to process, which means that they have less time for questions.

As you mentioned the 30-minute time limit is an important design element.  30-minutes protects instructional time. Exposure to more instruction is what drives student performance, not exposure to more testing.  A fact seeming lost by most schools, school districts and states.  Because 30-minutes is the driving factor, there will be many checkpoints that have fewer than ten questions.  And that is OK, because the checkpoint is assessing the critical concepts that had to be taught in the 3-week window, not every thing that was taught.

As for students with an IEP, time is a relative concept.  If it takes a student 60-minutes to answer ten questions, I can reduce the checkpoint to five questions for that student.  Or I could reduce answer choices, or I could pre-highlight passages. 

Keep working the process. With every checkpoint cycle things become more effective and more efficient.

Think. Work. Achieve.
Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Upcoming Conference Presentations: TASSP Aspiring Principal Workshop (Multiple Presentations), Learning for a Change Spring Summit (Keynote and Multiple Presentations) 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Friday, November 4, 2016

A Reader Asks... The Timed Checkpoint

A reader asks the following:

SC,

We are new to using the LYS Short-term Trend Analysis Form in our PLCs.  At our last meeting there was much debate over the time allotted to giving the quick 10-question checkpoint. We allow 30 minutes for the checkpoint, but the instructional leaders at campuses feel that many of their students need 40-minutes or more to complete.  They believe that taking up an assessment before students have had time to complete it is "demoralizing" to some of our students.  

Please explain the significance of keeping with the time limit, or is it okay to extend?

SC Response
What you describe is common and predictable pushback.

First, let me line out an assessment schedule for you:

Week 3: Checkpoint (30 minutes or less) (campus use)
Week 6: Checkpoint (30 minutes or less) (campus use)
Week 9: Mid-term (45 minutes or less) (district and campus use)
Week 12: Checkpoint (30 minutes or less) (campus use)
Week 15: Checkpoint (30 minutes or less) (campus use)
End of Semester: Final (90 minutes or less) (district and campus use)

Week 21: Checkpoint (30 minutes or less) (campus use)
Week 24: Checkpoint (30 minutes or less) (campus use)
Week 27: Mid-term (45 minutes or less) (district and campus use)
Week 30: Checkpoint (30 minutes or less) (campus use)
Week 33: Checkpoint (30 minutes or less) (campus use)
End of Course: Final (90 minutes or less) (district and campus use)

Notes: (a) If a STAAR test is administered in the course the week before, or the week of a checkpoint, SKIP the checkpoint. (b) A practice STAAR test can be substituted for the week 27 mid-term. (c) If it is a STAAR tested class, skip the second semester final and replace it with a final checkpoint.

Second, ask just enough questions that can reasonably be answered in the time frame of the assessment.  Which means for: (a) Checkpoints, it will generally be 10 of fewer questions. (b) Mid-terms, it will generally be 20 or fewer questions. (c) Finals, it will be 30 or fewer questions.

Third, in the STAAR environment, test taking fluency and pacing are critical. Adhering to the allotted testing time hones student processing skills and gives teachers critical information on student problem solving fluency.  If the issue is too many questions for the time frame, reduce the number of questions.  If the issue is inadequate student processing speed, that is instructional information that is vital for the teacher.  

Additionally, the short, timed checkpoint protects instructional time.  Teachers argue that they do not have enough time to teach the required content.  If this is the case, then in the classroom the best solution is to teach a lot, assess quickly, adjust, and repeat. 

Finally (and this upsets teachers), demoralized students are more a function of the teacher, not the student.  If the teacher communicates that the uses of checkpoints are progress gauges and growth indicators, then the “grade” has less significance. If the teacher communicates that the highest score (grade) is the goal, then “low” scores are bad.  What are your teachers communicating?

Implementing the checkpoint process correctly is hard work.  If it were easy, everyone would do it.  It boils down to this question, “Do you want to use your checkpoints to sort kids (traditional practice) or improve adult practice (exceptional practice)?”

I hope this better clarifies the process.

Think. Work. Achieve.
Your turn...
  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Upcoming Conference Presentations: TASSP Aspiring Principal Workshop (Multiple Presentations), Learning for a Change Spring Summit (Keynote and Multiple Presentations)
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Tuesday, December 15, 2015

Checkpoints and the Un-informed Leader

Sometimes I’m in a district and I witness leadership making a huge mistake. Today was one of those days.

Today, I heard a Superintendent tell his Principals that if their checkpoint scores didn’t improve then their jobs would be at risk.

Definitely a case of backwards thinking.

Checkpoint scores are about providing the following information:

First: Are we on pace?

Second: What works, instructionally?

Third: What doesn’t work, instructionally?

A Distant Fourth: What have students mastered?

Items 1 through 3 require an honest assessment environment and time to adjust practices. These are some of the prerequisites for improved student performance.

Item 4 can be masked by manipulating the assessment environment, which provides invalid data, which impacts adjustments to practice, which impedes student performance.

Trust me, based on his threat, this Superintendent will get better common assessment scores. And he is going to be red faced and tongue-tied as he tries to explain to his Board why his STAAR scores remain flat.  Odds are he will end up blaming his teachers, his principals or the test. 

Again, “Lose the Battle, Win the War.”

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: American Association of School Administrators Conference; National Association of Secondary School Principals Conference (Multiple Presentations) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Thursday, December 10, 2015

Lose the Battle, Win the War

With 3-week checkpoints, if they are administered correctly, the assumption should be that performance will be lacking.  After all we are asking high rigor questions almost immediately after students have been first exposed to the content.  As long as the poor performance is not due to being off pace, everything else can (and generally will) be corrected over the course of the school year. 

There are of course ways to “cheat” at checkpoints.  Most prevalent are to review for the checkpoint, extend time on the checkpoint, or not count the questions that were missed due to pacing setbacks. This gives the illusion of success when the reality is not as rosy.

Our advice to schools is “Lose the Battle. Win the War.” The battle being the checkpoint, the war being the state accountability test.

When we don’t “cheat” the checkpoint, we are able to determine if we are on pace, what is working, and what is not. With this information, we problem solve and adjust, putting us in a better position to meet the requirements of the state accountability tests.

When we “cheat” the checkpoint, we believe that everything is working as it should.  We don’t adjust and then we are sandbagged by the state tests.  So play it honest. Lose the Battle, Win the War. And if you doubt the strategy, it worked for both Sam Houston and George Washington.

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: American Association of School Administrators Conference; National Association of Secondary School Principals Conference (Multiple Presentations) 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Tuesday, December 9, 2014

A Reader Writes... But I Want a Full Benchmark

A teacher sent this to the curriculum department in a district that has worked to implement 3-week checkpoints this year.

To the Curriculum Department:

I understand not having a Checkpoint in November because of the upcoming benchmark.  But here is what I do not understand. Why only 30 questions for 2 hours. If we are going to take the time to lose two days of teaching, I would rather have data on a whole benchmark and know how I want to handle my tutorials.  I want the biggest bang for my buck. 

I know we have not covered some items but a whole benchmark would give us a better picture of how hard we need to hit items we have not covered. Plus, what needs tweaking.  I have really tried to understand just having 30 questions and how it is going to help me, but I just do not see it. 

I know on every Checkpoint how my students will score. I know where they are currently.  But more items on a full benchmark would help me with:

A. Do my students have stamina?

B. Do I need to increase student reading time?

C. Which TEKS (Texas Essential Knowledge and Skills) are my very low ones across the board?

D. Do I need to work more on expository writing, narratives, drama and poetry?
 
This is the data I can get from a whole benchmark versus a half of one.  When I asked if we could administer a full benchmark I was told that there would be a 30-question benchmark in December.  I received no indication we are ever going to have a full benchmark. 

I guess the bottom line is can we have a full benchmark... Please?

SC Response
Educators, let’s take a deep breath.  We cannot lament the fact that we test too much on one day and then ask for an extra four hours of testing the next. It makes us look like rank amateurs.  Let’s leave the amateurs antics to the Legislature.

Now to address the specific points of the above letter.

1. The postponement of the Checkpoint was a one-time event.  To not have one robbed teachers of real-time diagnostic information on what was supposed to be taught.  The only valid reason to postpone the checkpoint, sadly, was the recognition that the entire system is behind the required curriculum pacing.  Meaning that it is known that students have not been exposed to the required content, so the checkpoint results are now completely predictable.  But recognize (as the curriculum department does) that this is system and adult failure that is detrimental to students. Thus, the one-time solution of skipping a checkpoint and extending teaching.

2. 30 questions over 2 hours is a reasonable for a cumulative final with embedded preview questions.  This equates to four minutes per question. District finals are scheduled for the final week of the semester, so the risk of losing “quality” instructional time is negligible.  I'm not trying to be mean with this observation, just being real.

3. As for the statement, “...how hard must I hit the items we have not covered,” is ludicrous.  We already know that our students do not know what we have not taught (hence the postponement of the checkpoint). SO TEACH YOUR TAIL OFF... EVERY DAY. Your students need and deserve nothing less.

4. 25 questions, 30 questions, 40 questions…  What’s the point?  The Final needs to have just enough questions to give teachers the information they need to inform their next instructional decisions.  More questions aren’t necessarily better. In fact, I can get better information with a 13-question test than any 30+ question test in use at any school in the state (but that is another discussion).

5. Stamina can and should be built and measured throughout the year. The timed checkpoints, when implemented correctly, do this.  One long test is not how this is done.  You don’t train for a marathon by running one or two a pre-marathons. Let go of superstitious practices and trust the process.

6. Yes, increase your students’ reading time.  You don’t need a benchmark to know that.

7. Yes, keep working on writing.  You don't need a benchmark to know that.

8. The checkpoints are informing you which TEKS are at risk.  You are getting that information every three weeks.  My question is, “What have you been doing with that information?”

9. Finally there is no set number of questions for a full or half benchmark.  The issue seems to be time, 2 hours versus 4 hours. If the student can’t demonstrate mastery in 2 hours, belaboring the point for an additional 2 hours doesn’t give me better instructional information.  And honestly, I’ll take two additional hours of instruction over 2/3’s of the class waiting for hours for the testing period to end, every day of the week and twice on Sundays.   

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); PowerWalks CLC (Networked Formative Observation Tool) 
  • Upcoming Presentations: TMSA Winter Conference; ASCD Annual Conference; TEPSA Summer Conference 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook

Thursday, November 20, 2014

A Checkpoint Discussion (Brutal Truth Version)

The following is an exchange I had with a district curriculum director concerning 3-week checkpoints (common assessments).

DIRECTOR
This is a question I'm getting fairly often now, “Why don't the checkpoints get progressively longer as the time for the EOC exam nears? 

I restate and remind our teachers about the purpose of checkpoints.  But the questions keep coming up. What else can I add to my response?

SC
Teachers are worried about how their students will perform on the long, rigorous, high stakes test.  A legitimate concern.  Share with them that World Class marathon runners train thru a regiment of short sprints and mid-length runs. They do not constantly run marathons.

We mimic this with the following assessment series: 

Weeks 3 and 6 – short checkpoints
Week 9 - a mid-length midterm
Weeks 12 and 15 – short checkpoints
Week 18 – a longer final

Finally, we are checking to see if students have mastered what we taught and did we re-teach our identified deep holes. We are not checking to see if students can navigate thru 40 problems in four hours.

DIRECTOR
The same teachers that complain about the test being the center of everything, then complain that the test isn't the center of everything. Do they realize how schizophrenic that makes them look?

SC
Unfortunately, no.  But this is not unique to your district.  It is the manifestation of teacher stress, fear, and superstitious behaviors. And it’s better than your teachers not caring.

DIRECTOR
Just to clarify, are you saying that the 9-week checkpoint should be cumulative?

SC
Yes. But not stupid length cumulative. 15 questions, max.  Also, if the district looks at assessment data, it should only look at the data from the 9, 18, 27 and 36-week tests.  All the other checkpoints are for campus use.  And the tests for weeks 18 and 36 (which are in lieu of a traditional final exam) can be 20 to 30 questions.

DIRECTOR
Got it!

Think. Work. Achieve.
Your turn...

  • Call Jo at (832) 477-LEAD to order your campus set of “The Fundamental 5: The Formula for Quality Instruction.” Individual copies available on Amazon.com!  http://tinyurl.com/Fundamental5 
  • Now at the Apple App Store: Fun 5 Timer (Fundamental 5 Delivery Tool); Fun 5 Plans (Fundamental 5 Lesson Plan Tool) 
  • Upcoming Presentations: TMSA Winter Conference; ASCD Annual Conference; TEPSA Summer Conference 
  • Follow Sean Cain and LYS on www.Twitter.com/LYSNation  and like Lead Your School on Facebook