Measuring For Learning

Expat Educator StudyingThe Problem With Traditional Learning Measures

Not everything that can be counted counts is a phrase often used in the conversation about standardised tests. Whether originally stated by Dr. Stephen Ross or by Albert Einstein, human beings have long sought “fair” ways to determine which students are high achievers and which student are likely to be successful in university. The logic goes something like this: If we give every student the same test under the same conditions, those who know more will pick more correct answers and earn higher numerical marks.

We can’t quantitatively definitively define “success” by testing unless we reduce it to a number. So we define academic success by numbers on a test or letters on a report card and we define lifetime success based on income or leadership level within organisations. 

I was interested to hear from Alan Boyle, an author from OnlineEducation.net, about a recent article on how top universities seek to measure noncognitive skills as predictors of future academic success. The article made me think back to all the applications I didn’t fill out because my SAT scores, used at the time as the most accurate predictor of university success, didn’t hit the magic numbers. I remember feeling cheated that I couldn’t tick the box “Top 10% of graduating class” because my 3.98 GPA made me third in a graduating class of 23 students. Had I chosen to drop Physics, I would have been able to tick the necessary box on the application. I wished for a way to communicate to admissions officers my drive to achieve whatever was required of me – and my willingness to stick with a subject even if it compromised my numerical standing in the rank of graduates.

Standards-Based Continuums Bring Out the Noncognitive Dispositions

My love for curriculum stems from the way curriculum is written. Curriculum scope and sequence documents comprise statements of what students should know and be able to do – information the “me” from High school wished to communicate to universities with highly competitive admission requirements.

The executive team at my current school is leading teachers in an effort to put the Australian Curriculum (AC) standards onto continuums. As students move from Prep to Year 12, common assessments determine student movement through the continuum of results statements for each subject. In history, for example, a student might demonstrate a Year 9 level of historical knowledge and demonstrate a Year 6 level of historical research skills.

The standards-based continuum is transparent. Assuming common assessments are valid and scored reliably, both parents and students know students’ specific strengths and areas for growth in each subject.

My hope is that, through the transparent standards-based marking process, noncognitive areas for growth will emerge. If, as Alan suggests, one can improve important noncognitive skills by taking on challenges, pushing through difficult situations, setting measurable goals, and becoming a decent person, then a transparent set of standards gives students a continuous set of challenging goals through which they navigate.

More specifically, through a transparent, standards-based continuum based on valid, reliable assessments, students

  • understand the next level of expectation in each subject
  • set measurable, personal goals in each subject each term and follow through with those goals
  • demonstrate the grit to push through the cognitive and emotional challenges associated with achievement of subsequent standards

Decreasing the Weight of Standardised Tests

If we can create a valid, reliable way of measuring student outcomes, then standardised tests become one of the ways rather than the way of determining student “success” in school.

Such a continuum does not make students exempt from standardised tests. Australian students encounter the NAPLAN in grades, 3, 5, 7, and 9. While results are not linked to school funding as they are in the American outcomes of NCLB, school NAPLAN results are published and accessed easily by parents.

But if we can report to students, parents, and universities that a particular student under regular life conditions is able to set high academic goals and achieve those goals, families and universities might more accurately predict that the same student would set and achieve future goals.

More Clearly Describing Success

We can label students as successful because they receive a particular number on a particular test on a particular day. Alternately, we can describe what “success” looks like in each subject area and help students celebrate continued growth and eventual mastery. Under which conditions will students learn more?

if students work toward descriptors rather than numbers, the common assessments become a measure of academic achievement and indicate growth of the noncognitive measures such as grit, stamina, and resilience. Learning extends beyond the academic.

So what if we stop counting and start describing? Not everything that can be counted counts. But things we describe and to which you can aspire count.

photo credit: Angela Radulescu via photopin cc

If you like what you read, please sign up for Expat Educator updates by email. Your address will never be shared with outside parties.

End-of-School-Year Student Awards

To a tween, the number of years until High School graduation seem like an eternity. No matter what the grade, it is important to send students off well. The tech-savvy might send students off with a memorable video.

You might also have an end-of-year ceremony (parents invited), celebrating the gifts of each child as well as memorable classroom moments.

See if some of these awards remind you of any of your students:

  • Good guy/gal award
  • Future World Leader
  • Amazing Artist
  • Scholar-Athlete
  • Most Likely to Win a Pulitzer Prize in Literature
  • Most likely to own a Luxury Cruise Line.
  • Best Dancer
  • Evil Laugh or Best Laugh
  • Best Smile
  • Terrific Technician
  • Most Likely to be Captain of the All Blacks
  • Most Likely to play Goalie for Liverpool
  • Future Superbowl MVP
  • Most Conscientious Student
  • Most Improved Student
  • Future American Idol
  • Fountain of Knowledge
  • Future Academy Award Winner
  • Einstein Award
  • Future Editor of Vogue (or other magazine)
  • Future Olympic Gold Medalist
  • Book Worm Award
  • Best Debater
  • Gentle Giant Award
  • Heart of Gold Award
  • Humanitarian Award
  • Strong but Silent Award
  • Most Dedicated Scholar
  • Most Likely to Earn More Money than Bill Gates (or other rich dude)
  • Most Renowned Civil War historian (or other part of history)
  • Most Photogenic
  • Most Respected
  • Prada Award
  • Pulitzer Prize for Literature/Poetry
  • Strong Leader
  • Most Likely to Play in Carnegie Hall
  • Award for Making the World a Better Place

If you’re stuck on what award to give a student, you can pass a class list to each child. Beside each classmate’s name, students write a compliment or share a fun memory. Patterns will emerge – as well as interesting tidbits you wouldn’t otherwise know.

What awards might you add to this list?

If you like what you read, consider subscribing to Expat Educator (below).

Natural Consequences for Online Behavior?

I saw an article today that has me thinking… so I’d like to know your opinion.

A CNN article reported on a parent’s method for punishing her daughter’s inappropriate online behavior.

In short, the underage girl posted an Instagram picture of herself holding a bottle of vodka. The caption indicated she wished she was allowed to drink it.

The mother then had her daughter pose for an Instagram picture, this time holding a sign that said, “Since I want to post photos of me holding liquor, I am obviously not ready for social media and will be taking a hiatus until I learn what I should and should not post. Bye-bye.” The girl’s face is only partially shown.

On the one hand, I suspect the consequence will be highly effective in making the child think twice before posting items online. At the same time, the consequence has an element of humiliation – like a permanent, viral “dunce cap.”

So what do you think? Am I being oversensitive? What is the most appropriate way to correct irresponsible online behavior?

If you like this post or site, please vote for http://expateducator.com as Teacher blog of the Year. Also, please consider subscribing to the blog feed.

Image from from http://thecahokian.blogspot.com/2010_08_01_archive.html

Keeping Students Engaged in a 1:1 Project-Based Classroom

This weekend I worked on a guest post for Dangerously Irrelevant and 1to1 Schools. Both blogs are run by Dr. Scott McLeod. If you give a student a computer, you’ll want to subscribe and read his stuff.

Scott has allowed me to cross-post onto this blog (Thanks, Scott!). Here is the article:


Image approved for copy by Creative Commons.
Source: http://bit.ly/vYUkXB

When laptops first arrived in my classroom, I worried about classroom management. How could I create an environment where students used their computers as tools rather than toys?

I was worried for nothing. The following are suggestions for keeping students engaged in a project and accountable for their time with computers:

Students make a plan.
Students are most tempted to open widgets, games, and social chats when they are faced with a blank screen and have no plan.

Much of the time, students think they have a plan. If you ask them What are you going to do?, the answer is usually I’m gonna make a Power Point about… or I want to make a movie about… Those answers indicate that students are thinking of technology before content.

Instead, ask What are you trying to learn? or What are you trying to communicate? or What are you working on as a writer? Those questions get answers like I want to know more about the horses that Civil War generals rode or I want to convince people that Justin Bieber is the best singer ever or I’m trying to describe the character’s actions.

When you ask about learning and communication, you are signaling that the content is more important than the technology. Pull aside those who are struggling with plans. Let them talk together and encourage them to sketch their ideas with diagrams or bullet points and return to the computer later. Students with a plan tend to stay on task.

Students set time-bound goals.
Once students have a plan, they break the project into smaller tasks that can be finished in 10- to 15-minute chunks of time. Have students write the specific tasks on Post-it notes. Post-its are set beside the computer. On their Post-its, students finish the sentence, “In the next [x-amount of] minutes, I plan to…” They generally write things like…

  • Create an outline for my essay
  • Write my introduction
  • Find three pictures about…
  • Do my voice recording
  • Finish four slides of my Power Point/Keynote
  • Find at least three database articles on…
  • Draft at least three paragraphs
  • Use Google docs to peer-edit so-and-so’s essay
  • Upload my story to Voicethread

Tasks should be specific. I’m gonna work on my project is not specific enough. At the end of class, Post-its become “exit slips”. Students tick off the tasks they have completed and hand the Post-its to the teacher so the teacher can see the progress.

Laptop screens are “fisted” or “put at half mast”. 
Teachers don’t lecture much in a project-based learning environment. However, sometimes student work time is interrupted so the teacher can give reminders or clarify directions.

Ask students to “fist” their computer (or “put the screen at half mast”). Screens should be gently lowered so that students’ fists fit between the edge of the track pad and the screen.

When screens are fisted, students are not distracted by items on their screen nor can they type. At the same time, students do not lower their screens to the point that the computers go to sleep. In an iPad environment, students might carefully face their screens down on the desk.

Fingers indicate the amount of time students need to complete a shorter task.
Some tasks are shorter and need to be completed within a few minutes of class. After students have worked for a reasonable amount of time, ask students to show fingers for how many additional minutes they need. Fisted computers signal completion.

If a student is far behind the rest of the class, try to determine whether the student got distracted or if the student needs reteaching. Have the student take a screenshot of his or her progress. Screenshots are helpful to guide future conversations.

Circulate the room, conferencing with students.
Walking and talking with students is important with or without computers. In her article 10 Ways to be a Terrible Teacher, Vicki Davis describes the terrible teacher as one who is working on his or her own computer and not paying attention to students.

Students welcome teacher conversation. They are eager to share their progress and request advice when they’re stuck. You build relationships with students when you talk to them about their work.

Rather than banning chat, teach students how to use it for collaboration.
Chat features are programmed into Gmail and Google products. The first year, I banned chats. Then, I realized that chats can be used for student collaboration.

I glance at the chat windows as I circulate the room. Since students have specific, time-bound goals, most chats are used to ask peers to look over a paragraph or help with another aspect of the project.

Don’t be afraid to have tough conversations with individual students.
Each year, I have to pull aside one or two students to talk about time management. It’s not a punitive conversation. The conversation goes something like this:

I’ve noticed you haven’t made much progress on…I need to know what’s getting in the way of your progress. I’m not asking because I want to get you in trouble. I’m asking because you’re now x-years old and I’m worried that, if you get in the habit of…,then school will be really hard for you in the future.

Many of the suggestions above apply to project-based learning environments both with and without computers. The trick in a 1:1 environment is to maintain focus on learning and communication. Then let technology naturally enhance those outcomes.

What tricks do you use to keep students engaged?

[cross-posted at 1-to-1 Schools]

If you like what you read, consider subscribing to Expat Educator (below).

An Alternative to Student Gifts

I was surprised to see that Alabama set policy against students giving gifts to teachers. But I understand many of the reasons behind the rule.

Christmas has always been a little awkward for me. When I taught in low-income public schools, I didn’t want students or their parents spending any of their limited money on me. My first couple years in an international school, my students gave me expensive gifts. I suspected most of the gifts were bought duty-free by parents on their various airline flights.

My school then implemented a policy that gifts could not exceed roughly US$25. Since then I’ve worried about getting an expensive gift and needing to insult the giver by handing it back.

Some cultures are gift-giving cultures. A colleague of mine said that his school in Korea had a similar gift limit policy. Parents found ways around the rule. One example: the teacher was given a Monteblanc pen. He would have given it back – but his name was engraved on the side.

So I tried something different this year. Rather than giving me $25 gifts, I asked students donate the amount to Ember. A group of High Schoolers started Ember to fund girls’ education in rural China. High School education, including uniforms and books, costs US$350. Many high-achieving girls come from families who are unable to afford these costs. If 14 students donated to Ember rather than giving me gifts, a girl could attend High School.

I ran the idea by one of my classroom parents. I asked her if she would be willing to collect the money on my behalf, make the donation, and give me a card with the names of students who made a donation gift. Then I wrote an email to parents explaining my request.

Fourteen of my 24 students donated. I’ve been in contact with the High School students who run the charity. They have chosen a girl to receive the money and the girl will communicate with my class for the remainder of the year.

I don’t have students old enough to deal with issues such as modern slavery. But my student can understand the benefits of education. They can learn about the levels of poverty in rural China. And, they see the High School students that organize Ember as role-models, examples of learners who contribute to society.

Have you ever asked students to give to charity in lieu of giving gifts? What was the reaction?