Last week I presented (for a second time) a webinar for Simple K12 on the topic, Performance Task Assessment is 21st century Assessment.

Those slides are embedded above, and the webinar is available here (free for members, for a fee if you’re not).

In that presentation I discuss various strategies for designing and developing your own performance tasks for assessment, and suggest that one avenue is to borrow an existing one and adapt for your purposes.     In the PBL world where I also spend a lot of time, we refer people often to PBL libraries (BIE has a list of them here), and so it is important we match them with performance task libraries.

Performance Task assessment is becoming increasingly important, as I’ve posted here several times before, because of its role in Common Core assessments, (more…)

Delighted today to have the opportunity to share these slides and thoughts with folks here at OESIS today.  I continue to think that using technologies, current and emerging, to reinvent testing and assessment is among the primary projects for 21st century K-12 learning in the current decade, and I’m going to continue to do my best to support this reinvention.

As I explained at some length in the opening of my session, and I realize I may stand a bit alone here, I still love tests– of all kinds, including the “test” that is asking students to demonstrate their learning in challenging ways– and a huge part of my personal mission is to make testing more engaging and meaningful for students: let’s improve the way we use assessment as, for, and of learning! 

Pam Moran and I shared this and facilitated this conversation today at educon: our thanks to the attendees for the rich and meaningful conversation.

Above are the slides for my presentation today to the Association of Colorado Independent Schools Heads and senior administrators, a three hour workshop.   Sadly, I (again!) made the mistake of trying to stuff in too much information, and several of our intended activities and videos had to be cut.

Below are first, some of the key links to think to which I referred, and below that, some of the videos I showed or intended to show as part of the presentation.

A very valuable reference is the excellent presentation, Measuring What We Value by Lyons and Niblock.   (Note: I borrowed/adapted a small number of these slides for integration into my presentation: My thanks to Lyons and Niblock. )

My thanks to Lee Quinby, the very fine ACIS executive director, and all those who took the time for the session this morning.

Links:

[slides shared with permission of the authors]

The presentation above, by Doug Lyons and Andrew Niblock, is from a session which was a highlight of last spring’s NAIS Annual Conference, a session which sadly I was unable to attend, but about which I heard great things– and the slides carry much of that value.

This presentation covers terrain that I too spend a lot of time examining.  (for comparison, see my presentation to the Canadian Heads at their annual meeting last year.)

I am very well aware that there are many fine minds and outstanding educators who are arguing against measurement in education– or for dramatically reducing the measurement we do of learning– or that much of what we most value is hard or effectively impossible to measure.

And certainly, there is a somewhat appalling misuse and abuse of student learning measurement data in the US today– of course there is.

But, my ongoing approach, aligned exactly with this high quality presentation, is that we seek diligently to improve and correct the way we use learning measurement, but not abandon or reject evaluating and measuring learning.   Indeed, to best change education from its current course and to bring it to a far more student centered, 21st century oriented, technology accelerated, and innovative place, we have to have data to support our campaign and change current policies.

Among the things I appreciate about this presentation is its breadth, looking at both internal and qualitative ways we assess learning AND external/quantifiable ways.   We have to look at this topic broadly– what gets measured gets done, what gets measured gets valued, we can’t manage what we can’t measure: these mantras are compelling and significant, and if we want to transform learning we have to transform what we assess and measure.

It is good too that it is built in part upon Criterion 13 of the Commission on Accreditation standards, which is essential to framing the issue of assessment in independent schools:

The Standards require the school to provide evidence of a thoughtful process, respectful of its mission, for the collection and use in school decision-making of data, both external and internal, about student learning.

This evidence is required for the accreditation of all independent schools in coming years, , as, I believe, it should be.

Some thoughts, comments, and observations on this presentation.

1.  I love the citation from Ted McCain’s Teaching for Tomorrow–a highly valuable, but, I fear, highly under-valued, book on the topic.  As they quote McCain:

“we need to invert the conventional classroom dynamic: instead of teaching information and content first, and then asking students to answer questions about it second, we should put the question/problem first, and then facilitate students with information and guidance as they seek the answer and hold them accountable for the excellence of their solutions and of their presentation of their results”.

In my own 2008 research visiting 21 schools and shadowing students at each, I found McCain proven right– that putting problems first made a huge difference. (more…)

genericcovercwra.ai-133940

  • Far more detailed institutional reports–
  • student level scoring validity
  • possibility of improved student test-taking motivation
  • available for 8th graders now
  • flexible scheduling
  • Lower price– $38
  • Special trial price this spring only $22

Regular readers here know of my interest in, and on balance enthusiasm for, the CWRA– the College Work Readiness Assessment, which I have administered as a school head over the course of three years, presented on about half a dozen times and written about about here a dozen times.

Run, don’t walk, to register for the 30 minute free webinar CAE, CWRA’s parent, is offering this week and next about the forthcoming changes in the CWRA.   If you can’t attend one of these sessions, you’ll do pretty well as an alternate reviewing the five page overview of CWRA changes I’ve embedded at the bottom of this post.  (Be sure to click “more” to see it if you are interested).

As enthusiastic as I’ve been, I’ve also been a gentle critic on the following fronts.

  • The institutional reporting lacks detail and specificity for use in identifying program gaps and targeting institutional improvement.
  • It is too expensive.
  • Students lack motivation to perform because they have no stake in the game– there is no student-level report.
  • There are enough or pertinent norm groups for comparison– particularly in the lack of independent school comps.
  • It doesn’t have enough possible purposes beyond an institutional check on student learning.
  • It isn’t available for middle school students.
  • Is automated scoring of essays proven and reliable enough?

And now, here it is: the new CWRA plus addresses nearly all of these issues.  I feel almost as if they were listening to me.  (Smile) (more…)

Performance Task Assessment, sometimes referred to simply as Performance Assessment, is coming soon in a substantial and significant way to K-12 schooling;  21st century principals and other educational leaders would do well to familiarize themselves with this method and began to make plans for successful integration of this new, alternative format of assessments.

[the following 10 or so paragraphs lay out some background for my “10 Things;” scroll down to the section heading if you want to skip over the background discussion]

President Obama and Secretary Duncan have been assuring us for several years that they will take standardized testing “beyond the bubble,” and both PARCC and Smarter Balanced are working hard at developing new common core assessment using the format of perfomance task assessment.

As PARCC explains,

PARCC is… contracting with [other organizations] to develop models of innovative, online-delivered items and rich performance tasks proposed for use in the PARCC assessments. These prototypes will include both assessment and classroom-based tasks.

Smarter Balanced, meanwhile, states that by 2014-15,

Smarter Balanced assessments will go beyond multiple-choice questions to include performance tasks that allow students to demonstrate critical-thinking and problem-solving skills.

Performance tasks challenge students to apply their knowledge and skills to respond to complex real-world problems. They can best be described as collections of questions and activities that are coherently connected to a single theme or scenario.

These activities are meant to measure capacities such as depth of understanding, writing and research skills, and complex analysis, which cannot be adequately assessed with traditional assessment questions.

Samples of the performance tasks being developed for grades K-8 are available here.   (more…)

I’m recently returned from a quick trip to beautiful Charlottesville, Virginia.    Thursday I presented a five hour workshop on 21st century learning for the faculty of Tandem Friends School, and was pleased that nearly a third of the faculty volunteered to stay on for an additional 75 minutes for the material I hadn’t completed in the regular time.

Friday I spent the afternoon with Pam Moran, Superintendent of Schools in Albemarle County school district, a district of about 30 schools.   Regular readers here know that I am both friends with and a great admirer of Pam’s; last winter I wrote a piece about my belief that she exemplifies my model of Eight steps for leading in 21st century learning.

In my visit, we toured two of her district’s schools, and met many of her hard-working teachers.   Several themes emerged.

1. Open-ness and transparency.

“I think we have one of the most unfiltered internet service of any school district in the nation,” Pam told me, and this seemed to exemplify a larger spirit to open the world into her schools and  to bring her students out to the wider world, in every way possible.     When visiting a middle school, she explained to me that this was the most rural school in her district, and that that was why it was chosen as a pioneer school for a 1-1 laptop program: because these were the students who have otherwise the least access to the wider world of information.  This district is also proudly BYOD across all its high schools– students are all, always, welcome and encouraged to bring and use their own mobile devices and the educators there are striving to help students use them productively and wisely.

Pam herself is wide open, personally.   As we toured she never hesitated to go up to anyone in her path and introduce herself–sticking out her left arm for a shake and then reaching over with her right to be even warmer in a semi-embrace–  and then to ask them about their roles, their work, and to enthuse about it.    We went right into classrooms and engaged students and teachers,  gushing over what was happening.    Pam was simultaneously on her iphone, texting and tweeting as we went, determined to broadcast more widely the exciting things which were happening and to stay in touch with her network, both internal to her district and out in the wider world.

Learning spaces we observed, such as the libraries at both the middle and high school and in new cluster classroom areas of the big high school, similarly displayed this philosophy of transparency.  Regularly could be seen windows replacing walls, making spaces where everything happening became more visible to all school community members.   Lockers were being removed from the high school, Pam explained, (“most students don’t use them”) so as to create more open, central, common spaces, which soon will be furnished with comfortable furnishings and tables to create stronger spaces of civil society for the students.

I find this fascinating metaphorically, the replacement of private lockers, which take up valuable real estate so that students can store their individual stuff, by communal open spaces.  As more and more, student textbooks and notebooks are replaced by mobile technologies, which are nearly always carried on our persons, surely lockers will be ever less important for school-goers, and it is great to see the opportunities this change provides for more open space, more connection and community.

(more…)

As I wrote about last year, I am greatly enthusiastic about the opportunity Open Computer testing plays in assessing our students in their development of 21st century skills.     I think it is a really exciting way to take assessment into 21st century information environments, and to situate students in much more real-world situations as we prepare them for the contemporary world of work.

The above slideshow displays what I think is a very well designed “Open computer/open internet” exam, and Dr. Scott Morris has added on every slide his annotations of how he expects students to use the internet in answering these questions, and how these questions, with those resources, demand more of his students, particularly the higher order thinking skills of critical thinking and analytic reasoning, and a deeper understanding of the course material. (If the slides are too small for the print to be legible, click on the full screen link at the bottom right).

As I frequently discuss with Dr. Morris, with whom I have prepared this post and with whom I am co-presenting on this topic at the NAIS Annual Conference in March, our rationale is that our students are preparing to work in professional environments where they must tackle and resolve complex problems, and we know that in nearly every envisionable such environment, they will have laptops or other mobile, web-connected, digital tools to address those problems.   Let’s assess their  understanding in situations parallel to those for which we are preparing them.

But it is not just a matter of situating them in real-world environments, but that with open computer testing, the format of exams, (and yes, as much as I am a huge fan of PBL, exhibitions, and portfolios, call me retrograde but I still think there is a place and a role for exams in the range of assessment tools we use,) but the format of exams changes in really meaningful ways. (more…)

Links of interest:

New York Times article about Character report cards: http://www.nytimes.com/2011/09/18/magazine/what-if-the-secret-to-success-is-failure.html

NAIS monograph, Value Add Measurements of Learning: http://www.nais.org/sustainable/article.cfm?ItemNumber=151607

Contact for the PISA Based testing for Schools pilot in Canada: For any questions, please email pisabasedtestforschools@oecd.org or Charles Cirtwill at charlescirtwill@aims.ca


 


CWRA and CLA ought not be only tools for assessing educational effectiveness; they must also be tools for informing improved learning of what they assess, and ultimately, we need to close the gap and link them back to effective teaching for effective learning of higher order thinking skills.

It is an empty exercise to assess student learning without providing a means to adjust teaching in response to deficiencies revealed through the information gleaned from that assessments.

So argues Marc Chun, director of education for the CWRA and CLA host, Council for Aid to Education (CAE), in an article published in Change magazine: Taking Teaching to Performance Task: Linking Pedagogical and Assessment Practices.  (Unfortunately, the article is behind a pay-wall, but someone posted it here).  Marc runs a program called CLA in the Classroom, and offers workshops around the country.

The critical thing for Marc and his team is to encourage institutions using the Collegiate Learning Assessment not just to measure overall performance, but to connected with teaching.

Assessment should align with student learning objectives so that what faculty are teaching maps directly into what is being assessed.  However, a way to achieve even closer alignment is to seek convergence between pedagogical practice and assessment tools: in other words, for an institution to teach and assess in the same way.  Teaching and assessment– so often seen at odds- instead become coterminous.

To make the learning even more powerful, this can also be done so that both the teaching and assessment mimic how the skills or knowledge will eventually be used. (more…)

I have long been passionate about problems in learning (and Problem Based Learning), and even more so since my visit to New Technology High School in October 2008, and since working (in a very small way) with the Buck Institute’s Jason Ravitz on an article on this topic.  As Ted McCain writes, brilliantly, in Teaching for Tomorrow, we need to invert the conventional classroom dynamic: instead of teaching information and content first, and then asking students to answer questions about it second, we should put the question/problem first, and then facilitate students with information and guidance as they seek the answer and hold them highly accountable for the excellence of their solutions and of their presentation of their results.

I am working now to think through and discern what particular  and compelling term best captures this approach: is “problem based learning” the answer?   (Share with me your thoughts about terminology by using the “leave a comment button.”)

The College and Work Readiness Assessment, which we use at St. Gregory to assess our students’ learning of critical thinking, communication, and problem solving, uses the term “Performance Task” to capture and convey the learning approach I am trying to describe here.  (more…)

The Digital Ed. blog having recently brought Chris Dede to my awareness,  I have been poking around his publications at his Harvard GSE faculty website.

  • One paper, called Transforming Education for the 21st century, very effectively brings together a number of the issues and priorities that I blog about here:
  • * what the fast-changing world requires of our students to learn in the new era;
  • * how our students must have higher level thinking skills such as problem solving and communication;
  • how tackling real-world problems enhances the development of these 21st century skills;
  • and how contemporary digital tools enhance the opportunity for our students to gain these 21st c. skills. (more…)