Perhaps this is a bit too much inside baseball, (and I know it makes me out to be a test-geek), but I want to write briefly today to cheer the news that the OECD Test for Schools (based on PISA), abbreviated to TFS, has been taken up by NorthWest Evaluation Association, coming over from its previous administrator, CTB-McGraw Hill.
(Note: I have no current or past affiliation with NWEA nor with OECD).
NWEA is best know for its MAP testing, the Measures of Academic Progress computer adaptive test. More about MAP below (after jump):
Regular readers know of my enthusiasm for PISA testing in schools; in 2013-14 I researched and wrote a 64 page user’s guide and toolkit on the PISA TFS, (for EdLeader21 funded by the Hewlett Foundation) sharing how it is being and how it can be valuably used at the school level.
It was fascinating to observe and learn how unique and exciting this tool is: PISA questions are richer, more challenging, more open-ended, far more demanding of higher order thinking than those of most other tests. (Sample questions can be seen in slides above or in this excellent compendium)
The TFS 160 page school results report is a thing of beauty: colorful, studded with scores of charts and tables, enabling comparison of your students to norms globally and US. There’s information about your school’s performance compared to like-socioeconomic schools as well. There’s also a bunch of data about how students perceptions of their schooling– reading practices, teacher relations, instrumental motivation– can be mapped onto their performance, giving schools far more insight into opportunities for improving student performance than most other tests or tools.
The report is also studded with great little nuggets about evidence-based educational practices from around the world. Disappointed by your school’s reading results? Read about how reading is taught in Finland. And so on. Administering the TFS is an awesome window into comparative educational practice research and opens up perspective and understanding for school-leaders brilliantly.
I often tell people the story of Fairfax County (VA), which enrolled ten of its high schools in the PISA TFS pilot, at no cost, and was so delighted by the value of the reports they received that they then expanded their involvement, enrolling 27 high schools in the test at $12,000 each!
But, as successful as the TFS has been to date, it has been limited a bit by its previous high price point (about $12K) and its less-than-terrific management by the for-profit corporate behemoth that is CTB-McGraw Hill.
So how great it is to learn that its being taken up by the not-for-profit (501(c)3) NWEA, which is well regarded nationally (and in my own personal experience as a school-leader) for its skillful management of the MAP (more about below). MAP has long been administered online, and now TFS will also be administered. Because of the greater economic efficiency of online testing, NWEA will be slashing the price point for the TFS, down to about $6500 (and only $5000 this pilot year though June), and it is my recommendation that every high school strongly consider adding the PISA TFS on an annual basis– or perhaps every other year or third year. Do it every three years and your amortized price is about $2k a year– worth it. (more…)