One of the most powerful tools that sits at the heart of Deming’s Theory of Knowledge is in fact the Plan-Do-Act-Study (PDSA) cycle. PDSA cycles are experiments during which you gather evidence to test your theories. Observed outcomes are compared to predictions and the differences between the two become the learning that drives decisions about next steps with your theory. The know-how generated through each successive PDSA cycle ultimately becomes the practice-based evidence that demonstrates that some process, tool, or modified staff role or relationship works effectively under a variety of conditions and that quality outcomes will reliably ensue within your organization.
Read MoreLast month, I discussed a powerful tool, the process behavior chart, that can be used to filter the noise out of our data. The whole point of this series has been to think through how to properly interpret and react to data, which includes the filtering process. Unfortunately, much of what happens on the data analysis front in the education sector is akin to writing fiction. Writing fiction will be the main topic of this post.
Read More
Last month, I discussed the difference between information and knowledge by analogizing the two concepts to data ponds (information) and data streams (knowledge). A key idea in the transformation of information to knowledge is adding the element of time and visualizing the data in a tool called a process behavior chart. Part of the power of the process behavior chart (PBC) is its ability to filter out the noise in our data; the idea of filtering out data “noise” is the focus of this post.
Read MoreLast month, I outlined why data has no meaning apart from their context. The discussion centered on some key ideas for presenting data in context as well as a logical definition of improvement. I also introduced an example of how data is often misinterpreted in the education sector. In this post, I’ll begin to lay the foundation for understanding variation in quality improvement work; this will be a precursor to comprehending why so much of the data analysis that is done in organizations is akin to writing fiction.
Read More
In the K-12 education sector, one of the primary uses of data is in state accountability systems. Many states now issue district and school report cards typically based on various performance metrics such as proficiency rates on standardized tests, absenteeism rates, and college and career readiness indicators. Unfortunately though, as James Leonard stated so eloquently in The New Philosophy for K-12 Education:
Absent an understanding of the type of variation present, any discussion of accountability is a burlesque!
Dr. Russell Ackoff, the eminent systems thinker said, “Managers do not solve problems, they manage messes.” My take would be more optimistic than Ackoff’s assuming managers knew something about variation. This is in fact why I’ve spent so much time over the last year studying this idea as it fits into W. Edwards Deming’s theoretical framework, the System of Profound Knowledge.
Read MoreThe case I’ve been making for organizational transformation is based on the premise that our education system is not broken. Rather, it is a system that is operating exactly as it was designed to operate, and it’s producing exactly what it was designed to produce. I do not believe that our schools need reform or restructuring but rather a change in state. This transformative change in state does not occur overnight, but instead is a process that unfolds over 5-10 years (as Deming would put it, “There is no instant pudding!”).
Read More
Each part of the SoPK is interdependent and equal in importance. Nonetheless, if there is one of the four components that seems to flow through each of the others, it is psychology. A leader of organizational transformation must understand the psychology of individuals, the psychology of groups, the psychology of society, and the psychology of change.
Read More
In our organizations, theory must be the basis of all investigation, and the basis for any action we take to improve systems within our organizations has to include testing our theories. The Theory of Knowledge is all about where our knowledge comes from that we use in these improvement efforts. This knowledge has temporal spread.
Read MoreIn the last written work of his long life, The New Economics, Deming had this to say about variation:
Variation there will always be, between people, in output, in service, in product. What is the variation trying to tell us about a process and about the people that work in it?
The main point that Deming was making was that outcomes are either good or bad by the time we look at them. The enemy is variation and the sources of variation in and around the process that produced the outcome. When you combine this point with the core idea of systems thinking - that most results belong to the system - you begin to see your organization through a completely new lens.
Perhaps the most radical idea put forth by Deming is the idea that any outcome we see within our system is the result of more than the skills and efforts of the individuals that work within the organization. Organizations are characterized by a set of interactions among the people who work there, the tools and materials they have at their disposal, and the processes through which these people and resources join together to accomplish its work. Central to this idea is that most of the performance differences observed between individuals are generated by the complex and dynamic system itself of which workers are only one part.
Read More
In order to achieve equitable outcomes for all students, schools must undergo a transformation on an order of magnitude seldom seen in the history of organizations. One such example from history is that of Japanese industry after World War II. This transformation was assisted by a team of American engineers, scientists, and statisticians, but arguably the most instrumental was W. Edwards Deming.
Read More