Using What Works and NOT Using What Does Not Work
Posted on 20/01/2010 | 1 Comments
Recently, my research team published a scientific commentary in the Canadian Medical Association Journal dealing with an important mental health concern. We conducted an assessment of the information dealing with psychological debriefing in schools and found that there was no substantive evidence to support the use of that kind of intervention following traumatic events. We also found that the best available evidence in studies of adults showed that these type of interventions were not helpful, and indeed in some studies turned out to be harmful (see: Psychological debriefing in schools, www.cmaj.ca Online publication, January 4, 2010)...
Yet, these interventions have been very popular and used so frequently that they have become commonplace. Who has not heard the news on the radio that grief counselors have been dispatched to a school after a traumatic event?
This raises a very important issue. That is, before we start wide-scale mental health interventions we need to be pretty sure that they work and we need to be really sure that they do not cause harm. If we put programs into place that do not work we are creating a false sense of security and using scare resources; money and people, to no good end. Furthermore, because of our investment in such programs we may be less interested in considering other options – options that may actually work. In other words, what seems like a good idea may not be a good idea and if that gets codified or ingrained in an organization or institution it may have more negative than positive consequences.
So, what is to be done? First, when we do get solid substantive evidence that what we are doing does not really work, is not cost effective, could be done better in a different way or may cause harm – we should stop doing whatever that is that we are doing. Sounds simple but it is not so easy. Usually because there has been a big investment in the initial program and there may even be a big industry and local champions pushing for its continuation. Second, before putting in a program we should demand solid substantive evidence that the program really works and that it causes no harm. Third, if we decide to put programs in without the kind of evidence we need to have, we better make sure that we also provide the kind of independent and unbiased research that is needed to help us determine if the program works or not, if it is cost effective and it does not lead to harm!
We have to do the right thing, not just do something.
--Stan
Blog Tag Cloud
adhd anxiety disorders attention award awards behaviour bipolar blog brain & neurology bullying canada care carter center conference confidentiality control coping criminal justice system cruelty cutting depression discrimination doctor driving eating disordersRecent Comment
This is a great set of comments and rings very true.
I totally agree that scientists (just like everyone else) have their biases and foibles. After all, scientists are human beings too! But science is different than scientists.
The scientific method is the most objective frame that we have by which to evaluate and predict. Science is not about finding truth. It is only about being less wrong most of the time. The scientific method (experimental design and mathematics) gives us the ability to test what we believe. The scientific method is not used to prove something is correct, on the contrary, the scientific method is designed to prove that something is not correct! It is designed to test what is called the “null hypothesis”. It takes ideas that come out of left field (or wherever else they come from) and puts those ideas to an independent test.
t does not drive our beliefs. It does however challenge our beliefs. In that way it is self-correcting. Of course scientific inquiry and understanding lives within a wider social context. That is one of the great features of science.
But gravity is gravity, social context notwithstanding. And thus it is nasty, brutish and long. As Brecht said, (something like this) - the purpose of science is to save us from everlasting error.
By Christina Carew on May 11th
We would like to say thanks...
Without their help this initiative would not be possible. Thanks for you help.






What people are saying?
dholl said...
How important an issue is this? “That is, before we start wide-scale mental health interventions we need to be pretty sure that they work and we need to be really sure that they do not cause harm.” Can there be a more important question to ask about our service to kids? This is long overdue and requires much work. Can we as educators and parents hope that we will provide wide-scale mental health interventions for kids that will make a positive difference in their lives? Let’s hope!
Comment made on February 04th, 2011
What do you think?