An important meeting for this year.

 

www.POLQMWeekendWorkshop.ca

Quality Education: what's it good for?

We are putting together a Master’s in Laboratory Quality Management which we expect will be available both in an on-line option and an on-site option.  The on-line will primarily be for folks who are working and intend to continue to work.  The on-site will be for folks who want to take some time away and spend some time doing primary research in medical laboratory quality.  I will continue to write on the subject as the program becomes ready for prime-time.

In the process of putting the proposal together, we did a survey of the folks who participated in the UBC Certificate Course.  Rather than invite and re-invite folks to respond to the survey we made the decision to take the responders from the first pass.  Both approaches can be equally useful, as long as you take methodology  into consideration as you interpret the results.

So after 5 days we gathered about 25 percent of course attenders.  The distribution of folks from across British Columbia and across Canada, and from outside Canada were essentially the same as the total group.  In addition the responders  equally included participants from the early years, the middle years, and the recent years, and few from the current group.   As we did not put any pressure on this group we can interpret this as a reasonably representative group.

Of interest to us was that about 90% belief there is a market for people with a Master’s degree today, and that the same percentage see that the market will be much stronger over the next 5-10 years.  That is what I believe too.

One finding that interested me, and disappointed me at the same time, was that only about 65% of responders currently are holding positions involved directly  in Quality.  We didn’t ask how many had held quality positions but had changed jobs, in large part because that was not the primary point of the survey  But what was interesting was that folks who had taken the course but were not actively engaged in Quality positions still believed there are opportunities out there, and that the market will continue to get stronger.

Which all got me to thinking; there are all sorts of positions for people interested in and trained in Quality.  The most obvious position is as part of a quality team or a part of laboratory  management.  But there are lots of other places as well.  There are positions with all the quality partners, like the proficiency testing group and the accreditation bodies.  There are positions within public or civil service, especially within the Ministries (or Departments) of Health and the health authorities, where knowledge of laboratory quality is important.  There are positions with service and equipment and reagent suppliers who need to be aware of validation, verification, stability, and measurement uncertainty.  And there are consultant positions, especially as we in Canada move more and more towards official inquiries for laboratory error.  And importantly there are increasing opportunities within education with the schools of technology, as well as the medical schools.

Bottom line appears to be that Quality in health and in particular the medical laboratory is a growth opportunity; today and tomorrow, and from the folks who responded to our survey, for the next 5-10 years plus.

Resident Quality Seminars as Adult Education

A few weeks ago I wrote (See “Communicating Quality and the Principles of Adult Education - January 30th 2011) that adults learn what they want, and  how they want and accept the knowledge if it makes sense and is consistent with what we already know.  The educator needed to be seen to be organized and pragmatic and relevant and interesting.  If adults are motivated they learn better.  

So with this in mind, can I make any objective comments about my own teaching capabilities?

I got back the results from my Resident Seminar Series.  
 
Background 
To summarize, I put on a seminar series for anatomic and general pathology residents.  The series begins the week after New Years and my sessions start at 08:00 AM.  A draw to the academic half day program is that they get a free breakfast when they attend.  
Before I start the seminar series  I create an anonymous on-line survey that includes a series of 10 questions on quality facts, along with some demographic information.  I then present 7 hours of seminars over 4 sessions and give 1 hour to a guest presenter, and after that asked the group to respond to a second on-line survey which asked the same questions as before and added some additional comments on the series based on a 7 point Likert ranked scale with a maximum value of 6.0

Attendance
The pre-seminar survey had 25 responders.  
On average there were 29-31 attenders to the seminar series.  Nearly everyone attended all 4 sessions.
The post-seminar survey had 14 responders.

Findings
So my first point.  Adult learners do what they want and respond to surveys if there is something on the table.  After the series we were able to get 14 responders (despite repeated requests).  Not getting a better response rate in the post-survey was annoying, but it is what is is.  

My second point:  There was improvement in the responses to all the fact based questions.  There was significant improvement (yates corrected p<0.05) in 2 questions.

My third point:  The responders found the information relevant to their career (5.5/6.0)  informative (5.36/6.0), relevant to their residency (5.29/6/0), and relevant to preparation for examinations (5.07/6.0)  The weakest response was when the group found the information interesting (5.0/6.0).  

Interpretation.  
Overall I can this a success.  Not an overwhelming success, but a success none the less.  

What was encouraging was that after the series, one resident  approached the hospital quality manager to get engaged in a project, and one resident approached me on a similar topic.

The increase in knowledge performance was ojectively positive and in part significantly so.  And there is a powerful opinion and recognition that knowing something about quality is important in a laboratory career.

Discussion and Conclusion
The objective measures point to the seminar series as a measurable success with opportunities for improvement.

Teaching my on;line course is the ideal adult education situation.  The participants seek us out because they want the information.  There is money on the table.  They feel free to participate actively.
With residents, they are present because they feel required to be there, even if they don’t care.  At worst they still get a free breakfast.  There is no money on the table.  They feel free to drop out if they are not being entertained.   

Note to myself:  
Look forward to doing the seminar series again, maybe next year, more likely in 2 years.  
Make some changes to beef up interest.  
And importantly don’t take the weak response rate too personally.  If they really thought the series stunk they probably would have taken full advantage to let me know.  

PS:
The information will be presented more completely and formally during the POLQM Quality Weekend Workshop in June.  There will be an education breakout session.

Ranting on a Rant.

A recent article in Quality Digest Daily (www.qualitydigest.com) posed the question “Internal Quality Audits – Valuable or False Security?”  The question was written within The QA Pharm, an anonymous blog focused mainly on issues in the Pharma industry.  

An interesting question, with an even more interesting answer.  QA Pharm contends that internal audits are not helpful because they tend to be done by auditors who have been working too long and who are too politically aware and avoid sensitive concerns, and senior management doesn’t support them anyways.  And they never get to the root cause because company culture gets in the way.  

In a way I am not too surprised by the rant.  My experience with folks who have transitioned from pharma to health care is that the pharma culture is hyper reactive to the point of absolute risk aversion, which tends to either paralyze or drive folks in the opposite direction.   People who care for pharma quality tend to get extremely passionate.  The rest get bashed to indifference.

Pharma does have certain problems.  Most drug release decisions are made through a series of graduated studies, on pharmaceutical effect, and then controlled safety studies, and then “larger” population studies, and then after-the-fact post-market analysis.  In their world even 6 sigma (3 defects per million) can be enough to sink the ship.  But they are not unique.  It only takes one airplane to fall out of the sky or one bridge to fall down to create industry chaos.  

In contrast the health care may be a little more tolerant, maybe too tolerant.

My biggest problem with QA Pharm is not on his opinions with respect to the frustrations of practicing qualitology in the pharmaceutical industry.  It is more with the folks who read the rant, and interpret the opinion as generalizable.  

Health care laboratories are just at the beginning part of the quality process and the introduction of internal quality audits is just being introduced in a significant way.  That is not only true in Vancouver, but it is my personal experience that this is the case across Canada, across the United States, and in many countries worldwide.  This is not the time for health care laboratorians to be thinking that internal quality audits are a waste of time, or too political. 

Internal quality audits can and should be an important component of technologist training, quality manager training, pathologist training.  They can and must (shall) be a component of quality monitoring infrastructure, and the foundation of quality research and outreach.

So QA Pharm can have his(?) point of view, and that is fine, if it is intended to apply only to the pharma industry.  That internal audits are a WOT, is not my point of view and it has no place in health care laboratories.

Memo to self: Ranting is a good thing, but don't expect everybody to agree with you.

m

PS:  Some of you may be in the receiving group for a POLQM Weekend Workshop blast out. next week.

PPS:  Some of you might consider sending the link to to friends and colleagues who might be interested.  All a part of being within an interest network.  Twitter works well as well.

Communicating Quality and the Principles of Adult Education

In recent while, I have been engaged in the active promotion of  medical laboratory quality in a variety of forums, including writing this web-log, providing an on-line course, hosting single-site lunch time education,  hosting the resident seminar series, and organizing and participating in workshops and conferences.  All of them have provided me with the opportunity to consolidate my own philosophy towards Quality.  

There is a lot of differences between all these activities; some have been held in Canada and others are international, some are one-off events while others short-term multiple events, and others yet are long multiple events, some of them are at no-charge to the participants while others are at substantial cost. Some of the participants want to be participating while others they are there because they feel compelled for one reason or another.  It would be easy to say that the only thing they have in common is a common topic, but there is something of far greater commonality; all the participants are adults.

Teaching adults is a special event because adults learn in their own special way.  There is tons written on adult learning.   For a quick summary you can visit Principles of Adult Learning at the University of Hawaii site.  

There are lots of reasons that people attend courses.  For learning, the most successful reasons are when they believe there is something in it for them; it is a topic of interest or there is an opportunity for career advancement.  Sometimes it is less about knowledge, and more about the social aspects; is a way to meet and connect with others, or is better than just being bored.  These folks may not be focused on learning, but they might connect.  Sometimes folks attend solely because they have to; it is a requirement and attendance is being taken.  This never turns out well.

Adults are autonomous and self-directed, and learn on top of their accumulated knowledge and life experiences, which means we learn what we want and how we want and accept the knowledge if it makes sense and is consistent with what we already know.  And we learn if we see the purpose to the information and especially it is meets our own goals.  And we are practical and pragmatic learners; if the information is not organized and timely then we turn-off. 

Adults tend to learn best if motivated, especially if we can link the information to what we do as a matter of competence or promotion, or job enrichment.  (Some say we learn better if there is money on the line.)  

For the educator, this means that the successful ones make the information relevant to what people do, is consistent with what they already know and link the knowledge to competence and enrichment.  Keep the information organized and timely and interesting.  For me, I have been involved as an adult educator for over 30 years.  When I think back to what I was like when I started, I can say with confidence that I am a lot better today than I was back then.  And one of these days I may actually get it right.  

One of the most successful educators I know has a formula.  He has 3 points to make (4 points a maximum).  He makes his points and reinforces them with stories and humor.  When he has delivered his points and told his stories, he stops.  I’m pretty good at the selecting 3-4 points and the telling stories.  I am pretty weak at the humor, and tend talk until I run out of time, rather that knowing when to stop.

Memo to self:  with widely divergent groups, some folks are there because they want to be there; others are not.  Remember the motivation; point of why knowing about Quality is an important   component of competency and enrichment, and can have an impact on promotion.  Be organized and know when to stop talking.  After than, the rest is largely out of your control, so don't worry about it.

m

PS: I am accumulating the post seminar series data now.  Will share the results soon.

PPS:  Big changes at www.POLQMWeekendWorkshop.ca  Lots of NEW information.