Moodle Project Inspire – transparent next-generation learning analytics
Moodle/Totara community started Project Inspire. The goal is to create “transparent next-generation learning analytics that go beyond simple descriptive analytics to provide predictions of learner success, and ultimately diagnosis and prescriptions (advisements)” to learners, teachers, content experts and CME/CPS professionals. That sounds great. Right?
As a vibrant open source community, with 106+ million users, Moodle is well positioned to create a powerful learning analytic engine. At this moment, Project Inspire is collecting anonymized user data they can use to train the machine learning engine (+ develop and test additional analytic algorithms). So far bunch of schools and universities contributed anonymized copies of their sites. I’m proud to say that my Alma Mater, the University of Zagreb, contributed the first full data set to Project Inspire in April.
If you use Moodle/Totara 2.7+ you can join the project. Here you can find more about it:Read More
Dr. McMahon encourages innovation and experimentation in CME
We want to do everything we can to encourage innovation and experimentation in CME, so that educators are free to respond nimbly to their learners’ changing needs while staying true to core principles for educational excellence and independence. We thank accredited CME providers for their participation in this process and look forward to their feedback on our proposal and to our continued work together to drive quality in postgraduate medical education and improve care for the patients and communities we all serve,” said Graham McMahon, MD, MMSc, President and CEO, ACCME.
Find more: http://www.accme.org/news-publications/news/ama-and-accme-announce-call-comment-proposal-align-credit-and-accreditationRead More
Distance learning of the U.S. healthcare workforce has a long history, starting with correspondence education in the 1960s (Josseran & Chaperon, 2001). Some popular correspondence programs, such as Refresher Courses in Anesthesiology, were initiated in the early 1970s (ASA, 1973).
Online has become the dominant way of delivering CPD. Five years ago, Harris, Sklar, Amend, and Novalis‐Marine (2010) predicted that “online CPD is likely to be 50% of all CPD consumed within 7-10 years.” Four years later, in 2014, all education delivered by the American Society of Anesthesiologists (ASA) is online or enhanced by online formatting. On the other hand, it has been known for a long time that online CPD programs are as effective as traditional CPD programs (Wutoh, Boren, & Balas, 2004). Consequently 97% of physicians expect more online CPD in the future (archemedx.com, 2013).
Historically, the focus of CPD was primarily on content transmission. More recently, strong societal forces are converging focus shift toward behavior changing learning activities with impact on patient population (Moore, Green, & Gallis, 2009; Russell, Maher, Prochaska, & Johnson, 2012). We can also notice a shift of focus from individuals towards to CPD of groups and organizations (Webster-Wright, 2009).
Five generations of distance education, as described by (Taylor, 2001) and later elaborated on by (Bates, 2008), can categorize the evolution of CPD as provided by the ASA.
- The Correspondence Model, based on print technology, is losing its share and is enhanced with online delivery. However, it still plays a significant part. In 2014, approximately 30% of CPD credits claimed by ASA users was done through that model.
- The Multi-media Model – delivery of multimedia content on print, digital storage devices (CD/DVD, flash memory), or through the Internet, but without any communication among humans. It is well-suited for industrial mass production. It is the dominant method of delivery, with around 68% of credit hours delivered in this format.
- The Telelearning Model delivers synchronous communication, such as webinars, and is used quite rarely in CPD. There were no CPD credits awarded by ASA this year through this model.
- The Flexible Learning Model is based on asynchronous online communication (Bates, 2008). In the U.S., CPD context it is very rarely used. The current LMS used by the ASA does not provide support for it.
- The Intelligent Flexible Learning model will become possible after implementation of the new LMS. It builds on the functionality of the Flexible Learning Model. Some of the additions are: easy access to institutional guidelines and resources; computer-mediated communication; user- generated content; and peer assessment. The system will be integrated with the Anesthesia Quality Institute clinical outcomes tracking system(Dutton, 2014), allowing individuals and groups to assess and reflect on their clinical performance and create improvement and learning plans. The system will also deliver a business intelligence layer that suggests learning based on users’ clinical performance, and performance in courses and certification status.
Specific learning theories are associated with each of those generations. Generations 1 and 2 are associated primarily with behaviorism and cognitivism (Bates, 2008). A majority of CPD is delivered through the first two generations of distance education. Generation 3 is not popular anymore and instead of implementing generation 4 the ambition is to go straight to generation 5. Simultaneously, generation 5 utilizes constructivist approaches like collaborative learning, knowledge construction, communities of practice and self-directed learners (Peters, 2002). Between the first two generations and the fifth generation we have significant technological, theoretical and cultural differences. As described below, the U.S. healthcare reform and recently adopted educational technology solutions will enable those changes to happen in the form of IPL and QIE. However, the technology is just one element in that formula. This research will contribute to those efforts by providing insight into human perceptions of QIE and IPL, and technology enhanced learning solutions available to perioperative care teams.
IPL is a situation “when two or more professions learn with, from and about each other to improve collaboration and the quality of care” (CAIPE, 2002).
QIE is a system-wide educational framework focused on three goals: better care, better health and reduced-cost patient care (Batalden & Davidoff, 2007). Its holistic system design approach tackles all potential barriers for quality improvement (QI), attempting to make permanent system-wide changes. In that context, QI is coordinated with the continuous efforts of all stakeholders – healthcare professionals, patients, researchers, educators and the public – toward better patient outcomes, better system performance and better professional development.
The Alliance for Continuing Education in the Health Professions (ACEHP) in 2015 launched the QIE roadmap (Figure 2). As Figure 2 illustrates, QIE by ACEHP is a continuation of the gradual evolution of CPD from didactic lectures to practice-based activities with real impact on clinical performance. It assumes incorporation and integration of education professionals, tools, resources and methods into system-wide QI efforts. Since successful QIE changes are usually system-wide, and involve multiple professions, the QIE roadmap presented below (Diamond, Kues, & Sulkes, 2015) predicts the currently siloed education of healthcare professionals will evolve in interprofessional education during next 10-to-15-years.
Figure 2. Alliance QIE Initiative: A Transformation Shift – toward interprofessional team-based QIE (Source: Diamond et al., 2015)
QIE and IPL
Knowing that the traditional CPD has limited impact on quality of care (Hager, Russell, Fletcher, & Macy Jr, 2008; IoM, 2010; Macy, 2013), it is fair to say that IPL and QIE have different learning formats and different goals than traditional CPD.
QIE and IPL have numerous similarities. They assume that the best way to ensure individual and system- wide professional development and QI is to have a well-integrated and coordinated system (Shortell, Bennett, & Byck, 1998), where healthcare workers from all professions are connected and focused on meeting the needs of individuals and communities (Macy, 2013). They are each individually described as great tools to address the same three goals: better care, better health and reduced cost (Batalden & Davidoff, 2007; IoM & 2013). Finally, WHO (2010) presented IPL as an important prerequisite for a high-performing collaborative practice and continuous quality improvement. Therefore, QIE and IPL can be viewed as two different entry/view points of the same system-wide QI system (learning/networked health system) – as Figure 3 illustrates. IPL will start with creation of a skilled, collaborative, practice-ready workforce that can practice quality improvement and deliver optimal health services. On the other hand, QIE will start with system changes that require the collaborative practice-ready workforce IPL can produce. Ultimately, they should be treated as two related parts of the same system. Further on, I will refer to them as QIE/IPL.
Figure 3. IPL and QIE entry point or lenses into Health and Learning Health Systems. Left lens is more focused on IPL. Right lens is more focused on QIE. Together they provide the full picture (Adopted from: WHO, 2010, p. 9).
Healthcare is a team sport (Salas, DiazGranados, Weaver, & King, 2008). Healthcare professionals participate in it daily, and each one of us as patients participates in important healthcare events at least a few times in our lives. However, it is a very dangerous team sport. No other team sport has a greater potential for fatal outcomes. For example, the Institute of Medicine concluded that between 44,000 and 98,000 Americans die each year as a result of medical errors (IoM & 2001). Yet healthcare practitioners in the U.S. are rarely trained as a team and they have limited insight into QI methodology (Starr et al., 2015) .
Strong political-economic and social factors shape CPD of healthcare professionals in the U.S. (Balmer, 2013; Cervero & Moore Jr., 2011) and have obstructed interprofessional learning for decades (Hayes, 2012). As history shows, those factors (pay-for service, siloed guilds or accreditation systems, for example) may have a stronger impact than professional and educational factors.
This research will be done in the context of the perioperative care team (surgery and anesthesia professionals). The literature suggests that due to rivalry between professionals or specialties, learning and change in networked practices may be difficult (Norman, 2013). That may be very noticeable in this context where one very relevant issue is a long, intense and passionate debate between physician anesthesiologists and nurse anesthetists over nurse scope of practice (Hayes, 2012). In addition to the main factor – patient safety – nurse scope of practice directly influences positions and payment of physician anesthesiologists and nurse anesthetists, making it a strong political-economic factor (with a huge impact on social capital). For example, in a recent article Johnstone (2015) showed that, in addition to high membership fees ($665), one of the main reasons cited by anesthesiologists for not joining the ASA was related to the ASA’s policy toward Nurse Anesthetists (NAs). It is interesting that while some non-member anesthesiologists think the ASA is working too closely with NAs, others think it is not working closely enough.
On the other hand, new political-economic and social factors started changing that power dynamic recently. Rising costs of U.S. healthcare-associated quality and patient safety issues (Berwick & Hackbarth, 2012; Davis, Stremikis, Schoen, & Squires, 2014) have triggered massive changes in the U.S. healthcare system. IPL is recognized as an important tool to improve performance of U.S. healthcare teams and address the changes that the U.S. healthcare system and the CPD system are undergoing (IoM, 2010; Macy, 2013; WHO, 2010).
One important feature of the current healthcare reform is focus on development and performance of clinical microsystems. Clinical microsystems are small, interdependent groups of healthcare professionals who work collaboratively to deliver optimal and comprehensive healthcare for specific groups of patients (Batalden, Nelson, Edwards, Godfrey, & Mohr, 2003). Clinical microsystems are made up of groups that participate in immediate delivery of care and interact directly with patients, such as physicians, nurses or pharmacists, and groups that support the microsystem, like laboratory, IT and leadership professionals.
Communities of practice can be an important tool to improve performance of microsystems (Webster-Wright, 2009; Wenger, 2006). It is a very flexible tool and depending on purpose, communication methods an structure, they can vary significantly (Ranmuthugala et al., 2011). Results of this research may contribute toward better utilization of technology enhanced CoP methodology in this specific context.
Perioperative surgical home (PSH), a clinical microsystem focused on delivery of perioperative care – from the decision for surgery to complete recovery (ASAHQ.org, 2014) – is the context of this study. The four professions participating in PSH involved in this research will be: physician anesthesiologists, surgeons, nurse anesthetists and anesthesiologist assistants. Those professions were selected because:
- Clinicians are the main stakeholders in the healthcare microsystems and their interactions and professional cultures greatly shape how teams work and the quality of service they deliver (Macy, 2013)
- There is a specific political-economic dynamic between these professions mainly focused on questions of who will lead the PSH team and the role of each profession in that team (Hayes, 2012).
- For the scope of this research, it was important to limit the number of professions involved.
Maintenance of Board Certification – Another political-economic factor
Turbulent changes that affect Maintenance of Board Certification (MOC) of physicians in the U.S. may significantly influence context and implementation of QIE/IPL. Current MOC practices are mainly developed around multiple-choice questions and credit hours. Criticism toward them has been building during the past few years (Gray et al., 2014; Kempen, 2012, 2014; O’Gara & Oetgen, 2014; Strasburger, 2011). In 2014, the Association of American Physicians and Surgeons took the American Board of Medical Specialties and MOC to court, claiming that MOC “imposes enormous ‘recertification’ burdens on physicians, which are not justified by any significant improvements in patient care” (AAPS, 2014). The beginning of 2015 was marked by a nation-wide revolt against MOC. Significant amounts of criticism were supported with the current educational theory and online learning formats that QIE/IPL will promote. As a result, majority of the boards are reorganizing their MOC programs (Baron, 2015).
Organizational and technological context
Thus far, a majority of CPD providers rely on LMS (if they use LMS), which has limited functionality. Such LMS systems are built around a combination of SCORM + files + quiz + survey + certificates, and usually are completely lacking in support for collaborative education. They can address needs of content-focused education, but can’t address needs of collaborative or networked learning. The ASA’s leadership has recognized that and at this moment the ASA is in the process of implementing a new Moodle-based LMS – Totara. Totara comes with all the collaborative features of Moodle. Therefore, it will be a big change. In addition, Totara provides strong support for learning plans and organizational structure/hierarchies. Through the Totara hierarchies’ framework, the ASA can assign specific competencies and courses to specific roles in a team/organization. That feature may enable the ASA to deliver programs for multiprofessional teams.
This research is located in the context of perioperative team. Associations representing the other two key players in the perioperative team – the American College of Surgeons and American Association of Nurse Anesthetists – are planning to select LMSes with the functionality similar to the LMS ASA selected by the end of August 2015. Those selections may significantly influence the context and perspectives interviewees have on QIE/IPL. This research will help better navigate toward better and more coordinated utilization of learning technology available to members of perioperative team.
There are a number of theories that can be used to define and analyze IPL (Hean, Craddock, Hammick, & Hammick, 2012) and QIE. The approach to theory in papers on IPL has been evolving. At the beginning, a significant number of papers were very pragmatic and didn’t describe a theoretical background. Many later papers grounded IPL research in a single theory – usually related to a specific school of thought and academic discipline (Barr, 2013). Finally, at this point, a growing number of papers build a sound, flexible and inclusive IPL frame of references by combining multiple theories and practices. Following that evolution of thought, this research will reflect on a few major theories that can be used to describe IPL and possible interactions/overlaps between different theories.
Social theories (social constructivism, social capital) (Hean et al., 2012), adult learning (Clark, 2006), identity theories, situated learning (Ranmuthugala et al., 2011; Wenger, 1998, 1999) and networked learning (Dev & Heinrichs, 2008) are the main theories relevant to QIE/IPL learning processes. On the other hand, theories most relevant to QIE/IPL context are sociology of professions, organizational theory and activity theory. They may present a compelling example of how different theories complement each other. For example, Larson (1979) argues that professional guilds are actively engaged in monopolizing knowledge in specific areas, to ensure cognitive exclusivity. That may explain why, despite learning organization (Roberts & Thomson, 1994; Senge, 2006) being a very popular theory concept (Barr, 2013), it is especially hard to achieve it among different professional organizations and patients. Fortunately, activity theory allows us to analyze organizations as “distributed, decentered and emergent systems of knowledge” (Blackler, Crump, & McDonald, 2000, p. 278); it provides insight into connections between activities and context and reasoning behind complex social activities.
- AAPS, Association of American Physicians and Surgeons. (2014, Oct 24, 2014). AAPS Takes MOC to Court. Retrieved from AAPS Takes MOC to Court
- archemedx.com. (2013). 2013 Healthcare Professional Continuing Education Preference Survey. Retrieved from http://www.archemedx.com/blog/2013-clinician-continuing-education-preference-survey/
- ASA, Americaln Society of Anesthesiologists (1973). ASA Refresher Courses in Anesthesiology – Volume 1. ASA Refresher Courses in Anesthesiology, 1(1), 1-167.
- ASAHQ.org. (2014). The Perioperative Surgical Home (PSH) Model of Care. Retrieved from http://www.asahq.org/For-Members/Perioperative-Surgical-Home.aspx
- Balmer, J. T. (2013). The transformation of continuing medical education (CME) in the United States. Advances in medical education and practice, 4, 171.
- Baron, R. J. (2015, 2/3/2015). ABIM Announces Immediate Changes to MOC Program. Retrieved from http://www.abim.org/news/abim-announces-immediate-changes-to-moc-program.aspx
- Barr, H. (2013). Toward a theoretical framework for interprofessional education. Journal of interprofessional care, 27(1), 4-9. doi:10.3109/13561820.2012.698328
- Batalden, P. B., & Davidoff, F. (2007). What is “quality improvement” and how can it transform healthcare? Quality and safety in health care, 16(1), 2-3.
- Batalden, P. B., Nelson, E. C., Edwards, W. H., Godfrey, M. M., & Mohr, J. J. (2003). Microsystems in health care: Part 9. Developing small clinical units to attain peak performance. Joint Commission Journal on Quality and Patient Safety, 29(11), 575-585.
- Bates, A. W. T. (2008). Transforming distance education through new technologies. In T. Bates (Ed.).
- Berwick, D. M., & Hackbarth, A. D. (2012). Eliminating waste in US health care. JAMA, 307(14), 1513-1516.
- Blackler, F., Crump, N., & McDonald, S. (2000). Organizing processes in complex activity networks. Organization, 7(2), 277-300.
- CAIPE, Centre For The Advancement Of Interprofessional Education. (2002). Interprofessional Education – The definition. Retrieved from http://caipe.org.uk/resources/defining-ipe/
- Cervero, R. M., & Moore Jr., D. E. (2011). The Cease Smoking Today (CS2day) initiative: A guide to pursue the 2010 IOM report vision for CPD. Journal of Continuing Education in the Health Professions, 31(S1), S76-S82.
- Clark, P. G. (2006). What would a theory of interprofessional education look like? Some suggestions for developing a theoretical framework for teamwork training 1. Journal of interprofessional care, 20(6), 577-589.
- Davis, K., Stremikis, K., Schoen, C., & Squires, D. (2014). Mirror, Mirror on the Wall, 2014 Update: How the US Health Care System Compares Internationally. Retrieved from http://www.commonwealthfund.org/publications/fund-reports/2014/jun/mirror-mirror
- Dev, P., & Heinrichs, W. L. (2008). Learning medicine through collaboration and action: collaborative, experiential, networked learning environments. Virtual reality, 12(4), 215-234.
- Diamond, L., Kues, J., & Sulkes, D. (2015). The Quality Improvement Education (QIE) Roadmap: A Pathway to Our Future. Retrieved from http://www.acehp.org/p/cm/ld/fid=209
- Dutton, R. P. (2014). Quality management and registries. Anesthesiology clinics, 32(2), 577-586.
- Gray, B. M., Vandergrift, J. L., Johnston, M. M., Reschovsky, J. D., Lynn, L. A., Holmboe, E. S., . . . Lipner, R. S. (2014). Association between imposition of a Maintenance of Certification requirement and ambulatory care-sensitive hospitalizations and health care costs. JAMA, 312(22), 2348-2357.
- Hager, M., Russell, S., Fletcher, S. W., & Macy Jr, J. (2008). Continuing education in the health professions: improving healthcare through lifelong learning: Josiah Macy, Jr. Foundation.
- Harris, J. M., Sklar, B. M., Amend, R. W., & Novalis‐Marine, C. (2010). The growth, characteristics, and future of online CME. Journal of Continuing Education in the Health Professions, 30(1), 3-10.
- Hayes, J. C. (2012). Anesthesiologist-CRNA Teamwork Common, but Groups at Odds. Medscape Anesthesiology.
- Hean, S., Craddock, D., Hammick, M., & Hammick, M. (2012). Theoretical insights into interprofessional education: AMEE Guide No. 62. Medical teacher, 34(2), e78-e101.
- IoM. (2010). Institute of Medicine: Redesigning Continuing Education in the Health Professions (9780309140782). Retrieved from http://www.ama-assn.org/resources/doc/cme/iom-report-cme.pdf
- IoM, & , Institute of Medicine. (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Retrieved from http://www.iom.edu/~/media/Files/Report%20Files/2001/Crossing-the-Quality-Chasm/Quality%20Chasm%202001%20%20report%20brief.pdf
- IoM, & , Institute of Medicine. (2013). Interprofessional Education for Collaboration: Learning How to Improve Health from Interprofessional Models Across the Continuum of Education to Practice: Workshop Summary: National Academies Press.
- Johnstone, R. E. (2015, 4/10/2015). ASA Membership: Some Say No. Anesthesiology News. Retrieved from http://www.anesthesiologynews.com/ViewArticle.aspx?d=Commentary&d_id=449&i=April+2015&i_id=1168&a_id=30903
- Josseran, L., & Chaperon, J. (2001). History of continuing medical education in the United States. Presse medicale (Paris, France: 1983), 30(10), 493-497.
- Kempen, P. M. (2012). Maintenance of Certification (MOC), and Now Maintenance of Licensure (MOL): Wrong Methodologies – Wrong Methodologies to Improve Medical Care. Journal of American Physicians and Surgeons, 17(1), 12-14.
- Kempen, P. M. (2014). Maintenance of Certification and Licensure: regulatory capture of medicine. Anesthesia & Analgesia, 118(6), 1378-1386.
- Larson, M. S. (1979). The rise of professionalism: A sociological analysis (Vol. 233). USA: Univ. of California Press.
- Macy, Josiah Macy Jr. Foundation. (2013). Transforming Patient Care: Aligning Interprofessional Education with Clinical Practice Redesign. Paper presented at the Macy Conference on Transforming Patient Care: Aligning Interprofessional Education with Clinical Practice Redesign, January 2013.
- Moore, D. E., Green, J. S., & Gallis, H. A. (2009). Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. Journal of Continuing Education in the Health Professions, 29(1), 1-15.
- Norman, A.-C. (2013). The Implicit or Explicit Character of Negotiation: how Quality Improvements are discussed in Communities of Practicein Health Care. Paper presented at the Microsystems in Healthcare-a scientific perspective 2013.
- O’Gara, P. T., & Oetgen, W. J. (2014). The American College of Cardiology’s Response to the American Board of Internal Medicine’s Maintenance of Certification Requirements. Journal of the American College of Cardiology, 64(5), 526-527.
- Peters, O. (2002). Distance education in transition: New trends and challenges: BIS Verlag.
- Ranmuthugala, G., Plumb, J., Cunningham, F., Georgiou, A., Westbrook, J., & Braithwaite, J. (2011). How and why are communities of practice established in the healthcare sector? A systematic review of the literature. BMC Health Services Research, 11(1), 273.
- Roberts, C., & Thomson, S. B. (1994). Our Quality Program Isn’t Working. In P. M. Senge (Ed.), The Fifth Discipline Fieldbook: Strategies and Tools for Building a Learning Organization. USA: Doubleday.
- Russell, B., Maher, G., Prochaska, J. O., & Johnson, S. S. (2012). Strategic approaches to continuing medical education: applying the transtheoretical model & diffusion of innovation theory. CE Measure, 6(3), 27-31.
- Salas, E., DiazGranados, D., Weaver, S. J., & King, H. (2008). Does team training work? Principles for health care. Academic Emergency Medicine, 15(11), 1002-1009.
- Senge, P. M. (2006). The Fifth Discipline: The Art & Practice of the Learning Organization. USA: Doubleday.
- Shortell, S. M., Bennett, C. L., & Byck, G. R. (1998). Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. Milbank Q, 76(4), 593-624, 510.
- Starr, S. R., Kautz, J. M., Sorita, A., Thompson, K. M., Reed, D. A., Porter, B. L., . . . Bora, P. R. (2015). Quality Improvement Education for Health Professionals A Systematic Review. American Journal of Medical Quality, 1062860614566445.
- Strasburger, V. C. (2011). Ain’t Misbehavin’: Is It Possible to Criticize Maintenance of Certification (MOC)? Clinical pediatrics, 50(7), 587-590.
- Taylor, J. C. (2001). Fifth generation distance education. Instructional Science and Technology, 4(1), 1-14.
- Webster-Wright, A. (2009). Reframing professional development through understanding authentic professional learning. Review of Educational Research, 79(2), 702-739.
- Wenger, E. (1998). Communities of Practice: Learning, Meaning, and Identity. Cambridge: Cambridge University Press.
- Wenger, E. (1999). Learning as social participation. Knowledge Management Review, 1(6), 30-33. Retrieved from https://modules.lancs.ac.uk/pluginfile.php/210525/mod_page/content/37/W3_Wenger%281999%29.pdf
- Wenger, E. (2006). Communities of practice: A brief introduction. Retrieved from wenger-trayner.com website: http://wenger-trayner.com/wp-content/uploads/2012/01/06-Brief-introduction-to-communities-of-practice.pdf
- WHO, World Health Organization. (2010). Framework for Action on Interprofessional Education and Collaborative Practice. Retrieved from http://www.who.int/hrh/resources/framework_action/en/
- Wutoh, R., Boren, S. A., & Balas, E. A. (2004). ELearning: a review of Internet‐based continuing medical education. Journal of Continuing Education in the Health Professions, 24(1), 20-30.
 Totara: Frequently Asked Questions for Positions, Organizations and Competency Hierarchies http://help.totaralms.com/FAQs_for_Hierarchies.htmRead More