No conflicts of interest reported.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
This article will outline the background and development of a longitudinal curriculum in information mastery in the Oregon Health & Science University (OHSU) Family Medicine Residency program.
IntroductionOver 2.79 million pages of journal articles are published annually in MEDLINE. This number has likely increased since the time of the publication of the manuscript that highlighted this information (2005), given the fact that the number had increased by nearly a million pages per year from the prior decade.[1] Academic clinicians and teachers often comment on the inability to âkeep upâ with the information overload that is happening in medicine. Due to the dramatic increase in available information in the literature and a desire to move away from anecdotal practices in medicine the field of evidence-based medicine (EBM) was born. While some resources would site EBMâs philosophical origins dating back to the mid-19th century,[2] frequently cited sources in the field of Family Medicine date to the more recent 1990âs as a time when EBM began to take its roots in primary care education and training.[3] Despite having had these important perspectives in the medical literature for over the past 20 years, many Family Medicine residency programs have struggled with the development and incorporation of a curriculum in âinformation masteryâ. Only recently have quality articles appeared reviewing newly developed curricula in information mastery and evidence-based medicine.[4] This article will outline the background and development of a longitudinal curriculum in information mastery in the Oregon Health & Science University (OHSU) Family Medicine Residency program.BackgroundThe information mastery longitudinal curriculum was one component of the revision of the entire Family Medicine Residency program at OHSU as it transitioned from a three-year to a four-year training program in July 2012. The program is taking part in the four-year Family Medicine Residency Pilot, which has been approved by the ACGME and will be overseen by a specially designated committee from the Review Committee for Family Medicine.[5] Along with rotation modifications and transitions, the residency program incorporated three new longitudinal curricular threads into the training program: Information Mastery, Leadership and the Patient-Centered Medical Home. Each curricular thread targeted a specific year in the residency-training program and the Information Mastery curriculum was placed in the second year of the residency. The residency leadership anticipated that, being in the second year, the residents in the program would have been exposed to some evidence-based medicine practices in the clinics and hospital settings, observed some of the data and reports that were being distributed to the clinicians in the practices, and had an opportunity to migrate away from a focus through internship that was largely concentrated on the immediacy of patient care.Literature and Relevance to Family Medicine Residency TrainingKhan and Coomarasamy describe a hierarchical approach to effective teaching and learning in order to acquire competence in evidence-based medicine.[6] The lowest level in this hierarchy includes content that is solely didactic, classroom or standalone teaching time. As one progresses up to higher levels in the hierarchy clinically integrated and interactive activities are included. At the highest level of the ranking interactive and clinically integrated activities are combined. We decided to incorporate this highest-level approach in the development of the information mastery curriculum, to ensure that we had the best chance of the residents developing competency in this important area. Thangaratinam et al. compare the traditional learning environment with the 21st century learning environment. In their article, the authors describe how traditional clinical teaching occurred through âosmosisâ of the senior clinician imparting their experience and authoritative practice upon the medical decision making of the learner. This is contrasted with the modern learning environment where learners should be asking an answerable question, acquiring and appraising the evidence, and subsequently integrating this evidence into practice and applying the evidence in the learnersâ medical decision making.[7] Slawson and Shaughnessy have also argued that, âThere is a need to teach the applied science of information management along with, or perhaps even instead of, teaching the basic science of EBM.â[8]The current version of the ACGME (Accreditation Council for Graduate Medical Education) Program Requirements for Graduate Medical Education in Family Medicine, which went into effect in July 2007, specifically identifies areas of practice-based learning and improvement (one of the six core competencies) including the ability to locate, appraise, and assimilate evidence fromscientific studies related to their patientsâ health problems and using information technology to optimize learning.[9] The more recently developed âmilestonesâ, which are a joint venture of the Accreditation Council for Graduate Medical Education and the American Board of Family Medicine, identify the highest obtainable level (Level 5) of practice-based learning and improvement (PBLI-1) as, âIncorporates principles of evidence-based care and information mastery into clinical practice.â[10] Residency programs will be held accountable for meeting these important milestones in the future. The American Academy of Family Physicians (AAFP) has developed recommended curriculum guidelines for Family Medicine residents relating to scholarly activity and information mastery, which have also been endorsed by theAssociation of Departments of Family Medicine(ADFM), the Association of Family Medicine Residency Directors(AFMRD), and the Society of Teachers of Family Medicine(STFM).[11] The guidelines include recommendations regarding the expected knowledge, skills and attitudes of residents towards specific elements of information mastery. Lastly, a new online resource is available to Family Medicine residencies: the Family Medicine Residency Curriculum Resource (http://www.fammedrcr.org/).[12] This website includes a large number of curricular resources for Family Medicine residency programs, including content relating to information management.
Development of the CurriculumSee Table 1 for a list of the concepts and issues that were considered in the development of the new Information Mastery Curriculum. Using the Kern six step approach to curriculum development,[13] we first identified the âproblemâ we were trying to address: the data from our electronic health record (EHR) was demonstrating inadequate and inconsistent application of preventive health services in our clinic populations (including immunizations, screening tests, etc.), resulting in suboptimal patient care. We also recognized that our Family Medicine residents did not have a unified curriculum in information mastery and evidence-based medicine and were receiving information about these areas in an ad-hoc fashion during our regular didactic time. In terms of a needs assessment of the targeted learners, we recognized that there was variable understanding of the basic principles of EBM and basic statistics, which would need to be addressed as a component of the curriculum.The residency program decided to provide 2 hours of weekly time to the curriculum, spanning a total of 16 weeks. The use of 16 weeks was arbitrary but strategic, given the fact that the residency has three outpatient practice sites with 12 residents at each site. Time in the second year of training would be equally split amongst the residents from the three training sites, totaling 48 weeks (in addition to 4 weeks of âintensivesâ â one week blocks of dedicated didactic time, spaced throughout the year). In order to maximize the incorporation of adult learning theory principles we decided to have a self-directed learning session precede each small group session. Research has demonstrated that active learning can enhance academic achievement,[14] promote superior skills in social and cognitive performance,[15] superior professional competencies, [16] [17] retention and application of knowledge, [18] enhanced understanding and mastery of course content, [19] and mastery of difficult subjects.[20] The small group sessions in the week following the self-directed learning session were with a faculty member who possessed some extra knowledge or expertise in the content area for that session. The faculty-facilitated sessions would allow the residents an opportunity to review the work and concepts from the self-directed session the prior week. Goals and objectives were developed for each of the self-directed and faculty facilitated sessions. Table 1: See Illustration 1 Table 2 itemizes the 16 sessions that were included in the Information Mastery Curriculum. See Illustration 2
Evaluation and OutcomesIn this first year of implementation of the Information Mastery curriculum, feedback about the curriculum has come from both residents and faculty. A summary of the salient themes in terms of feedback from residents and faculty in the Family Medicine Residency program can be found in Table 3.
Various evaluation tools have been utilized in publications relating to information mastery and EBM curricula. Cabell and colleagues measured the number of Ovid log-ins during resident rotations[21] and Ross et al. measured the number of EBM terms used during continuity clinics after introducing an EBM curriculum into a Family Medicine Residency. Others have utilized resident ratings of self-confidence in EBM knowledge and skills after implementing an EBM curriculum[22] [23]or resident attitude and knowledge quiz scores after working with a learning coach.[24] A modified version of the Fresno test of EBM[25] was also utilized in one Family Medicine Residency after implementation of an information mastery curriculum, though the authors admitted the use of the grading rubric difficult to apply and ârequired several practice sessions to calibrate gradingâ.[4] A systematic review of instruments used for evaluating education in evidence-based practice identified 104 unique instruments.[26] Since it was the first year of implementation of the information mastery curriculum at the OHSU Family Medicine Residency, a specific evaluation tool has not been utilized yet. There has been concern expressed by the leadership in the residency and faculty involved in the curriculum that there does not appear to be a validated instrument that would adequately capture the anticipated outcomes from this new and innovative curriculum, since many of the sessions explore novel content.
The OHSU Family Medicine Residency has successfully implemented a new information mastery curriculum as one component of the new four year residency program. Mixed feedback from the involved residents demonstrates ample opportunities for refinement and improvement of the curriculum. The greatest challenge though will be finding a suitable evaluation tool or instrument that can measure the resident outcomes after participation in the longitudinal curriculum. While the measurement of EBM knowledge, skills, attitudes and behaviors would be very useful, perhaps the most important variables relate to patient-oriented outcomes, which have been infrequently measured in the EBM literature. This is an area that requires attention in EBM research moving forward. Additionally, while assessing resident awareness and use of EBM during their training is valuable, continuing to practice the use of EBM after residency is of utmost importance. Unfortunately, an exploratory study of residency graduatesâ practice habits found that residents instructed in EBM skills did not regularly practice these skills after graduation, in large part due to time and workload pressures,[27] emphasizing the importance of also studying long-term clinically oriented behaviors in trainees.
evidence-based medicine (EBM)Oregon Health & Science University (OHSU)
OHSU Family Medicine Residency
1. Druss BG, Marcus SC. Growth and decentralization of the medical literature: implications for evidence-based medicine. J Med Libr Assoc. 2005;93(4):499-501.2. Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. 1996. Evidence based medicine: what it is and what it isn't. BMJ 312: 71â2 [3].3. Slawson DC, Shaughnessy AF. Teaching information mastery: creating informed consumers of medical information. J Am Board Fam Pract. 1999 Nov-Dec;12(6):444-9.4. Shaughnessy AF, Gupta PS, Erlich DR, Slawson DC. Ability of an information mastery curriculum to improve residents' skills and attitudes. Fam Med. 2012 Apr;44(4):259-64.5. Cleared For Takeoff: The 4-year Family Medicine Residency. Ann Fam Med 2012;10:84-85.6. Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ. 2006:15;6:59.7. Thangaratinam S, Barnfield G, Weinbrenner S, Meyerrose B, Arvanitis TN, Horvath AR, Zanrei G, Kunz R, Suter K, Walczak J, Kaleta A, Oude Rengerink K, Gee H, Mol BW, Khan KS. Teaching trainers to incorporate evidence-based medicine (EBM) teaching in clinical practice: the EU-EBM project. BMC Med Educ. 2009:10;9:59.8. Slawson DC, Shaughnessy AF. Teaching evidence-based medicine: should we be teaching information management instead? Acad Med. 2005;80:685â689.9. ACGME Program Requirements for Graduate Medical Education in Family Medicine. From:http://www.acgme.org/acgmeweb/Portals/0/PFAssets/ProgramRequirements/120pr07012007.pdf. Accessed June 3, 2013.10. The Family Medicine Milestone Project. From: http://www.acgme-nas.org/assets/pdf/Milestones/FamilyMedicineMilestones.pdf. Accessed June 3, 2013.11. Recommended Curriculum Guidelines for Family Medicine Residents: Scholarly Activity and Information Mastery. From:http://www.aafp.org/online/etc/medialib/aafp_org/documents/about/rap/curriculum/reprint280.Par.0001.File.tmp/ResidentsGuidelinesReprint280.pdf. Accessed June 3, 2013.12. Information Management. From:http://www.fammedrcr.org/access-curriculum/information-management. Accessed June 3, 2013.13. Kern DE, Thomas PA, Howard DM, Bass EB. Curriculum Development for Medical Education: A Six-step Approach. Baltimore: Johns Hopkins Press; 1998.14. Trappler B. Integrated problem-based learning in the neuroscience curriculum--the SUNY Downstate experience. BMC Med Educ. 2006 Sep 18;6:47.15. Koh GC, Khoo HE, Wong ML, Koh D: The effects of problem-based learning during medical school on physician competency: a systematic review. CMAJ 2008;178:34â41.16. Neville AJ. Problem-based learning and medical education forty years on: A review of its effects on knowledge and clinical performance. Medical Principles and Practice 2009; 18: 1-9.17. Schmidt HG, Vermeulen L, van der Molen HT. Long-term effects of problem-based learning: A comparison of competencies acquired by graduates of a problem-based learning and conventional medical school. Medical Education 2005; 40: 562-567.18. Gurpinar E, Musal B, Aksakoglu G, Ucku R. Comparison of knowledge scores of medical students in problem-based learning and traditional curriculum on public health topics. BMC Medical Education 2005; 5: 7.19. Cortright RN, Collins HL, DiCarlo SE. Peer instruction enhanced meaningful learning: Ability to solve novel problems. Advances in Physiology Education 2005; 29: 107-111.20. Michael J. Whereâs the evidence that active learning works? Advances in Physiology Education 2006; 30: 159-167.21. Cabell CH, Schardt C, Sanders L, Corey GR, Keitz SA. Resident utilization of information technology. J Gen Intern Med. 2001 Dec;16(12):838-44.22. Thom DH, Haugen J, Sommers PS, Lovett P. Description and evaluation of an EBM curriculum using a block rotation. BMC Med Educ. 2004 Oct 11;4:19.23. Allan GM, Korownyk C, Tan A, Hindle H, Kung L, Manca D. Developing an integrated evidence-based medicine curriculum for family medicine residency at the University of Alberta. Acad Med. 2008 Jun;83(6):581-7.24. George P, Reis S, Nothnagle M. Using a learning coach to teach residents evidence-based medicine. Fam Med. 2012 May; 44(5):531-5.25. Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence-based medicine. BMJ 2003;326(7384):319-21.26. Shaneyfelt T, Baum KD, Bell D, Feldstein D, Houston TK, Kaatz S, Whelan C, Green M. Instruments for evaluating education in evidence-based practice: a systematic review. JAMA. 2006 Sep 6;296(9):1116-27.27. Yew KS, Reid A. Teaching evidence-based medicine skills: an exploratory study of residency graduates' practice habits. Fam Med. 2008 Jan;40(1):24-31.