Nil
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Objective: To determine the internal consistency and construct validity of the AL-i among first year medical students. Methods: Cross sectional study was done on 196 first year medical student in Universiti Sains Malaysia (USM). The items of AL-i were framed based on the adult learning principles. The Cronbachâs alpha reliability analysis and factor analysis were applied to measure internal consistency and construct validity respectively. The analysis was done using Statistical Package for Social Science (SPPS) version 18. Result: A total of 196 medical students responded to this study. The Cronbachâs alpha value of the AL-i was 0.798. The Cronbachâs alpha values of adult learner and child learner domains were 0.85 and 0.81 respectively. Factor analysis showed that on 10 items were nicely loaded into two constructs as their factor loading values were more than 0.3. Approximately 2 out of 12 items were removed from the inventory because they did not fit into the intended domain. Each domain of the final version AL-i has 5 items. Conclusion: The AL-i has shown good psychometric values. It is a valid and reliability tool to determine adult leaner status among medical students. It is a promising psychometric instrument that can be used to determine types of learner among students in future.
The variation between individuals is almost never-ending because each one of us has very unique characters that make our ways of learning are different from others. In general learning is referred to an active and lifelong process of acquiring information through various medium where the information are transformed and translated into meaningful ideas that lead to formation of knowledge, skills, behaviour and attitude (1-3). The core characteristics of how person learn that remain stable for life can be referred as learning traits. They are thus a good and visible predictor of learning patterns and styles. It is worth noting that part of an effective educator involves understanding how learners learn best (4).In general, learners can be grouped into two types which are adult learner (andragogic learner) and child learner (pedagogic learner) (4-7). The word andragogy was derived from the Greek word aner which means man not boy and agogus which means leading. While the term pedagogy was originated from Greek word paid which means child. That is why andragogy and pedagogy are commonly referred as the art and science of teaching adults and children respectively (6, 7). It is worth to mention that part of an effective learning involves understanding of how we learn best (6, 8).Adult learners are always known to be as independent learner and self-directed leaner (6, 8). They decide what important to learn and act as a resource for learning whenever they are needed by other learners (8). Their learning are driven and affected by the need to know something or to do something where they validate any information given to them before accepting it. When they learn they relate their belief and experience upon their new learning experience where they tend to immediately make use the learning experience to their jobs (6, 8). They tend to take active role in planning, monitoring and evaluating their learning (8). In contrast, pedagogic learners are known to be as dependent learner and more teacher-directed where they rely on others to decide what is important to be learnt (6 -8). Their learning is affected by desire to meet course requirement and tend to be rot learners where they accept all information given to them at face value without validating it (7, 8). They have very limited knowledge and experience to relate upon their learning where they expect their learning to be useful in long-term future; that is why they have little ability to serve as resource learning to other learners (5-8). It should be noted that understanding of nature of learners will be advantages for educators to enhance learning experience of the learners (9-11). One of instruments that can be used to identify types of learners is the Adult Learning Inventory (AL-i) (8).Validity is defined as to what extent the measurement measures what it should measure, whereas reliability is generally defined as consistency or reproducibility of measurement over time or occasions(12-15). Both validity and reliability are important qualities that an inventory must be tested for in order to ensure it measures what it is supposed to measure and the measurement obtained is reproducible over time and occasion if similar measurements are being measured. The Reliability analysis of Cronbachâs alpha and factor analysis are commonly used by researchers to determine the internal consistency and construct validity of an inventory (13-14). From that notion, similar analyses were applied to determine the internal consistency and construct of the AL-i.This study described the reliability and validity of the AL-i, which was developed based on the andragogy and pedagogy theories (6, 7) to assess nature of learners with the hope that it can be used as a valid and reliable instrument among medical students. It is hoped that this study may provide some validity evidence in the use of the AL-i to identify nature of learners thus will help medical educators to understand better about their studentsâ nature of learning.
The Adult Learning Inventory (AL-i)The inventory was developed based on the principles of pedagogy and andragogy that were proposed by learning theory researchers [6, 7]. The items of AL-i were framed literature review and discussion with the experts in medical education. The items were designed based on its compatibility and suitability with medical professional qualities, local culture and values. Items conveying characteristics of the andragogic and pedagogic learner most clearly were selected. About six items were selected for each group of learner. The items were undergone a process of scrutiny and evaluation as a result of it the language of the items was modified to make it simple and suitable to express the concept implied. Each item of the AL-i was rated using 5-likert scores (1=least like you, 2=in between scores of 1 and 3, 3= 50% like you, 4=in between scores of 3 and 5, 5=most like you) to indicate how close the statement described the respondentsâ behaviour.Expert evaluation of the itemsIn order to establish the content validity of the AL-i, the items were subjected to expertsâ evaluation. The experts were drawn from the field of Medical Education. Necessary modifications were made with the feedback given by the experts.Preliminary try-outThe items were administered to a sample of 100 first year medical students and 20 medical teachers to check their applicability and face validity during separate face-to-face sessions. The students and medical teachers were encouraged to express their doubts freely. Necessary modifications were made with the experience gained through this preliminary try-out. The selected 12 items according to the learner groups are shown in table 2.Validation studyPurposive sampling method was applied. Approximately all 196 new first year medical students were selected as respondents. Proper instructions were given before the administration of the questionnaire. The applicants were asked to respond to all the statements and no time limit was imposed. During the time of administration the investigator gave proper assistance and directions whenever necessary.Study subjectsPopulation of this present study was 196 new first year medical students at the School of Medical Sciences, Universiti Sains Malaysia. All of them were selected as study subjects.Collection of dataThe investigator obtained permission and clearance from the School of Medical Sciences and Human Ethical Committee of Universiti Sains Malaysia. Informed consent was obtained from the respondents and they were requested to fill in the questionnaire. Completion of the questionnaire was voluntary and the respondents were informed that not returning the questionnaire would not affect the studentsâ progress in the course. Data was collected by guided self-administered questionnaire. The questionnaires were collected on the same day.Factor AnalysisCollected data was analysed using Statistical Packages Social Sciences (SPSS) version 18. Factor Analysis was done to determine construct validity of the AL-i. Kaiser-Meyer-Olkin (KMO) test and Bartlettâs test of sphericity was applied to measure the sampling adequacy (16). The sample was considered adequate if i) KMO value was more than 0.5 and ii) Bartlettâs test was significant (p-value less than 0.05). Principal Component Analysis (PCA) method was applied in extraction of components. Components with Eigen values of over 1 were retained. With the assumption that all items were uncorrelated with each other, Varimax rotation was applied in order to optimize the loading factor of each item on the extracted components. Items with loading factor of more than plus or minus 0.3 were considered as an acceptable loading factor (16). Once constructs of the AL-i were finalised, reliability analysis for each construct was done.Reliability analysisReliability analysis was done to determine the reliability of the questionnaire. Internal consistency of the items was measured by using Cronbachâs alpha coefficient. For an estimation of reliability, statistical reliability of individual items was done. Items with corrected-item total correlation value of more than 0.3 were selected and items with corrected-item total correlation value of less than 0.3 were deleted. The Cronbachâs alpha value of deleted item could determine which item highly contributed to the reliability of the AL-i. If the Cronbachâs alpha value for those items-deleted decreased, it would indicate that the items highly contributed to alpha value. In contrast, if the Cronbachâs alpha value for those items-deleted increased, it would indicate that the items poorly contributed to alpha value. The items of AL-i were considered to represent measure of good internal consistency if the total alpha value was more than 0.6 (15).
A total of 196 (100%) medical students participated in study. Table 1 shows the demographic profile of the respondents. In general the demographic profile represents the Malaysian population. Majority of the respondents were female (65.3%), Malays (53.6%) and came from the matriculation (88.8%) stream. It seems that most of the respondents originated from urban areas (50.5%) and various economic strata. Initial factor & reliability analysis The sample was adequate as indicated by i) a KMO value of 0.798 and ii) Bartlettâs test of sphericity being significant (p-value < 0.001). Table 2 showed the initial factor analysis where 2 components were extracted using principal component analysis (PCA with rotation of Varimax). It seems that Q9 were loaded into different group therefore this item was removed from the inventory for final analysis. Q3 and Q8 were loaded on both groups; item will be removed if the Cronbachâs alpha value for those items-deleted increased. Total variance explained by these two components was 55.88%. Table 2 showed that the Cronbachâs alpha value of the AL-i was 0.703. The Cronbachâs alpha values of the andragogy and pedagogy domains were 0.57 and 0.77 respectively. The reliability analysis showed that Q3 poorly contributed to the reliability of AL-i as the Cronbachâs alpha value increased after deleting the item. While other items highly contributed to the reliability of AL-i as the Cronbachâs alpha value decrease after deleting them. Item Q3 was removed from this inventory due to its poor contribution to the inventory reliability. Final factor & reliability analysis After the initial analysis, 10 items were remained for final analysis; 5 items for each domain. Table 3 shows the total number of components that was extracted remained two similar to the initial analysis. It shows that all items have loading factors more than 0.3. Therefore all items were retained. Total variance explained by these 5 factors was 62.723% which is acceptable (16) and better than the initial analysis; these findings show that the final 10 items AL-i has better construct. Reliability analysis shows that the total Cronbachâs alpha value of the AL-i was 0.798 which indicated a high level of internal consistency (12-15) and better than the initial analysis (table 3). The Cronbachâs alpha values of the andragogy and pedagogy domains were 0.85 and 0.81 respectively as shown in table 3. Those domains show very good level of internal consistency (15, 17). Table 3 also shows that all the items has corrected-item total correlation of more than 0.3 and highly contributed to the inventory reliability. Thus they were retained in the inventory. These findings suggested that the 10 items AL-i is reliable and has high internal consistency.
The demographic profile of the respondents was almost parallel with that of the Malaysian population in terms of gender and ethic group. Even more, the distribution also can be considered to represent those from rural areas and lower social strata. These facts were considered as evidence of a good level of representativeness of study samples to the Malaysian population. Therefore findings of this study represent the study population.The factor analysis showed that the final 10 items were loaded into the two domains (table 3) without forced extraction. All the items loaded well into the two predetermined domains as all the items had loading factor of more than 0.3 (16). These findings concurred that the AL-i has a good construct. It provides evidence to suggest that the inventory measures what it should measure and that it is a valid tool to be utilised in identifying types of learner among medical students. However, it is recommended that confirmatory factor analysis be conducted in the future to test the existence of the AL-i latent constructs.The reliability analysis suggested that the final 10 items of AL-i exhibited a measure of high internal consistency as their Cronbachâs alpha values were more than 0.7 as shown in table 3; it reflected the internal reliability of the inventory (17). The two domains had also shown a measure of good internal consistency as the Cronbachâs alpha values were more that 0.7; it was another evidence to support the reliability of the inventory. These findings provided evidence to support that the AL-i is a reliable instrument that could be used in the future to identify types of learner among medical students.The reliability and factor analyses have provided evidence of validity and reliability of the AL-i in determination of learner types among medical students of Universiti Sains Malaysia. However, a limitation of this study is that it is only confined to one institution. Therefore it is recommended that a multi-centre validation study should be conducted in the future to determine the validity and reliability of the AL-i across institutions. Apart from that, this study has provided useful baseline information for future studies in this area.
The AL-i has shown good psychometric values. It is a valid and reliability tool to determine adult leaner status among medical students. It is a promising psychometric instrument that can be used to determine types of learner among students in future.
Nil
Our special thanks to the School of Medical Sciences, Universiti Sains Malaysia for supporting and allowing us undertake this study. Our appreciation to all the first year medical students involved in this study. Our special thank you also to Dr Ahmad Fuad Abdul Rahim, Dr Mohamad Najib Mat Pa and the support staff of the Academic Office and Medical Education Department staff for their help. This study was made possible under the Short Term Research Grant 304/PPSP/6139071.
1. Yusoff MSB. Medical Education Notes: Introduction to principles of teaching and learning. Retrieved September 15, 2010 from www.saifulbahri.com website: http://saifulbahri.com/Medical_education/Medical_Education_Notes/Introduction_to_principles_of_teaching_and_learning.pdf2. Learning. (n.d.). Collins English Dictionary - Complete & Unabridged 10th Edition. Retrieved September 15, 2010, from Dictionary.com website: http://dictionary.reference.com/browse/learning3. Cobb J. Definition of learning. Retrieved September 15, 2010 from www.missiontolearn.com website: http://www.missiontolearn.com/2009/05/definition-of-learning/4. Lieb S. Principles of adult learning. Retrieved September 15, 2010 from honolulu.hawaii.edu website: http://honolulu.hawaii.edu/intranet/committees/FacDevCom/guidebk/teachtip/adults-2.htm5. Yusoff MSB. Medical Education Notes: Teaching approach Pedagogy and Andragogy. Retrieved September 15, 2010 from www.saifulbahri.com website: http://saifulbahri.com/Medical_education/Medical_Education_Notes/teaching_approach_pedagogy_andragogy.pdf6. Knowles MS, Holton III EF, Swanson RA. The Adult Leaner, 6th edn. USA: Butterworth-Heinemann, 2005.7. Mortimore P. Understanding Pedagogy and its Impact on learning. England: Paul Chapman Publishing Ltd, 1999.8. Yusoff MSB, Rahim AFA. The Study Skills Workshop. MedEdPORTAL, 2010. Available online at http://services.aamc.org/30/mededportal/servlet/s/segment/mededportal/?subid=80109. Kolb AY. The Kolb Learning Style Inventory¿Version 3.1 2005 Technical Specifications. Boston, MA: Hay Resource Direct. 2005.10. Dent J, Harden R. A practical guide for medical teachers: Churchill Livingstone; 2009.11. Newble D, Cannon R, Kapelis Z. A handbook for medical teachers: Kluwer Academic Publishers; 2001.12. Streiner LD, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd ed. New York: Oxford University Press, 2003.13. McDowell I. Measuring health: A guide to rating scales and questionnaires. 3rd ed. New York; Oxford University Press: 2006.14. Thomas KC. Fundamentals of educational research. 2nd ed. United States of America; McGraw-Hill, 1996.15. Downing SM. Reliability: on the reproducibility of assessment data. Medical Education. 2004; 38: 1006-1012.16. DeCoster J. Data Analysis in SPSS, 2004. Retrieved on 14th October 2008 from http://www.stat-help.com/notes.html.17. Field A. Discovering Statistics Using SPSS. 2nd ed. London: Sage Publication, 2005.