Instrument review: Getting the most from a panel of experts
Summary
Authors on research methods frequently recommend the use of a panel of experts to maximize the likelihood of content-valid, well-constructed data collection instruments. Figure 3 summarizes the panel review process as a series of steps, beginning with the first draft of an instrument and ending with the pilot testing of the instrument. When items are revised as a result of expert reviews, the revised instrument also should be subjected to this same series of steps.
This article has been an attempt to provide criteria for selecting expert reviewers and maximizing their participation in assessment of data collection instruments. Panel reviews provide opportunities for investigators to secure valuable expert consultation from colleagues in nursing and other disciplines. Careful use of this expertise is one of the most important components of the instrument development process. Finally, an investigator also should keep in mind that the experts who participate in instrument review have a professional investment in the study. As such, it is an expected courtesy to inform experts of the subsequent performance of the instruments they have reviewed, as well as the outcomes of the study.
References (4)
- MartuzaV.
Applying norm-referenced and criterion-referenced measurement in education
(1977) - NunnallyJ.
Psychometric theory
(1978)
Cited by (1054)
Driving the dual learning process of management knowledge: A social cognitive theory perspective
2024, International Journal of Management EducationRecent research has demonstrated a sustained interest in the effectiveness of learning management knowledge. A dual learning process is proposed in this study to explain how learners acquire management knowledge. Furthermore, this study examines the influences that encourage learners to engage in the dual learning process based on Social Cognitive Theory (SCT).
The study surveyed 262 business school students in seven classes enrolled in the Principles of Business course, using structural equation modeling to validate relationships among the dual learning process, driving factors, and knowledge learning.
Empirical results suggest that environmental factors, including ChatGPT-assisted learning and teacher support – as well as individual factors, such as self-efficacy – help strengthen learners’ experience in the dual learning process. This research attempts to integrate the social cognitive theory, learning cycle theory, and knowledge types perspective to provide a holistic theoretical foundation and interpretations for effective learning in management knowledge.
Knowledge levels and evidence-based approaches of undergraduate nursing students on suctioning practices: A cross-sectional study
2024, Nurse Education TodaySuctioning is one of the nursing interventions frequently applied in clinical and intensive care units. In order to perform suctioning correctly and effectively, it is important for nursing students to acquire and develop this skill during their undergraduate theoretical and practical education.
The study aims to reveal the knowledge levels and evidence-based approaches of nursing students about suctioning practices.
The study is a descriptive and cross-sectional study.
It was carried out in the Faculty of Nursing of two state universities in Konya between March and June 2022.
A total of 506 undergraduate students participated in the study.
Data were collected using the Personal Information Form, the Knowledge of Suctioning Questionnaire, and the Attitude towards Evidence-Based Nursing Questionnaire. Data were analyzed by calculating number, percentage, mean, and standard deviation, and using the multiple linear regression analysis.
The mean Attitude towards Evidence-Based Nursing Questionnaire score of the students was found to be 63.04 ± 7.91, and their mean Knowledge of Suctioning Questionnaire score was 33.46 ± 14.63. 83.8 % of the students obtained a low score from the questionnaire. Senior students had high scores on the Attitude towards Evidence-Based Nursing Questionnaire, which are significant predictive variables affecting the level of knowledge about suctioning (p < 0.05).
It was found that the high scores of the students on the Attitude towards Evidence-Based Nursing Questionnaire had an effect on their level of suctioning knowledge. The study also revealed that being a fourth-year student and receiving training on suctioning affected the level of suctioning knowledge.
Student well-being in higher education: Scale development and validation with implications for management education
2024, International Journal of Management EducationStudent well-being (SWB) encompasses the physical, psychological, and social wellness of students, aspects increasingly at risk in the high-pressure environment of higher education. Marked by intense workloads, unmet expectations, and uncertainties around degree completion and employment, the higher education sector faces a growing challenge in maintaining and enhancing SWB. Current instruments for assessing SWB are limited in scope, failing to capture its multifaceted nature comprehensively. Addressing this gap, our research adopts a rigorous multi-study, multi-method, and multi-sample approach to develop and validate a multi-dimensional scale that effectively captures the nuances of SWB. This process encompassed five methodical stages: scale generation, scale purification, scale refinement, scale validation, and scale generalizability. The resulting SWB scale, encompassing five key dimensions—academic well-being, financial well-being, physical well-being, psychological resilience well-being, and relational well-being—provides a sophisticated tool for measuring and improving SWB in higher education contexts. Crucially, this paper extends beyond the scale development to explore the profound implications of this research for management education. By integrating SWB into management curricula and institutional cultures, this study underscores the potential for higher education to significantly contribute to Sustainable Development Goal 3: Good Health and Well-being. It highlights how nurturing SWB in management education can foster more resilient, empathetic, and socially responsible future leaders, addressing a critical need in contemporary business environments and society at large.
Psychometric properties of the pediatric ward nurses' caring self-efficacy scale: A Turkish validity and reliability study
2024, Journal of Pediatric NursingTo translate the 51-item Pediatric Ward Nurses' Caring Self-Efficacy Scale into Turkish and to test the validity and reliability of the Turkish version of the scale in the Turkish population.
The study was conducted with 308 nurses working in the pediatric/pediatric wards of two hospitals in Turkey between September 2021 and January 2022. A Personal Information Form, the Pediatric Ward Nurses' Caring Self-Efficacy Scale, and the Nursing Profession Self-Efficacy Scale (NPSES) were used to determine the care self-efficacy levels of the research sample.
The Cronbach alpha value of the scale, which was adapted to Turkish culture, was 0.982, and the test-retest reliability coefficient was 0.994. Factor loads varied between 0.40 and 0.89. The Kaiser-Meyer-Olkin sample fit coefficient of the scale was 0.963 and the Barlett sphericity test χ2 value was 15,259.02 (p < 0.001). It was determined to have a six-factor structure in Turkish culture and showed good fit indices for the Turkish scale (GFI = 0.93, CFI = 0.97, TLI = 0.96 and RMSEA = 0.09).
The Pediatric Ward Nurses' Caring Self-Efficacy Scale was found to be valid and reliable for sensitively detecting changes in the care self-efficacy levels of nurses working in pediatric wards.
The scale can be used by professionals interested in scientific knowledge about pediatric population.
MS bladder check tool: Development and validation of a patient awareness tool to facilitate timely management of lower urinary tract dysfunction due to multiple sclerosis
2024, Multiple Sclerosis and Related DisordersLower urinary tract dysfunction impacts quality of life of people with MS; often, symptoms are ‘lived with’ or deprioritised by healthcare providers (HCPs). Consequently, patients must be given the skills they need to become confident in managing their illness and enhance their involvement in the process.
To develop and validate a self-assessment tool to help people with MS become more aware of their bladder symptoms and prompt contact with their HCP to facilitate timely management and specialist referral, if required.
The ‘MS bladder check tool’ was developed by a multidisciplinary panel of specialist advisors. Consensus meetings and pilot testing were conducted to design and evolve the tool into a series of nine questions, using population-appropriate language, and covering all aspects of bladder dysfunction in MS. The tool was then validated by an international, multidisciplinary team of experts.
Validity was rated ‘excellent’ for all questions indicating that the MS bladder check tool is an appropriate method of highlighting bladder problems in people with MS.
The MS bladder check tool is simple, easy-to-use, and empowers patients to take charge of their urinary tract health, aiming to improve the management of MS and, ultimately, patient quality of life.
Development and psychometric testing of the narrative nursing teaching effectiveness scale: A methodological study
2024, Nurse Education TodayNarrative teaching is widely used in nursing education. However, there is currently a lack of valid and reliable tool to assess the effectiveness of narrative nursing teaching from the perspective of nursing students.
This study developed a Narrative Nursing Teaching Effectiveness (NNTE) scale and evaluated its psychometric properties.
A methodological design was used to develop and validate the instrument.
The study took place at a university in southern China.
The study involved 283 nursing students enrolled at a medical university in Fujian Province, China.
The researchers conducted literature reviews, held focus groups and individual interviews, and utilized the Delphi method to create a pool of indicators for a narrative nursing teaching evaluation system. A pretest was administered to 150 nursing students. Next, the primary study involved 283 nursing students, chosen through cluster sampling, completed a general information questionnaire along with the NNTE scale. Data analysis was performed using SPSS 26.0, Mplus 6.1, and STATA 16.0, and included general statistical analysis, critical test theory, and item response theory analyses.
The researchers created a 42-item scale with four subdomains, explaining 60.32 % of the total variance. Confirmatory factor analysis proved the four-factor model's validity. Cronbach's alpha values for the four subscales ranged from 0.869 to 0.949. The average content validity index of the scale was 0.923 and the item content validity index ranged from 0.872 to 1. In addition, all item characteristic curves displayed desirable shapes, and the test information functions provided precise information.
The NNTE scale exhibits good psychometric properties, providing a scientifically sound and effective instrument to evaluate the effectiveness of the narrative nursing teaching approach to nursing education.
- 1
From the School of Nursing, University of Alabama at Birmingham, AL.
- 2
Linda Lindsey Davis, PhD, RN, ANP: Professor, School of Nursing, University of Alabama at Birmingham, AL.