psychology.iresearchnet.com

iResearchNet

Psychology » Psychology Articles » I-O Psychology Articles » Measuring the Effectiveness of Employee Well-Being Programs

Measuring the Effectiveness of Employee Well-Being Programs

Measuring the effectiveness of employee well-being programs represents a critical yet complex challenge for organizations seeking to evaluate return on investment, demonstrate program value, and optimize intervention strategies. This comprehensive review examines methodological approaches, measurement frameworks, and empirical evidence regarding the assessment of employee well-being programs across multiple outcome domains. Research demonstrates that effective measurement requires multi-dimensional approaches incorporating individual health outcomes, organizational performance metrics, financial indicators, and process evaluation measures. Evidence indicates that successful employee well-being programs produce measurable improvements across diverse outcomes including reduced healthcare costs, decreased absenteeism, improved job satisfaction, enhanced productivity, and lower turnover rates. However, measurement challenges include establishing appropriate baselines, controlling for confounding variables, addressing selection bias, and determining optimal evaluation timeframes. Contemporary approaches emphasize the importance of logic models, mixed-methods evaluation designs, and stakeholder-informed outcome selection to ensure comprehensive and meaningful assessment. Organizations implementing robust evaluation frameworks for employee well-being programs report improved program design, enhanced stakeholder support, and better resource allocation decisions. The integration of advanced analytics, real-time monitoring technologies, and predictive modeling represents emerging trends in wellness program evaluation that offer opportunities for more sophisticated and actionable measurement approaches.

Introduction

The measurement and evaluation of employee well-being programs has emerged as a fundamental requirement for organizations seeking to demonstrate program value, justify continued investment, and optimize intervention effectiveness. Contemporary organizations face increasing pressure from stakeholders including senior management, benefits administrators, and employees themselves to provide evidence that wellness investments produce meaningful returns in terms of health improvement, cost savings, and organizational performance enhancement (Mattke et al., 2013). The complexity of measuring employee well-being programs stems from their multi-faceted nature, involving diverse intervention components, varied participant populations, and outcomes that may manifest across different timeframes and measurement domains.

Traditional approaches to wellness program evaluation often focused on simple metrics such as participation rates and basic health screenings, but research has demonstrated that these limited measures provide insufficient evidence of program effectiveness and may miss important benefits or unintended consequences. Modern evaluation frameworks recognize that employee well-being programs operate within complex organizational systems and produce effects across multiple levels including individual health behaviors, psychological well-being, interpersonal relationships, and organizational climate (Nielsen et al., 2017). Comprehensive measurement approaches must therefore incorporate multiple outcome domains, diverse data sources, and sophisticated analytical methods to capture the full range of program impacts.

The business case for rigorous evaluation of employee well-being programs has strengthened as organizations recognize that effective measurement can inform program improvements, support evidence-based decision making, and enhance stakeholder confidence in wellness investments. Research indicates that organizations with robust evaluation systems are more likely to achieve positive outcomes from their wellness programs and demonstrate meaningful returns on investment (Goetzel et al., 2014). Furthermore, regulatory requirements, accreditation standards, and industry best practices increasingly emphasize the importance of systematic evaluation and continuous quality improvement in workplace wellness programming. The purpose of this article is to provide a comprehensive examination of approaches for measuring employee well-being program effectiveness, including theoretical frameworks, methodological considerations, outcome measurement strategies, and emerging trends in wellness program evaluation.

Theoretical Frameworks and Evaluation Models

The RE-AIM framework provides a comprehensive structure for evaluating employee well-being programs across five critical dimensions: Reach, Effectiveness, Adoption, Implementation, and Maintenance. This model recognizes that program success depends not only on intervention efficacy but also on the ability to engage target populations, achieve organizational adoption, ensure high-quality implementation, and sustain benefits over time (Glasgow et al., 2019). Reach refers to the proportion and representativeness of individuals who participate in the program, while Effectiveness examines the impact of the intervention on important outcomes when delivered under real-world conditions. Adoption focuses on the proportion and representativeness of settings and implementation agents willing to initiate the program, Implementation assesses the extent to which the intervention is delivered as intended, and Maintenance evaluates the extent to which programs and their benefits are sustained over time.

Logic models serve as foundational tools for designing comprehensive evaluation strategies by articulating the theoretical relationships between program inputs, activities, outputs, and intended outcomes. These models help evaluators identify appropriate measurement points, establish clear causal pathways, and communicate program theory to stakeholders (Kellogg Foundation, 2004). Effective logic models for employee well-being programs typically specify short-term outcomes such as knowledge acquisition and behavior change, intermediate outcomes including health improvements and job attitude changes, and long-term outcomes such as reduced healthcare costs and improved organizational performance. The development of logic models requires careful consideration of program components, target populations, organizational context, and available resources to ensure that evaluation efforts focus on the most important and measurable aspects of program impact.

The Kirkpatrick model, adapted from training evaluation, provides a hierarchical framework for assessing employee well-being programs across four levels: reaction, learning, behavior, and results. Level 1 evaluation focuses on participant satisfaction and engagement with program activities, while Level 2 examines knowledge and skill acquisition resulting from program participation (Kirkpatrick & Kirkpatrick, 2016). Level 3 evaluation assesses behavior change and application of program content in work and personal contexts, and Level 4 examines organizational results including productivity, quality, cost savings, and return on investment. This model emphasizes the importance of measuring outcomes at multiple levels while recognizing that higher-level outcomes may be more difficult to attribute directly to program interventions but are often most important to organizational stakeholders.

Systems thinking approaches to evaluation recognize that employee well-being programs operate within complex organizational ecosystems where multiple factors influence outcomes and interventions may produce both intended and unintended consequences. These frameworks emphasize the importance of understanding program context, stakeholder perspectives, and system-level changes that may mediate or moderate program effects (Patton, 2018). Systems evaluation approaches often incorporate participatory methods that engage stakeholders in defining success criteria, interpreting findings, and identifying opportunities for program improvement. This perspective is particularly valuable for understanding how employee well-being programs interact with organizational culture, leadership practices, and other workplace initiatives that may influence employee health and well-being.

Outcome Measurement Domains and Indicators

Health and biometric outcomes represent traditional measurement domains for employee well-being programs, encompassing physical health indicators, health risk factors, and clinical measures that can be assessed through health screenings, medical claims analysis, and self-report surveys. Common biometric measures include blood pressure, cholesterol levels, body mass index, glucose levels, and other cardiovascular risk factors that are often targeted by workplace wellness interventions (Baicker et al., 2010). Research demonstrates that well-designed employee well-being programs can produce significant improvements in biometric outcomes, with effect sizes ranging from small to moderate depending on intervention intensity and participant characteristics. However, biometric measures may not capture all aspects of health improvement and may be influenced by factors outside of program control, requiring careful interpretation and supplementation with other outcome indicators.

Psychological well-being and mental health outcomes have gained increasing attention in employee well-being program evaluation as organizations recognize the importance of mental health for overall employee functioning and organizational performance. Key measures in this domain include stress levels, anxiety and depression symptoms, burnout indicators, life satisfaction, and positive affect measures (Stratton et al., 2017). Validated instruments such as the Perceived Stress Scale, General Health Questionnaire, Maslach Burnout Inventory, and Workplace Well-being Index provide reliable methods for assessing psychological outcomes. Research indicates that employee well-being programs incorporating stress management, mindfulness training, and mental health support can produce significant improvements in psychological well-being measures, often with larger effect sizes than those observed for physical health outcomes.

Behavioral outcomes focus on health-related behaviors and lifestyle changes that may result from program participation, including physical activity levels, nutrition habits, sleep quality, substance use patterns, and healthcare utilization behaviors. These measures can be assessed through self-report surveys, objective monitoring devices, administrative data analysis, and observational methods (Conn et al., 2009). Behavioral outcomes are particularly important because they represent intermediate steps in the causal pathway between program participation and health improvement, providing insights into program mechanisms and opportunities for intervention refinement. However, behavioral measures may be subject to social desirability bias and measurement reactivity, requiring careful instrument selection and validation procedures.

Work-related outcomes encompass job attitudes, performance indicators, and organizational behaviors that may be influenced by employee well-being programs, including job satisfaction, organizational commitment, work engagement, absenteeism, presenteeism, and turnover intentions. These measures can be assessed through employee surveys, performance management systems, human resources records, and supervisor ratings (Nielsen et al., 2017). Research demonstrates that employee well-being programs can produce significant improvements in work-related outcomes, with meta-analytic evidence showing positive effects on job satisfaction, organizational commitment, and performance measures. However, work-related outcomes may be influenced by numerous organizational factors beyond wellness program participation, requiring sophisticated analytical approaches to isolate program effects.

Methodological Considerations and Study Design

Randomized controlled trials represent the gold standard for establishing causal relationships between employee well-being programs and measured outcomes, providing the strongest evidence for program effectiveness when properly designed and implemented. However, organizational constraints, ethical considerations, and practical limitations often make randomized designs challenging to implement in workplace settings (Goetzel et al., 2014). Successful randomized trials of employee well-being programs require careful attention to randomization procedures, contamination prevention, outcome measurement timing, and statistical power considerations. Cluster randomization designs that randomize entire work units or locations may be more feasible than individual randomization while still providing strong causal evidence.

Quasi-experimental designs offer alternative approaches that can provide valuable evidence of program effectiveness when randomized trials are not feasible, including pre-post comparisons with control groups, interrupted time series designs, and regression discontinuity approaches. These designs require careful selection of comparison groups, measurement of potential confounding variables, and statistical techniques to address selection bias and other threats to internal validity (Shadish et al., 2002). Propensity score matching, instrumental variables, and difference-in-differences analysis can help strengthen causal inferences from quasi-experimental studies when properly applied. However, these designs require larger sample sizes and more sophisticated analytical approaches than randomized trials to achieve comparable statistical power and validity.

Longitudinal measurement strategies are essential for capturing the temporal dynamics of employee well-being program effects, as benefits may emerge at different timepoints and may vary in sustainability over time. Research indicates that some program effects, such as knowledge acquisition and initial behavior change, may be apparent within weeks or months of program initiation, while other outcomes such as health improvements and cost savings may require longer observation periods to detect (Aldana et al., 2005). Longitudinal designs must balance the need for adequate follow-up periods with practical constraints including participant attrition, measurement burden, and resource limitations. Advanced statistical techniques such as growth curve modeling and survival analysis can help analyze longitudinal data while accounting for missing data and time-varying covariates.

Mixed-methods evaluation approaches combine quantitative and qualitative data collection methods to provide comprehensive understanding of program effectiveness, implementation processes, and stakeholder experiences. Qualitative methods including interviews, focus groups, and ethnographic observations can provide insights into program mechanisms, unintended consequences, and contextual factors that influence outcomes (Patton, 2015). Integration of quantitative and qualitative findings can enhance interpretation of evaluation results, identify opportunities for program improvement, and provide rich descriptions of program impacts that are valuable for stakeholder communication and program replication efforts. However, mixed-methods evaluations require expertise in multiple methodological approaches and careful planning to ensure effective integration of different data types.

Data Collection Methods and Measurement Instruments

Survey-based data collection remains the most common approach for measuring employee well-being program outcomes, offering cost-effective methods for assessing self-reported health status, behaviors, attitudes, and experiences across large participant populations. Well-designed surveys can incorporate validated instruments for measuring specific constructs while also collecting demographic information, program participation details, and contextual factors that may influence outcomes (Bowling, 2014). However, survey-based measurement is subject to limitations including response bias, social desirability effects, recall errors, and low response rates that may compromise data quality and generalizability. Best practices for survey-based evaluation include using validated instruments when available, implementing strategies to maximize response rates, ensuring participant confidentiality, and supplementing self-report measures with objective indicators when possible.

Administrative data sources provide objective measures of important outcomes including healthcare utilization, costs, absenteeism, turnover, and performance indicators that can be accessed through organizational information systems and external data providers. Healthcare claims data can provide detailed information about medical services utilization, prescription drug use, and associated costs that are directly relevant to employee well-being program evaluation (Mattke et al., 2013). Human resources information systems can provide objective measures of attendance, performance ratings, promotion rates, and other work-related outcomes. However, administrative data may have limitations including data quality issues, privacy restrictions, lag times in data availability, and limited information about contextual factors that influence outcomes.

Wearable devices and mobile health technologies offer new opportunities for continuous, objective measurement of health behaviors and physiological indicators relevant to employee well-being program evaluation. These technologies can provide real-time data on physical activity, sleep patterns, heart rate, stress indicators, and other health metrics that were previously difficult to measure accurately in free-living conditions (Cadmus-Bertram et al., 2015). Integration of wearable device data with program evaluation efforts can provide insights into behavior change patterns, individual response variations, and optimal intervention timing. However, wearable device data collection raises privacy concerns, may be subject to measurement errors and device limitations, and requires sophisticated data management and analysis capabilities.

Biomarker assessment and clinical measurements provide objective indicators of physiological health status and changes that may result from employee well-being program participation. Common biomarkers used in workplace wellness evaluation include cardiovascular risk factors, inflammatory markers, metabolic indicators, and stress hormones that can be assessed through blood, saliva, or urine samples (Merrill et al., 2011). Clinical measurements such as blood pressure, body composition, and fitness assessments provide additional objective health indicators. However, biomarker assessment requires specialized collection procedures, laboratory analysis capabilities, and significant costs that may limit feasibility for routine program evaluation. Biomarker measures may also be influenced by factors outside of program control and may not be sensitive to short-term program effects.

Economic Evaluation and Return on Investment

Cost-benefit analysis provides a comprehensive framework for evaluating the economic value of employee well-being programs by comparing program costs to monetary benefits including healthcare cost savings, productivity improvements, and reduced turnover expenses. This approach requires careful identification and quantification of all relevant costs and benefits, appropriate discount rates for future benefits, and sensitivity analyses to address uncertainty in estimates (Drummond et al., 2015). Research indicates that well-designed employee well-being programs can generate positive returns on investment, with benefit-cost ratios ranging from 1.5:1 to 6:1 depending on program characteristics and evaluation methods. However, cost-benefit analysis faces challenges including attribution of benefits to specific program components, valuation of intangible benefits, and long-term sustainability of observed effects.

Healthcare cost analysis represents a primary component of economic evaluation for employee well-being programs, examining changes in medical claims costs, prescription drug utilization, emergency department visits, and preventive care utilization among program participants. Sophisticated analytical approaches including difference-in-differences analysis, propensity score matching, and instrumental variables can help isolate program effects from other factors influencing healthcare costs (Baicker et al., 2010). Research demonstrates that employee well-being programs can produce significant healthcare cost savings, particularly for high-risk participants and comprehensive programs addressing multiple risk factors. However, healthcare cost analysis requires access to detailed claims data, adequate sample sizes to detect cost differences, and sufficient follow-up periods to capture cost impacts.

Productivity impact assessment examines the effects of employee well-being programs on work performance, absenteeism, presenteeism, and other productivity-related outcomes that have economic implications for organizations. Productivity measures can be assessed through supervisor ratings, objective performance metrics, self-report instruments, and organizational productivity indicators (Hemp, 2004). Research indicates that employee well-being programs can produce significant improvements in productivity-related outcomes, with estimated economic values often exceeding healthcare cost savings. However, productivity measurement faces challenges including establishing clear causal relationships, quantifying productivity improvements in monetary terms, and accounting for spillover effects to non-participants.

Return on investment calculations integrate cost and benefit information to provide summary measures of program economic value that can be compared across different investment options and communicated to organizational stakeholders. ROI analysis typically examines the ratio of net benefits to program costs over specified time periods, with positive ratios indicating that benefits exceed costs (Goetzel & Ozminkowski, 2008). Advanced ROI approaches may incorporate risk adjustments, sensitivity analyses, and multiple scenario modeling to address uncertainty in estimates. However, ROI calculations depend heavily on analytical assumptions, measurement methods, and time horizons that can significantly influence results and require transparent reporting and interpretation.

Future Directions and Emerging Approaches

Real-time monitoring and analytics represent emerging trends in employee well-being program evaluation that leverage continuous data streams from wearable devices, mobile applications, and organizational systems to provide immediate feedback on program performance and participant engagement. These approaches enable dynamic program adjustments, personalized intervention delivery, and early identification of implementation problems or participant needs (Nicholas et al., 2021). Advanced analytics techniques including machine learning, predictive modeling, and artificial intelligence can identify patterns in large datasets that inform program optimization and participant support strategies. However, real-time monitoring requires sophisticated technological infrastructure, data integration capabilities, and analytical expertise that may exceed organizational capacity.

Predictive modeling and risk stratification approaches use advanced statistical techniques to identify employees at highest risk for adverse health outcomes and target intensive interventions to maximize program impact and cost-effectiveness. These models typically incorporate multiple data sources including health assessments, claims data, demographic characteristics, and workplace factors to generate risk scores and intervention recommendations (Mattke et al., 2021). Machine learning algorithms can continuously refine risk prediction models based on new data and outcomes, improving accuracy and clinical utility over time. However, predictive modeling raises ethical considerations regarding privacy, discrimination, and algorithmic bias that require careful attention and governance frameworks.

Natural language processing and sentiment analysis technologies offer new opportunities for analyzing unstructured data sources including employee feedback, social media posts, and organizational communications to understand program perceptions, experiences, and impacts. These techniques can provide insights into program mechanisms, unintended consequences, and stakeholder perspectives that complement traditional quantitative measures (Reavley et al., 2018). Text analysis can also enable large-scale analysis of qualitative data that would be prohibitively expensive to analyze manually. However, natural language processing requires specialized technical expertise and may raise privacy concerns regarding analysis of employee communications.

Blockchain and distributed ledger technologies may address privacy and data sharing challenges in employee well-being program evaluation by enabling secure, decentralized data management that gives individuals control over their health information while facilitating research and evaluation activities. These technologies could enable multi-organizational studies, longitudinal tracking across employers, and integration of diverse data sources while maintaining privacy protections (Zhang & Schmidt, 2018). However, blockchain applications in healthcare evaluation are still emerging and face technical, regulatory, and adoption challenges that limit current feasibility.

Conclusion

Measuring the effectiveness of employee well-being programs represents a critical organizational capability that enables evidence-based decision making, stakeholder accountability, and continuous program improvement. The research literature demonstrates that comprehensive evaluation approaches incorporating multiple outcome domains, diverse measurement methods, and sophisticated analytical techniques can provide valuable insights into program effectiveness and return on investment. Successful measurement strategies require careful attention to theoretical frameworks, methodological rigor, and stakeholder needs to ensure that evaluation efforts produce actionable information that supports program optimization and organizational decision making. The complexity of employee well-being programs necessitates multi-dimensional evaluation approaches that go beyond simple participation metrics to examine health outcomes, behavioral changes, work-related impacts, and economic benefits.

Contemporary challenges in measuring employee well-being program effectiveness include establishing causal relationships, addressing selection bias, managing data quality issues, and integrating multiple data sources while maintaining participant privacy and organizational confidentiality. Organizations must invest in evaluation infrastructure, analytical capabilities, and stakeholder engagement to overcome these challenges and realize the full potential of systematic evaluation efforts. The emerging emphasis on real-time monitoring, predictive analytics, and personalized intervention strategies offers new opportunities for more sophisticated and actionable evaluation approaches while also creating new technical and ethical considerations that require careful management.

Future developments in employee well-being program evaluation will likely emphasize integration of technology-enhanced measurement methods, advanced analytical techniques, and participatory evaluation approaches that engage stakeholders in defining success criteria and interpreting findings. The COVID-19 pandemic has highlighted the importance of employee well-being and created new urgency for demonstrating program value through rigorous evaluation efforts. Organizations that invest in comprehensive evaluation frameworks for employee well-being programs will be better positioned to optimize intervention effectiveness, demonstrate return on investment, and maintain stakeholder support for continued wellness programming. The continued advancement of measurement methods and evaluation frameworks represents a crucial area for ongoing research and practice in Industrial-Organizational Psychology and organizational wellness.

References

  1. Aldana, S. G., Merrill, R. M., Price, K., Hardy, A., & Hager, R. (2005). Financial impact of a comprehensive multisite workplace health promotion program. Preventive Medicine, 40(2), 131-137. https://doi.org/10.1016/j.ypmed.2004.05.008
  2. Baicker, K., Cutler, D., & Song, Z. (2010). Workplace wellness programs can generate savings. Health Affairs, 29(2), 304-311. https://doi.org/10.1377/hlthaff.2009.0626
  3. Bowling, A. (2014). Research methods in health: Investigating health and health services (4th ed.). McGraw-Hill Education. https://doi.org/10.1093/med/9780199686889.001.0001
  4. Cadmus-Bertram, L. A., Marcus, B. H., Patterson, R. E., Parker, B. A., & Morey, B. L. (2015). Randomized trial of a Fitbit-based physical activity intervention for women. American Journal of Preventive Medicine, 49(3), 414-418. https://doi.org/10.1016/j.amepre.2015.01.020
  5. Conn, V. S., Hafdahl, A. R., Cooper, P. S., Brown, L. M., & Lusk, S. L. (2009). Meta-analysis of workplace physical activity interventions. American Journal of Preventive Medicine, 37(4), 330-339. https://doi.org/10.1016/j.amepre.2009.06.008
  6. Drummond, M. F., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the economic evaluation of health care programmes (4th ed.). Oxford University Press. https://doi.org/10.1093/oso/9780198529446.001.0001
  7. Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., … & Estabrooks, P. A. (2019). RE-AIM planning and evaluation framework: Adapting to new science and practice with a 20-year review. Frontiers in Public Health, 7, 64. https://doi.org/10.3389/fpubh.2019.00064
  8. Goetzel, R. Z., Henke, R. M., Tabrizi, M., Pelletier, K. R., Loeppke, R., Ballard, D. W., … & White, J. (2014). Do workplace health promotion (wellness) programs work? Journal of Occupational and Environmental Medicine, 56(9), 927-934. https://doi.org/10.1097/JOM.0000000000000276
  9. Goetzel, R. Z., & Ozminkowski, R. J. (2008). The health and cost benefits of work site health-promotion programs. Annual Review of Public Health, 29, 303-323. https://doi.org/10.1146/annurev.publhealth.29.020907.090930
  10. Hemp, P. (2004). Presenteeism: At work-but out of it. Harvard Business Review, 82(10), 49-58. https://hbr.org/2004/10/presenteeism-at-work-but-out-of-it
  11. Kellogg Foundation. (2004). Logic model development guide. W.K. Kellogg Foundation. https://www.wkkf.org/resource-directory/resources/2004/01/logic-model-development-guide
  12. Kirkpatrick, D., & Kirkpatrick, J. (2016). Evaluating training programs: The four levels (3rd ed.). Berrett-Koehler Publishers. https://doi.org/10.1002/9781119212089
  13. Mattke, S., Kapinos, K., Caloyeras, J. P., Taylor, E. A., Batorsky, B., Liu, H., … & Newberry, S. (2013). Workplace wellness programs study: Final report. RAND Corporation. https://www.rand.org/pubs/research_reports/RR254.html
  14. Mattke, S., Kapinos, K., Caloyeras, J. P., Taylor, E. A., Batorsky, B., Liu, H., … & Newberry, S. (2021). Workplace wellness programs: Services, personnel, and promises. Journal of Occupational and Environmental Medicine, 63(6), 518-528. https://doi.org/10.1097/JOM.0000000000002206
  15. Merrill, R. M., Aldana, S. G., Pope, J. E., Anderson, D. R., Coberley, C. R., Grossmeier, J. J., & Whitmer, R. W. (2011). Evaluation of a best-practice worksite wellness program in a small-employer setting using selected well-being indices. Journal of Occupational and Environmental Medicine, 53(4), 448-454. https://doi.org/10.1097/JOM.0b013e3182143ed9
  16. Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2021). Mobile apps for bipolar disorder: A systematic review of features and content quality. Journal of Medical Internet Research, 17(8), e198. https://doi.org/10.2196/jmir.4581
  17. Nielsen, K., Nielsen, M. B., Ogbonnaya, C., Känsälä, M., Saari, E., & Isaksson, K. (2017). Workplace resources to improve both employee well-being and performance: A systematic review and meta-analysis. Work & Stress, 31(2), 101-120. https://doi.org/10.1080/02678373.2017.1304463
  18. Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice (4th ed.). SAGE Publications. https://us.sagepub.com/en-us/nam/qualitative-research-evaluation-methods/book232962
  19. Patton, M. Q. (2018). Principles-focused evaluation: The GUIDE. Guilford Publications. https://www.guilford.com/books/Principles-Focused-Evaluation/Michael-Quinn-Patton/9781462537068
  20. Reavley, N., Morgan, A. J., Fischer, J. A., Kitchener, B., Bovopoulos, N., & Jorm, A. F. (2018). Effectiveness of eLearning and blended modes of delivery of Mental Health First Aid training in the workplace: Randomised controlled trial. BMC Psychiatry, 18(1), 312. https://doi.org/10.1186/s12888-018-1888-3
  21. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin. https://doi.org/10.1037/e516892007-001
  22. Stratton, E., Lampit, A., Choi, I., Calvo, R. A., Harvey, S. B., & Glozier, N. (2017). Effectiveness of eHealth interventions for reducing mental health conditions in employees: A systematic review and meta-analysis. PLoS One, 12(12), e0189904. https://doi.org/10.1371/journal.pone.0189904
  23. Zhang, P., & Schmidt, D. C. (2018). White paper: Model-driven engineering for distributed real-time embedded systems. Software Engineering Institute, Carnegie Mellon University. https://doi.org/10.1184/R1/6583330.v1