Engineering Trustworthy Predictive Models for Clinical Decision Support
Keywords:
Predictive Analytics in Healthcare, Clinical Prediction Models, Resource Allocation Optimization, Workflow Optimization, Risk Stratification, Treatment Response Prediction, Healthcare Machine Learning, Production-Grade ML Pipelines, End-to-End Analytics Frameworks, Clinical Decision Support Systems, Healthcare MLOps, Model Deployment in Healthcare, Continuous Healthcare ML Operations, Experimentation Pipelines, Translational Analytics, Operationalizing ML in Healthcare, Data-to-Decision Pipelines, Scalable Healthcare AI, Reliable Clinical ML Systems, Analytics-Driven Care Delivery.Abstract
Predictive analytics leverages past occurrences to answer questions about future events, thereby enabling healthcare organizations to identify exceptional cases and optimize strategies and actions. Healthcare predictive analytics applies predictive analytics to clinical prediction, resource allocation, workflow optimization, risk stratification, treatment response prediction, and other tasks with different objectives and stakeholder perspectives. Successful solutions can be instrumental in improving healthcare outcomes, increasing operational efficiency, and achieving better return on investment, thereby stimulating interest among analysts and clinicians. However, the innovation gap in applying machine learning to healthcare is primarily associated with production-grade models rather than algorithmic novelty. Machine learning is maturing into a viable technology for many forms of prediction, but the surround systems and processes needed for real-world adoption remain largely unsolved. Production-grade pipelines fill this need by providing the end-to-end framework connecting clinicians’ predictive ideas to analytically-driven changes in healthcare delivery. They support experimentation by enabling analysts or researchers to quickly build and test pipelines on small-scale data using diverse models without requiring detailed technical expertise. For the clinical effort to yield substantial benefits, however, the pipelines must be production-grade, thereby allowing a solution to work reliably and continuously once analysts uncover an interesting prediction application.
References
1. Abraham, A., Le, B., Kosti, I., Straub, P., Velez-Edwards, D. R., Davis, L. K., Newton, J. M., Muglia, L. J., Rokas, A., Bejan, C. A., Sirota, M., & Capra, J. A. (2022). Dense phenotyping from electronic health records enables machine learning-based prediction of preterm birth. BMC Medicine, 20, 333.
2. Banerjee, A., Chen, S., Fatemifar, G., Zeina, M., Lumbers, R. T., Mielke, J., Gill, S., Kotecha, D., Freitag, D. F., Denaxas, S., & Hemingway, H. (2021). Machine learning for subtype definition and risk prediction in heart failure, acute coronary syndromes and atrial fibrillation: Systematic review of validity and clinical utility. BMC Medicine, 19, 85.
3. de Hond, A. A. H., Leeuwenberg, A. M., Hooft, L., Kant, I. M. J., Nijman, S. W. J., van Os, H. J. A., Aardoom, J. J., Debray, T. P. A., Schuit, E., van Smeden, M., Reitsma, J. B., Steyerberg, E. W., Chavannes, N. H., & Moons, K. G. M. (2022). Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: A scoping review. npj Digital Medicine, 5, 2.
4. Kolla, S. K. (2022). Engineering Healthcare Data Infrastructures for Predictive Clinical Analytics and Evidence-Based Decision Making. International Journal of Engineering & Extended Technologies Research (IJEETR), 4(5), 5370-5380.
5. Dhiman, P., Ma, J., Andaur Navarro, C., Speich, B., Bullock, G., Damen, J. A. A., Kirtley, S., Hooft, L., Riley, R. D., Van Calster, B., Moons, K. G. M., & Collins, G. S. (2021). Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved. Journal of Clinical Epidemiology, 138, 60–72.
6. Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021). Do as AI say: Susceptibility in deployment of clinical decision-aids. npj Digital Medicine, 4, 31.
7. Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021). The false hope of current approaches to explainable artificial intelligence in health care. The Lancet Digital Health, 3(11), e745–e750.
8. Kolla, S. H. (2022). Strategic Information Integration Models for Cross-Functional Service Optimization in Large-Scale Enterprises. International Journal of Emerging Trends in Engineering and Management Research, 7(3), 11811.
9. Gichoya, J. W., Banerjee, I., Bhimireddy, A. R., Burns, J. L., Celi, L. A., Chen, L.-C., Correa, R., Dullerud, N., Ghassemi, M., Huang, S.-C., Kuo, P.-C., Lungren, M. P., Palmer, L. J., Price, B. J., Purkayastha, S., Pyrros, A. T., Oakden-Rayner, L., Okechukwu, C., Seyyed-Kalantari, L., Trivedi, H., Wang, R., Zaiman, Z., & Zhang, H. (2022). AI recognition of patient race in medical imaging: A modelling study. The Lancet Digital Health, 4(6), e406–e414.
10. Loh, H. W., Ooi, C. P., Seoni, S., Barua, P. D., Molinari, F., & Acharya, U. R. (2022). Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011–2022). Computer Methods and Programs in Biomedicine, 226, 107161.
11. Markus, A. F., Kors, J. A., & Rijnbeek, P. R. (2021). The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies. Journal of Biomedical Informatics, 113, 103655.
12. Yandamuri, U. S. (2021). A Comparative Study of Traditional Reporting Systems versus Real-Time Analytics Dashboards in Enterprise Operations. Universal Journal of Business and Management, 1(1), 1-13.
13. Rasheed, K., Qayyum, A., Ghaly, M., Al-Fuqaha, A., Razi, A., & Qadir, J. (2022). Explainable, trustworthy, and ethical machine learning for healthcare: A survey. Computers in Biology and Medicine, 149, 106043.
14. Andaur Navarro, C. L., Damen, J. A. A., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R., Riley, R. D., Moons, K. G. M., & Hooft, L. (2021). Risk of bias in studies on prediction models developed using supervised machine learning techniques: Systematic review. BMJ, 375, n2281.
15. Yi, S. E., Harish, V., Gutierrez, J., Ravaut, M., Kornas, K., Watson, T., Poutanen, T., Ghassemi, M., Volkovs, M., & Rosella, L. C. (2022). Predicting hospitalisations related to ambulatory care sensitive conditions with machine learning for population health planning: Derivation and validation cohort study. BMJ Open, 12(4), e051403.
16. van Klaveren, D., Zanos, T. P., Nelson, J., Basile, M. J., Hajizadeh, N., Lingsma, H. F., & Kent, D. M. (2022). Prognostic models for COVID-19 needed updating to warrant transportability over time and space. BMC Medicine, 20, 456.
17. Mangalampalli, B. M. "Scalable Data Warehouse Architecture for Population Health Management and Predictive Analytics." World Journal of Clinical Medicine Research 1, no. 1 (2021): 1-18.
18. Eurlings, C. G. M. J., et al. (2022). Use of artificial intelligence to assess the risk of coronary artery disease without additional (non-invasive) testing: Validation in a low-risk to intermediate-risk outpatient clinic cohort. BMJ Open, 12, e055170.
19. Klement, R. J., et al. (2021). Machine learning for prediction of clinical outcomes in patients with cancer: A systematic review and meta-analysis. Journal of Clinical Medicine, 10.
20. Zhou, Q., Chen, Z.-H., Cao, Y.-H., & Peng, S. (2021). Clinical impact and quality of randomized controlled trials involving interventions evaluating artificial intelligence prediction tools: A systematic review. npj Digital Medicine, 4, 154.
21. Di Martino, F., & Delmastro, F. (2022). Explainable AI for clinical and remote health applications: A survey on tabular and time series data. Artificial Intelligence Review, 56, 5261–5315.
22. Kostick-Quenet, K. M., & Gerke, S. (2022). AI in the hands of imperfect users. npj Digital Medicine, 5, 197.
23. Tjoa, E., & Guan, C. (2021). A survey on explainable artificial intelligence (XAI): Toward medical XAI. IEEE Transactions on Neural Networks and Learning Systems, 32(11), 4793–4813.
24. Holzinger, A., Malle, B., Kieseberg, P., Bibal, A., Weber, P., Foresti, G. L., Lehtinen, J., & Zeni, L. (2021). Toward the augmented human: A systematic review of explainable artificial intelligence in healthcare. Artificial Intelligence in Medicine, 118, 102090.
25. Petch, J., Di, S., & Nelson, W. (2022). Opening the black box: An introduction to explainable artificial intelligence in medicine. The Lancet Digital Health, 4(7), e455–e465.
26. Giuseffi, M., et al. (2022). Explainable artificial intelligence in healthcare: A systematic review of clinical applications and challenges. Artificial Intelligence in Medicine, 128.
27. Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2021). Explainability for artificial intelligence in healthcare: A multidisciplinary perspective. BMC Medical Informatics and Decision Making, 21, 1–15.
28. London, A. J. (2021). Artificial intelligence and black-box medical decisions: Accuracy versus explainability. Hastings Center Report, 51(1), 15–21.
29. Davuluri, P. S. L. N. (2021). Event-Driven Compliance Systems: Modernizing Financial Crime Detection Without Machine Intelligence. Journal of International Crisis and Risk Communication Research, 339-354.
30. Holzinger, A., Carrington, A., & Müller, H. (2022). Measuring the quality of explanations: The limitations of explainable AI in healthcare. Artificial Intelligence in Medicine, 127.
Additional Files
Published
Issue
Section
License
Copyright (c) 2023 Carlos Mendoza (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The American Online Journal of Science and Engineering (AOJSE) is an open-access journal, and all published articles are made freely available to readers worldwide under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license governs the use, sharing, adaptation, and distribution of all content published in AOJSE and is designed to promote the broadest possible dissemination and reuse of scholarly research.
Creative Commons Attribution 4.0 International License (CC BY 4.0)
Under the Creative Commons Attribution 4.0 International License, any user is free to share, copy, and redistribute the published material in any medium or format, and to adapt, remix, transform, and build upon the material for any purpose, including commercial use, provided that appropriate credit is given to the original authors and source. The license cannot be revoked as long as the terms are followed.
When using or redistributing content published in AOJSE, users must provide proper attribution by citing the original authors' names, the article title, the journal name (AOJSE), the volume and issue number, the year of publication, and the DOI or URL of the article. Users must also indicate if any changes were made to the original work. Attribution must be provided in a reasonable manner but must not suggest that the authors or AOJSE endorse the user or their use of the material.
Author Rights and Copyright Retention
AOJSE respects and upholds the intellectual property rights of all contributing authors. Authors who publish in AOJSE retain full copyright over their work. By submitting a manuscript to AOJSE, authors grant the journal a non-exclusive, worldwide, royalty-free license to publish, reproduce, distribute, publicly display, and archive the article in print and electronic formats. This license allows AOJSE to make the article freely accessible to readers globally while ensuring that the authors remain the rightful owners of their work.
Authors are permitted to deposit their published articles in institutional repositories, personal websites, academic networking platforms, and preprint servers, provided that the original publication in AOJSE is acknowledged and properly cited. Authors may also reuse their published content in subsequent works, presentations, teaching materials, and grant applications without requiring prior permission from the journal.
Third-Party Content
Authors are solely responsible for obtaining written permission to reproduce any third-party material, including figures, tables, images, data, or excerpts from other publications, included in their manuscript. Evidence of such permissions must be provided to the editorial office upon request. AOJSE does not assume any responsibility for copyright infringement arising from the unauthorized inclusion of third-party content in published articles.
Permitted Uses
Under the CC BY 4.0 license, the following uses of AOJSE published content are freely permitted without prior written permission from the journal or authors, provided that proper attribution is given. Users may read, download, print, and distribute articles for personal, educational, or research purposes. Researchers may reuse data, figures, and findings for meta-analyses, systematic reviews, and secondary research. Educators may incorporate published articles into course materials, syllabi, and academic presentations. Journalists, policymakers, and practitioners may reference and cite published findings for professional and public interest purposes.
Prohibited Uses
While the CC BY 4.0 license is broad and permissive, users may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. Users may not misrepresent the original authorship of published content or imply endorsement by the original authors or AOJSE without explicit consent. Plagiarism, data fabrication, and any form of academic misconduct in the reuse of published material are strictly prohibited and are a violation of publication ethics standards.
Institutional and Repository Deposit Policy
AOJSE fully supports self-archiving and green open access. Authors are encouraged to deposit the final published version of their article, also known as the version of record, in institutional repositories, subject repositories, and open-access databases immediately upon publication. There is no embargo period. Authors should always link back to the original article on the AOJSE website and include the full citation and DOI when depositing their work in any repository.
Digital Preservation and Archiving
AOJSE is committed to the long-term digital preservation of all published content to ensure its permanent availability and accessibility. The journal utilizes the Open Journal Systems (OJS) platform, which supports internationally recognized digital archiving standards. AOJSE encourages participation in archiving networks such as LOCKSS (Lots of Copies Keep Stuff Safe) and CLOCKSS (Controlled LOCKSS) to safeguard published articles against data loss and ensure continued access for future generations of researchers and readers.
Disclaimer
The views, opinions, findings, and conclusions expressed in articles published in AOJSE are solely those of the authors and do not necessarily reflect the official position, policy, or views of the journal, its editorial board, or its affiliated organizations. AOJSE makes every effort to ensure the accuracy and integrity of published content but does not accept legal responsibility for any errors, omissions, or claims arising from the use of information published in the journal.
Contact for Licensing Inquiries
For any questions regarding the licensing terms, copyright, or permitted use of content published in AOJSE, please contact the editorial office through the journal website at https://aojse.org. The editorial team will be happy to assist authors, readers, and institutions with any licensing-related queries.
