A Unified Data Fabric Framework for Modern Enterprises
Keywords:
Enterprise Data Fabrics;Intelligent Data Governance;Analytical Automation;AI-Driven Data Management;Data Fabric Architecture;Intelligent Decision Support;Enterprise Analytics;Automated Data Orchestration;Metadata Management;Data Integration;Real-Time Data Processing;Knowledge Graphs;Machine Learning Analytics;Cloud-Native Data Platforms;Autonomous Data Operations.Abstract
Enterprise data fabrics enable intelligent, automated data management across an organization's ecosystem, delivering accurate, contextualized data at scale to support data-driven decisions and operations. By automating data profiling, quality gate checks, and remediation, these fabrics meet the core requirements of modern analytical environments—transparency, reproducibility, and productivity.
Three enterprise-ready capabilities underpin this analytical automation: orchestration of analytical workflows, quality gates with remediation strategies, and governance. Workflow orchestration safeguards the confidentiality, integrity, availability, and performance of analytical pipelines, managing connections to diverse analytics engines and BI tools, integrating external data sources and services, and controlling latency, throughput, and security. Quality gates verify the timeliness, consistency, and correctness of data before it reaches downstream engines, automatically detecting issues and recommending remediation—whether rule-based or learning-driven. Together, these capabilities meet the growing demand for analytical automation, allowing organizations to capitalize on distributed engineering, model development, and operationalization.
References
1. Taleb, I., Serhani, M. A., Bouhaddioui, C., & Dssouli, R. (2021). Big data quality framework: A holistic approach to continuous quality management. Journal of Big Data, 8, 76.
2. Eichler, R., Giebler, C., Gröger, C., Schwarz, H., & Mitschang, B. (2021). Modeling metadata in data lakes—A generic model. Data & Knowledge Engineering, 136, 101931.
3. Pranitha Potturi. (2023). Cloud-Driven Business Intelligence Modernization for Scalable Enterprise Data Integration and Decision Support. International Journal of Intelligent Systems and Applications in Engineering, 11(3s), 387 –. Retrieved from https://www.ijisae.org/index.php/IJISAE/article/view/8505
4. Schoenenwald, A., Kern, S., Viehhauser, J., & Schildgen, J. (2021). Collecting and visualizing data lineage of Spark jobs. Datenbank-Spektrum, 21, 179–189.
5. Sáenz-Adán, C., García-Izquierdo, F. J., Pérez, B., Huynh, T. D., & Moreau, L. (2022). Automated and non-intrusive provenance capture with UML2PROV. Computing, 104, 767–788.
6. Nadal, S., Jovanovic, P., Bilalli, B., Romero, O., & others. (2022). Operationalizing and automating Data Governance. Journal of Big Data, 9, 117.
7. Yamada, M., Kitagawa, H., Amagasa, T., & Matono, A. (2023). Augmented lineage: Traceability of data analysis including complex UDF processing. The VLDB Journal, 32, 963–983.
8. Kolla, S. K., & Reddy, V. A. R. (2023). Deep Learning Architectures For Multimodal Medical Data Integration. South Eastern European Journal of Public Health, 248-260.
9. Jahnke, N., & Otto, B. (2023). Data catalogs in the enterprise: Applications and integration. Datenbank-Spektrum, 23, 89–96.
10. Abraham, R., Schneider, J., & vom Brocke, J. (2023). A taxonomy of data governance decision domains in data marketplaces. Electronic Markets, 33, 22.
11. Wider, A., Verma, S., & Akhtar, A. (2023). Decentralized data governance as part of a data mesh platform: Concepts and approaches. In 2023 IEEE International Conference on Web Services. IEEE.
12. Eichler, R., Gröger, C., Hoos, E., Stach, C., Schwarz, H., & Mitschang, B. (2023). Introducing the enterprise data marketplace: A platform for democratizing company data. Journal of Big Data, 10, 173.
13. Loganathan, R. (2022). Converging Security Architecture and Compliance Management in Enterprise Data Center Ecosystems: A Unified Control Framework. International Journal of Scientific Research and Modern Technology, 1(12), 295-312.
14. Araújo Machado, I., Costa, C., & Santos, M. Y. (2022). Data mesh: Concepts and principles of a paradigm shift in data architectures. Procedia Computer Science, 196, 263–271.
15. Papagiannidis, E., Enholm, I. M., Dremel, C., Mikalef, P., & Krogstie, J. (2023). Toward AI governance: Identifying best practices and potential barriers and outcomes. Information Systems Frontiers, 25, 123–141.
16. Schneider, J., Abraham, R., Meske, C., & vom Brocke, J. (2022). Artificial intelligence governance for businesses. Business & Information Systems Engineering, 64, 229–249.
17. Mäntymäki, M., Minkkinen, M., Birkstedt, T., & Viljanen, M. (2022). Defining organizational AI governance. AI and Ethics, 2, 603–609.
18. Bharath Penaka. (2023). AI-Driven Predictive Analytics for Early Detection of High-Risk Patients in Cloud-Based Healthcare Systems . International Journal of Medical Toxicology and Legal Medicine, 26(3 and 4), 118–124. Retrieved from https://ijmtlm.org/index.php/journal/article/view/1506
19. Mökander, J., & Floridi, L. (2023). Operationalising AI governance through ethics-based auditing: An industry case study. AI and Ethics, 3, 451–468.
20. Birkstedt, T., Minkkinen, M., Tandon, A., & Mäntymäki, M. (2023). AI governance: Themes, knowledge gaps and future agendas. Internet Research, 33(7), 133–167.
21. de Laat, P. B. (2021). Companies committed to responsible AI: From principles towards implementation and regulation? Philosophy & Technology, 34, 1135–1193.
22. Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2022). The ethics of algorithms: Key problems and solutions. AI and Society, 37, 215–230.
23. Mökander, J., & Floridi, L. (2022). Ethics-based auditing to develop trustworthy AI. Minds and Machines, 32, 323–327.
24. Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2021). From what to how: An initial review of publicly available AI ethics tools, methods and research to translate principles into practices. Science and Engineering Ethics, 26, 2141–2168.
25. Kaminski, M. E., & Malgieri, G. (2021). Algorithmic impact assessments under the GDPR: Producing multi-layered explanations. International Data Privacy Law, 11(2), 125–144.
26. Sasidhar Reddy Mondeddula. (2023). Natural Language Processing for Intelligent Automation of Financial Documents and Banking Operations. International Journal of Intelligent Systems and Applications in Engineering, 11(8s), 605–612. Retrieved from https://www.ijisae.org/index.php/IJISAE/article/view/8527
27. Metcalf, J., Moss, E., & Boyd, D. (2021). Owning ethics: Corporate logics, Silicon Valley, and the institutionalization of ethics. Social Research: An International Quarterly, 88(3), 449–472.
28. Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. E. (2022). Outsider oversight: Designing a third-party audit ecosystem for AI governance. Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society, 560–571.
29. Waldman, A. E., & Martin, K. (2022). Governing algorithmic decisions: The role of decision importance and governance on perceived legitimacy of algorithmic decisions. Big Data & Society, 9(2).
30. Mattaparthi, R. (2023). Deep Learning-Driven Combustion Anomaly Detection in Diesel Powertrains: A Multi-Sensor Fusion Approach for Real-Time ECM Adaptation. International Journal of Intelligent Systems and Applications in Engineering, 11, 1084.
31. Eichler, R., Gröger, C., Hoos, E., Schwarz, H., & Mitschang, B. (2022). Data shopping—How an enterprise data marketplace supports data democratization in companies. In Intelligent Information Systems: CAiSE Forum 2022 Proceedings (pp. 19–26). Springer.
Additional Files
Published
Issue
Section
License
Copyright (c) 2024 Olivia Johnson (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The American Online Journal of Science and Engineering (AOJSE) is an open-access journal, and all published articles are made freely available to readers worldwide under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license governs the use, sharing, adaptation, and distribution of all content published in AOJSE and is designed to promote the broadest possible dissemination and reuse of scholarly research.
Creative Commons Attribution 4.0 International License (CC BY 4.0)
Under the Creative Commons Attribution 4.0 International License, any user is free to share, copy, and redistribute the published material in any medium or format, and to adapt, remix, transform, and build upon the material for any purpose, including commercial use, provided that appropriate credit is given to the original authors and source. The license cannot be revoked as long as the terms are followed.
When using or redistributing content published in AOJSE, users must provide proper attribution by citing the original authors' names, the article title, the journal name (AOJSE), the volume and issue number, the year of publication, and the DOI or URL of the article. Users must also indicate if any changes were made to the original work. Attribution must be provided in a reasonable manner but must not suggest that the authors or AOJSE endorse the user or their use of the material.
Author Rights and Copyright Retention
AOJSE respects and upholds the intellectual property rights of all contributing authors. Authors who publish in AOJSE retain full copyright over their work. By submitting a manuscript to AOJSE, authors grant the journal a non-exclusive, worldwide, royalty-free license to publish, reproduce, distribute, publicly display, and archive the article in print and electronic formats. This license allows AOJSE to make the article freely accessible to readers globally while ensuring that the authors remain the rightful owners of their work.
Authors are permitted to deposit their published articles in institutional repositories, personal websites, academic networking platforms, and preprint servers, provided that the original publication in AOJSE is acknowledged and properly cited. Authors may also reuse their published content in subsequent works, presentations, teaching materials, and grant applications without requiring prior permission from the journal.
Third-Party Content
Authors are solely responsible for obtaining written permission to reproduce any third-party material, including figures, tables, images, data, or excerpts from other publications, included in their manuscript. Evidence of such permissions must be provided to the editorial office upon request. AOJSE does not assume any responsibility for copyright infringement arising from the unauthorized inclusion of third-party content in published articles.
Permitted Uses
Under the CC BY 4.0 license, the following uses of AOJSE published content are freely permitted without prior written permission from the journal or authors, provided that proper attribution is given. Users may read, download, print, and distribute articles for personal, educational, or research purposes. Researchers may reuse data, figures, and findings for meta-analyses, systematic reviews, and secondary research. Educators may incorporate published articles into course materials, syllabi, and academic presentations. Journalists, policymakers, and practitioners may reference and cite published findings for professional and public interest purposes.
Prohibited Uses
While the CC BY 4.0 license is broad and permissive, users may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. Users may not misrepresent the original authorship of published content or imply endorsement by the original authors or AOJSE without explicit consent. Plagiarism, data fabrication, and any form of academic misconduct in the reuse of published material are strictly prohibited and are a violation of publication ethics standards.
Institutional and Repository Deposit Policy
AOJSE fully supports self-archiving and green open access. Authors are encouraged to deposit the final published version of their article, also known as the version of record, in institutional repositories, subject repositories, and open-access databases immediately upon publication. There is no embargo period. Authors should always link back to the original article on the AOJSE website and include the full citation and DOI when depositing their work in any repository.
Digital Preservation and Archiving
AOJSE is committed to the long-term digital preservation of all published content to ensure its permanent availability and accessibility. The journal utilizes the Open Journal Systems (OJS) platform, which supports internationally recognized digital archiving standards. AOJSE encourages participation in archiving networks such as LOCKSS (Lots of Copies Keep Stuff Safe) and CLOCKSS (Controlled LOCKSS) to safeguard published articles against data loss and ensure continued access for future generations of researchers and readers.
Disclaimer
The views, opinions, findings, and conclusions expressed in articles published in AOJSE are solely those of the authors and do not necessarily reflect the official position, policy, or views of the journal, its editorial board, or its affiliated organizations. AOJSE makes every effort to ensure the accuracy and integrity of published content but does not accept legal responsibility for any errors, omissions, or claims arising from the use of information published in the journal.
Contact for Licensing Inquiries
For any questions regarding the licensing terms, copyright, or permitted use of content published in AOJSE, please contact the editorial office through the journal website at https://aojse.org. The editorial team will be happy to assist authors, readers, and institutions with any licensing-related queries.
