AI-Driven Operations and Automated Workflows on Azure

Authors

  • Niklas Andersson Author

Keywords:

Predictive intelligence, cloud ecosystem, AIOps, AIOps maturity, AIOps value, Azure workflow automation.

Abstract

Cloud environments are becoming increasingly enterprise-wide, with advanced features and capabilities being added to the three service models commonly found in these platforms (IaaS, PaaS, and SaaS). These services are often integrated into organizations' environments to enable predictive (anomaly detection, predictive analytics) and automated intelligence (automated decision-making and actions). The new areas of AIOps and workflow automation are gaining popularity due to their promise of improved business resilience and lower total cost of ownership, but interest remains low. A predictive intelligence framework for AIOps and workflow automation in Azure is presented, providing research support for its adoption.

Although relations between derivates of cloud technology and AIOps or workflow automation are apparent, few studies propose a mapping of Azure services to AIOps capability areas. Also lacking is a cloud-native view of AIOps scalability and performance challenges or a forward-looking perspective on emergent trends. Addressing these gaps aids understanding of how cloud environments empower predictive and automated intelligence. Proposed direction reinforces the notion that the Azure platform is not solely for resource hosting but comprises a continuously evolving toolbox for business management.

References

1. Notaro, P., Cardoso, J., & Gerndt, M. (2021). A survey of AIOps methods for failure management. ACM Transactions on Intelligent Systems and Technology, 12(6), Article 81.

2. John, M. M., Olsson, H. H., & Bosch, J. (2021). Towards MLOps: A framework and maturity model. In Proceedings of the 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (pp. 334–341). IEEE.

3. Granlund, T., Kopponen, A., Stirbu, V. A., Myllyaho, L., & Mikkonen, T. (2021). MLOps challenges in multi-organization setup: Experiences from two real-world cases. In 2021 IEEE/ACM 1st Workshop on AI Engineering—Software Engineering for AI (WAIN) (pp. 1–8). IEEE.

4. Nandan, B. P., & Chitta, S. S. (2023). Machine Learning Driven Metrology and Defect Detection in Extreme Ultraviolet (EUV) Lithography: A Paradigm Shift in Semiconductor Manufacturing. Educational Administration: Theory and Practice, 29 (4), 4555–4568. International Journal of Scientific Research and Modern Technology, 1(12), 216-226.

5. Mäkinen, S. S., Skogström, H., Laaksonen, E., & Mikkonen, T. (2021). Who needs MLOps: What data scientists seek to accomplish and how can MLOps help? In 2021 IEEE/ACM 1st Workshop on AI Engineering—Software Engineering for AI (WAIN). IEEE.

6. Xie, Y., Miranda da Cruz, L., Heck, P., & Rellermeyer, J. S. (2021). Systematic mapping study on the machine learning lifecycle. In Proceedings of the 2021 IEEE/ACM 1st Workshop on AI Engineering—Software Engineering for AI (WAIN) (pp. 70–73). IEEE.

7. Mashetty, S. (2023). A Comparative Analysis of Patented Technologies Supporting Mortgage and Housing Finance. Available at SSRN 5249181. Mashetty, S. (2023). A Comparative Analysis of Patented Technologies Supporting Mortgage and Housing Finance. Available at SSRN 5249181.

8. Martínez-Fernández, S., Bogner, J., Franch, X., Oriol, M., Siebert, J., Trendowicz, A., Vollmer, A. M., & Wagner, S. (2022). Software engineering for AI-based systems: A survey. ACM Transactions on Software Engineering and Methodology, 31(2), Article 37.

9. Kreuzberger, D., Kühl, N., & Hirschl, S. (2023). Machine learning operations (MLOps): Overview, definition, and architecture. IEEE Access, 11, 31866–31879.

10. Mandala, G., Reddy, R., Nishanth, A., Yasmeen, Z., & Maguluri, K. K. (2023). Ai and ml in healthcare: redefining diagnostics, treatment, and personalized medicine. International Journal of Applied Engineering & Technology, 5(S6).

11. Diaz-de-Arcaya, J., Torre-Bastida, A. I., Zárate, G., Miñón, R., & Almeida, A. (2023). A joint study of the challenges, opportunities, and roadmap of MLOps and AIOps: A systematic survey. ACM Computing Surveys, 56(4), Article 84.

12. Moreschini, S., Lomio, F., Hästbacka, D., & Taibi, D. (2022). MLOps for evolvable AI intensive software systems. In Proceedings of the 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (pp. 1293–1294). IEEE.

13. Paleti, S. (2023). Transforming Money Transfers and Financial Inclusion: The Impact of AI-Powered Risk Mitigation and Deep Learning-Based Fraud Prevention in Cross-Border Transactions. Available at SSRN, 5158588.

14. Mucha, T. M., Ma, S., & Abhari, K. (2022). Beyond MLOps: The lifecycle of machine learning-based solutions. In AMCIS 2022 Proceedings. Association for Information Systems.

15. Lima, A., Monteiro, L., & Furtado, A. (2022). MLOps: Practices, maturity models, roles, tools, and challenges—A systematic literature review. In Proceedings of the International Conference on Enterprise Information Systems.

16. Matsui, B. M. A., & Goya, D. H. (2022). MLOps: Five steps to guide its effective implementation. In Proceedings of the 1st International Conference on AI Engineering: Software Engineering for AI (pp. 33–34). Association for Computing Machinery.

17. Meda, R., & Pamisetty, A. (2023). Intelligent Infrastructure for Real-Time Inventory and Logistics in Retail Supply Chains. Educational Administration: Theory and Practice, 29 (4), 5215–5233.

18. Hewage, N., & Meedeniya, D. (2022). Machine learning operations: A survey on MLOps tool support. In Proceedings of relevant machine learning and software engineering research.

19. John, M. M., Gillblad, E. A. D., Olsson, H. H., & Bosch, J. (2023). Advancing MLOps from ad hoc to Kaizen. In Proceedings of the 49th Euromicro Conference on Software Engineering and Advanced Applications (pp. 94–101). IEEE.

20. John, M. M., Holmström Olsson, H., Bosch, J., & Gillblad, E. A. D. (2023). Exploring trade-offs in MLOps adoption. In Proceedings of the 30th Asia-Pacific Software Engineering Conference (pp. 369–375). IEEE.

21. Mashetty, S. (2023). View of A Comparative Analysis of Patented Technologies Supporting Mortgage and Housing Finance. Educational Administration: Theory and Practice.

22. Poenaru-Olaru, L., Cruz, L., Rellermeyer, J. S., & van Deursen, A. (2023). Maintaining and monitoring AIOps models against concept drift. In Proceedings of the 2023 IEEE/ACM 2nd International Conference on AI Engineering—Software Engineering for AI (pp. 98–99). IEEE.

23. Amorim, B. F., Souza, A. C. C., Costa, L. M., & Souza, F. C. M. (2023). An investigation of challenges in the machine learning lifecycle and the importance of MLOps: A survey. In Proceedings of Computer on the Beach 2023.

24. Barrak, A., Petrillo, F., & Jaafar, F. (2022). Serverless on machine learning: A systematic mapping study. IEEE Access, 10, 99337–99352.

25. Kalisetty, S. (2023). Big Data–Driven Cloud Collaboration Models for Enhancing Supplier–Retailer Synchronization in Mod-ern Manufacturing Supply Chains. Journal of Computational Analy-sis and Applications (JoCAAA), 31(4), 2188-2205.

26. Qiu, H., Mao, W., Patke, A., Wang, C., Franke, H., Kalbarczyk, Z. T., Başar, T., & Iyer, R. K. (2022). Reinforcement learning for resource management in multi-tenant serverless platforms. In Proceedings of the 2nd European Workshop on Machine Learning and Systems (pp. 20–28). Association for Computing Machinery.

27. Qiu, H., Mao, W., Patke, A., Wang, C., Franke, H., Kalbarczyk, Z. T., Başar, T., & Iyer, R. K. (2022). SIMPPO: A scalable and incremental online learning framework for serverless resource management. In Proceedings of the ACM Symposium on Cloud Computing. Association for Computing Machinery.

28. Luo, C., Qiao, B., Xing, W., Chen, X., Zhao, P., Du, C., Yao, R., Zhang, H., Wu, W., Cai, S., He, B., Rajmohan, S., & Lin, Q. (2021). Correlation-aware heuristic search for intelligent virtual machine provisioning in cloud systems. Proceedings of the AAAI Conference on Artificial Intelligence, 35(14), 11677–11685.

29. Luo, C., Zhao, P., Qiao, B., Wu, Y., Zhang, H., Wu, W., Lu, W., Dang, Y., Rajmohan, S., Lin, Q., & Zhang, D. (2021). NTAM: Neighborhood-temporal attention model for disk failure prediction in cloud platforms. In Proceedings of the Web Conference 2021 (pp. 1181–1191). Association for Computing Machinery.

30. Zhao, P., Luo, C., Qiao, B., Wu, Y., Dang, Y., Chintalapati, M., Yi, S., Wang, P., Zhou, A., Rajmohan, S., Lin, Q., & Zhang, D. (2021). F3: Fault forecasting framework for cloud systems. In Proceedings of the 2021 IEEE/ACM International Conference on Software Engineering Workshops.

31. Adusupalli, B. (2022). The Impact of Regulatory Technology (RegTech) on Corporate Compliance: A Study on Automation, AI, and Blockchain in Financial Reporting. Mathematical Statistician and Engineering Applications, 71 (4), 16696–16710.

32. Li, L., Zhang, X., Zhao, X., Zhang, H., Kang, Y., Zhao, P., Qiao, B., He, S., Lee, P., Sun, J., Gao, F., Yang, L., Lin, Q., Rajmohan, S., Xu, Z., & Zhang, D. (2021). Fighting the fog of war: Automated incident detection for cloud systems. In 2021 USENIX Annual Technical Conference (pp. 131–146). USENIX Association.

33. Wang, Y., Chen, J., Yang, L., Zhang, H., Zhao, P., Qiao, B., Kang, Y., Lin, Q., Rajmohan, S., Gao, F., Xu, Z., Dang, Y., & Zhang, D. (2021). How long will it take to mitigate this incident for online service systems? In Proceedings of the 2021 IEEE 32nd International Symposium on Software Reliability Engineering (pp. 36–46). IEEE.

34. Wang, Y., Crankshaw, D., Yadwadkar, N. J., Berger, D. S., Kozyrakis, C., & Bianchini, R. (2022). SOL: Safe on-node learning in cloud platforms. In Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems. Association for Computing Machinery.

35. Pamisetty, V. (2023). Leveraging artificial intelligence for strategic decision-making in tax administration and policy design. Available at SSRN.

36. Li, Y., Zhang, X., He, S., Chen, Z., Kang, Y., Liu, J., Li, L., Dang, Y., Gao, F., Xu, Z., Rajmohan, S., Lin, Q., Zhang, D., & Lyu, M. R. (2022). An intelligent framework for timely, accurate, and comprehensive cloud incident detection. ACM SIGOPS Operating Systems Review, 56(1), 1–7.

37. Shetty, M., Bansal, C., Upadhyayula, S. P., Radhakrishna, A., & Gupta, A. (2022). AutoTSG: Learning and synthesis for incident troubleshooting. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Association for Computing Machinery.

38. Nawrocki, P., & Osypanka, P. (2021). Cloud resource demand prediction using machine learning in the context of QoS parameters. Journal of Grid Computing, 19, Article 20.

39. Ghosh, S., et al. (2022). Machine learning-centric resource management in cloud computing: A review and future directions. Journal of Network and Computer Applications, 204, 103405.

40. Pandugula, C., & Nampalli, R. C. R. Optimizing Retail Performance: Cloud-Enabled Big Data Strategies for Enhanced Consumer Insights.

41. Alonso, J., Orue-Echevarria, L., & Huarte, M. (2022). CloudOps: Towards the operationalization of the cloud continuum: Concepts, challenges and a reference framework. Applied Sciences, 12(9), 4347.

42. El-Kassabi, H. T., Serhani, M. A., Masud, M. M., Shuaib, K., & Khalil, K. (2023). Deep learning approach to security enforcement in cloud workflow orchestration. Journal of Cloud Computing, 12, Article 10.

43. Wang, H., et al. (2023). Deep reinforcement learning for application scheduling in resource-constrained, multi-tenant serverless computing environments. Future Generation Computer Systems, 143, 277–292.

44. Recharla, M., & Chitta, S. AI-Enhanced Neuroimaging and Deep Learning-Based Early Diagnosis of Multiple Sclerosis and Alzheimer’s.

45. Ahmed, T., Ghosh, S., Bansal, C., Zimmermann, T., Zhang, X., & Rajmohan, S. (2023). Recommending root-cause and mitigation steps for cloud incidents using large language models. In Proceedings of the 45th IEEE/ACM International Conference on Software Engineering (pp. 1737–1749). IEEE.

46. Parayil, A., Ghosh, S., Kang, Y., Ma, M., Bansal, C., Nath, S., Mace, J., & Ganatra, V. (2023). Detection is better than cure: A cloud incidents perspective. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (pp. 1891–1902). Association for Computing Machinery.

Additional Files

Published

2024-06-21

How to Cite

AI-Driven Operations and Automated Workflows on Azure. (2024). The American Online Journal of Science and Engineering (AOJSE), 2(02). https://aojse.org/index.php/aojse/article/view/45

Similar Articles

1-10 of 48

You may also start an advanced similarity search for this article.