Intelligent Big Data Governance Using Policy-Driven Automation in Cloud-Based Enterprise Platforms
Abstract
The rapid expansion of cloud-based enterprise platforms has intensified the need for robust big data governance frameworks that ensure data quality, security, compliance, and usability. Traditional governance approaches often struggle to scale with the volume, velocity, and variety of modern data ecosystems. This paper explores an intelligent big data governance model that leverages policy-driven automation to streamline governance processes in cloud environments. By integrating artificial intelligence and machine learning techniques, the proposed approach enables dynamic policy enforcement, real-time monitoring, and adaptive decision-making. Policy-driven automation facilitates consistent data handling practices, reduces manual intervention, and enhances regulatory compliance across distributed systems. Furthermore, the model addresses critical challenges such as data lineage tracking, metadata management, and access control. Through a combination of rule-based engines and intelligent analytics, organizations can achieve improved data reliability, transparency, and operational efficiency. This study highlights the significance of automated governance frameworks in supporting scalable and resilient enterprise platforms while minimizing risks associated with data misuse and non-compliance. The findings suggest that intelligent governance systems are essential for organizations aiming to harness the full potential of big data in cloud-driven digital transformation.
Article Information
Journal |
International Journal of Advanced Engineering Science and Information Technology (IJAESIT) |
|---|---|
Volume (Issue) |
Vol. 7 No. 5 (2024): International Journal of Advanced Engineering Science and Information Technology (IJAESIT) |
DOI |
|
Pages |
14906-14914 |
Published |
October 9, 2024 |
| Copyright | |
Open Access |
This work is licensed under a Creative Commons Attribution 4.0 International License. |
How to Cite |
Magnus Sahlgren (2024). Intelligent Big Data Governance Using Policy-Driven Automation in Cloud-Based Enterprise Platforms. International Journal of Advanced Engineering Science and Information Technology (IJAESIT) , Vol. 7 No. 5 (2024): International Journal of Advanced Engineering Science and Information Technology (IJAESIT) , pp. 14906-14914. https://doi.org/10.15662/IJAESIT.2024.0705007 |
References
2. Kunadi, S. K. (2022). Designing high-performance data pipelines using Snowflake and cloud-native architectures. International Journal of Research and Applied Innovations (IJRAI), 5(6), 8220–8230.
3. Boddupally, H. L. (2022). Designing intelligent support bot frameworks for scalable enterprise production systems. Journal of Scientific and Engineering Research, 9(10), 108–115. https://doi.org/10.5281/zenodo.18085293
4. Chachra, B. (2023). Strengthening national digital infrastructure: Privacy focused data pipelines for ethical behavioral analytics. International Journal of Computer Technology and Electronics Communication (IJCTEC), 6(4), 7331–7340.
5. Nallamothu, T. K. (2023). GENERATIVE AI IN HEALTHCARE: AUTOMATING CLINICAL DOCUMENTATION, DIAGNOSTICS, AND KNOWLEDGE SYNTHESIS. International Journal of Computer Technology and Electronics Communication, 6(1), 6376-6392.
6. Rajasekharan, R. (2017). The role of DevOps automation in improving enterprise database reliability. International Journal of Humanities and Information Technology (IJHIT), 2(1), 20–29.
7. Jagadeesh, S., & Sugumar, R. (2017). A Comparative study on Artificial Bee Colony with modified ABC algorithm. European Journal of Applied Sciences, 9(5), 243-248.
8. Madhava Rao Thota. (2019). Policy-Driven Automation for Scalable Governance in Enterprise Big Data Platforms. International Journal of Scientific Research & Engineering Trends, 5(6). https://doi.org/10.5281/zenodo.18478880
9. Vayyasi, N. K. (2023). Designing a multi-domain predictive framework using Java and generative AI for financial, retail, and industrial use cases. International Journal of Computer Technology and Electronics Communication (IJCTEC), 6(6), 8060–8069.
10. Inbavalli, M., & Arasu, T. (2015). Efficient Analysis of Frequent Item Set Association Rule Mining Methods. International Journal of Scientific & Engineering Research, 6(4).
11. Katta, T. B. (2023). Towards unified enterprise integration: Leveraging hybrid integration platforms to bridge on-premises and cloud environments. International Journal of Computer Technology and Electronics Communication (IJCTEC), 6(5), 7354–7365. https://doi.org/10.15680/IJCTECE.2023.0605014
12. Soundappan, S. J. (2020). Big Data Analytics in Healthcare: Applications for Pandemic Forecastin. International Journal of Advanced Research in Computer Science & Technology (IJARCST), 3(1), 2248-2253.
13. Anand, L., & Neelanarayanan, V. (2019). Liver disease classification using deep learning algorithm. BEIESP, 8(12), 5105-5111.
14. Boddupally, H. (2023). Intelligent semantic retrieval pipelines driving scalable, context-aware, and high-fidelity knowledge management capabilities across complex enterprise application landscapes. International Journal of Scientific Research in Science, Engineering and Technology, 10(4), 404–419. https://doi.org/10.32628/IJSRSET232533
15. Sruthi, R. S., Ananya, S., & Murugeshwari, B. (2010). Web Based Virtual Control System Laboratory and On-Line Temperature Control of Electrophoresis Equipment using LabVIEW. International Journal of Computer Applications, 975, 8887.
16. Viswanathan, V. (2024). Embedding ethical principles into generative AI workflows for project teams. ProQuest. https://www.proquest.com/openview/2f467f07557f45c3a732296d5b78ad70
17. Sudha, N., Kumar, S. S., Rengarajan, A., & Rao, K. B. (2021). Scrum Based Scaling Using Agile Method to Test Software Projects Using Artificial Neural Networks for Block Chain. Annals of the Romanian Society for Cell Biology, 25(4), 3711-3727.
18. Dave, B. L. (2023). FEDERATED AI FRAMEWORKS FOR REGULATED INDUSTRIES: CROSS-DOMAIN INTELLIGENCE FOR SOCIAL SERVICES, INSURANCE, AND INDUSTRIAL OPERATIONS. International Journal of Research and Applied Innovations, 6(1), 8346-8362.
19. Gentyala, R. (2022). A Hybrid Machine Learning Approach for Credit Scoring: Integrating Traditional Financial History with Mobile Phone Behavioral Metrics. QITP-IJAIMLRD, 3(1), 13-40.
20. Appani, C. (2024). Explainable AI for fraud detection in financial transactions. Journal of Information Systems Engineering and Management, 9(3). https://jisem-journal.com/download/32_Explainable_AI_for_Fraud_Detection.pdf
21. Mathew, A. (2023). Learning Metaverse Powered by Artificial Intelligence. Recent Progress in Science and Technology, 4(4), 134-141.
22. Niture, N. A., & Abdellatif, I. (2020, October). AI based airplane air pollution identification architecture using satellite imagery. In 2020 IEEE Cloud Summit (pp. 150-155). IEEE.
23. Boddupally, H. L. (2022). Toward self-optimizing enterprise applications: AI-guided profiling and performance optimization for C# and SQL-based systems. SSRN. https://doi.org/10.2139/ssrn.6270498
24. Chachra, B. (2023). Strengthening national digital infrastructure: Privacy focused data pipelines for ethical behavioral analytics. International Journal of Computer Technology and Electronics Communication (IJCTEC), 6(4), 7331–7340.
25. Madhava Rao Thota. (2019). Policy-Driven Automation for Scalable Governance in Enterprise Big Data Platforms. International Journal of Scientific Research & Engineering Trends, 5(6). https://doi.org/10.5281/zenodo.18478880
26. G. Vimal Raja, K. K. Sharma (2014). Analysis and Processing of Climatic data using data mining techniques. Envirogeochimica Acta, 1(8), 460-467.
27. Madhava Rao Thota. (2019). Policy-Driven Automation for Scalable Governance in Enterprise Big Data Platforms. International Journal of Scientific Research & Engineering Trends, 5(6). https://doi.org/10.5281/zenodo.18478880