Computer and Information Engineering | Article | Published 2022

DEVELOPMENT OF THE BIG DATA PROCESSING ARCHITECTURE BASED ON DISTRIBUTED COMPUTING SYSTEMS

Authors:

Fayzullo Nazarov

Publisher: Fan va texnologiyalar nashriyot-matbaa uyi
Collection: INFORMATIKA VA ENERGETIKA MUAMMOLARI
Keywords: Big Data, Fast Data, Big Analytics, Deep Insight, Amdahl's law, Gustafson's law, interconnection scheme of a distributed computing system, distributed software architecture, optimized distributed computing system architecture

Abstract

Today, the growth of the flow of digital data requires unusual, specialized methods and tools for storing and processing it. The storage and processing of large volumes of data using a conventional single computing system are not efficient, neither in terms of storage nor processing speed. With that in mind, storing and processing large amounts of data using interconnected computing systems can have a number of benefits. One of the main tasks in the joint use of these computing systems is the correct choice of the scheme of interaction between them, as well as the software architecture. This research presents the efficiency and high-efficiency approach to storing and processing Big Data’s Fast Data and Big Analytics class data using distributed computing systems. In addition, this research analyzes the requirements for distributed computing systems in Big Data processing and storage, as well as the interconnection schemes and software architectures of distributed computing systems for Big Data processing and storage. As a result of this research, an optimized architecture for the Big Data processing and storage of a distributed computing system was developed.

References

  1. 1. A.R. Akhatov, A.E. Rashidov, F.M. Nazarov “Increasing data reliability in big data systems” // Scientific Journal of Samarkand State University 2021, №5, 106-14
  2. 2. Fan Zhang, Zude Zhou, Wenjun Xu “Distributed Storage and Processing Method for Big Data Sensing Information of Machine Operation Condition” // Journal of software, VOL. 9, NO. 10, OCTOBER 2014
  3. 3. V.A. Reznichenko, “Chto takoe Big Data” // Problemi programuvannya 2019. № 3, 86-100
  4. 4. Akhatov A.R., Rashidov A.E. “Big Data va unig turli sohalardagi tadbiqi”, // Descendants of Muhammad Al-Khwarizmi, 2021, № 4 (18), 135-44
  5. 5. A.I. Bogomolov, V.P. Nevejin “From Big Data to Big knowledge”, Xronoekonomika 2017, № 2 (4), 24-28
  6. 6. A.R. Akhatov, F.M. Nazarov, A.E. Rashidov “Increasing data reliability by using bigdata parallelization mechanisms” // ICISCT 2021, DOI: 10.1109/ICISCT52966.2021.9670387, November 3-5,
  7. 7. Akhatov A.R., Nazarov F. M. “Methods of automation of the employment process on the basis of ratings” // International Conference on Information Science and Communications Technologies (ICISCT) 19 February 2021.
  8. 8. Ajay D. Kshemkalyani, Mukesh Singhal “Distributed Computing. Principles, Algorithms, and Systems” // Cambridge university press, USA, 2008, 756
  9. 9. L.Y. Karpov “Arxitektura raspredelennыx sistem programmnogo obespecheniya” // Moskva, MAKS Press, 2007
  10. 10. A.R. Akhatov, F.M. Nazarov, A.E. Rashidov “Mechanisms of information reliability in BigData and blockchain technologies” // ICISCT 2021 November 3-5. DOI: 10.1109/ICISCT52966.2021.9670052,
  11. 11. Bogdan Khmelnitsky “Methods and tools for teaching parallel and distributed computing in universities: a systematic review of the literature” // The International Conference on History, Theory and Methodology of Learning, 2020
  12. 12. Akhatov A.R., Nazarov F. M. “Development of Control Models of Non-Stationary Systems in Limited Conditions” // International Conference on Information Science and Communications Technologies (ICISCT) 19 February 2020
  13. 13. G. Amdahl “Validity of the single processor approach to achieving large scale computer capability” // in Proceedings of AFIPS Spring Joint Computer Conference, pp. 30, Atlantic City, New Jersey, United States, 1967.
  14. 14. Inderpal Singh “Review on Parallel and Distributed Computing” // Scholars Journal of Engineering and Technology (SJET) 1(4), 2013, 218-25
  15. 15. J.L. Gustafson “Reevaluating Amdahl’s law” // Communications of ACM 31(5), 1988, 532-33.
Loading...
0

Views

0

Reads

0

Comments

0

Reviews

0

Liked

0

Shared

0

Bibliography

0

Citations

Like and share on

Cite this publication

Copy text below and use in your article