Privacy Preserving Mining using Data Encryption scheme for Hadoop Ecosystem
Authors: Sonal Jain, Mohit Jain
Published in: IJRRETAS, Volume 5, Issue 10, pp. 1-6 (24 Nov 2025)
Impact Factor: 4.75 (2019)
License:
CC BY 4.0 (Open Access)
Certificate: View Certificate
Abstract
Nowadays, explosive amount of data is being generated every day. Data from sensors, mobile devices, social networking websites, scientific data & enterprises – all are contributing to this huge explosion in data. This sudden bombardment can be grasped by the fact that we have created a vast volume of data in the last two years. Big Data- as these large chunks of data is generally called- Big Data and has become one of the hottest research trends today. Research suggests that tapping the potential of this data can benefit businesses, scientific disciplines and the public sector contributing to their economic gains as well as development in every sphere. Security is one of the important features to keep information safe and secure from unwanted and unintended data. Study of existing work concludes that HDFS does not have any security framework or algorithm to keep data safe and secure. This work proposed a solution to perform encryption of large data going to be put into HDFS as safe and secure.
Keywords
- Hadoop
- Map Reduce
- Blowfish
- Data Encryption
References
- Raj R. Parmar, Sudipta Roy, Debnath Bhattacharyya, Samir kumar bandyopadhyay, “Large-Scale Encryption in the Hadoop Environment: Challenges and Solutions”. Published on 9 May 2017, pp. 7156-7163, vol. 5, IEEE Access.
- Milind mathur, ayushkesarwani, “comparison between DES, 3DES, RC2, RC6, Blowfish and AES”. Proceedings of National Conference on New Horizons in IT - NCNHIT 2013.
- S. Ghemawat, H. Gobioff, and S.-T. Leung, ‘‘The Google file system,’’ in Proc. 19th ACM Symp. Oper. Syst. Principles (SOSP), 2003, pp. 29–43.
- D. Borthakur, ‘‘The Hadoop distributed file system: Architecture and design,’’ Hadoop Project Website, vol. 11, p. 21, Aug. 2007
- B. Lakhe, Practical Hadoop Security. New York, NY, USA: Apress, 2014, pp.19-46.
- . P. P. Sharma and C. P. Navdeti, ‘‘Securing big data Hadoop: A review of security issues, threats and solution,’’ Int. J. Comput. Sci. Inf. Technol., vol. 5, no. 2, pp. 2126–2131, 2014.
- D. J. Bernstein, ‘‘ChaCha, a variant of Salsa20,’’ in Proc. Workshop Rec SASC, 2008, pp. 1–6.
- . Seonyoung Park and Youngseok Lee, Secure Hadoop with Encrypted HDFS, Springer-Verlag Berlin Heidelberg in 2013Prof.
- Zerfos, Petros, Hangu Yeo, Brent D. Paulovicks, and Vadim Sheinin. "SDFS: Secure distributed file system for data-at-rest security for Hadoop-as-a-service." In Big Data (Big Data), 2015 IEEE International Conference on, pp. 1262-1271. IEEE, 2015. ISSN Online: (2455-4723)
- Cheng, Zhonghan, Diming Zhang, Hao Huang, and Zhenjiang Qian. "Design and Implementation of Data Encryption in Cloud based on HDFS." International Workshop on Cloud Computing and Information Security (CCIS 2013), pp. 274-277. 2013.
- Shehzad, Danish, Zakir Khan, Hasan Dag, and ZekiBozkus. "A Novel Hybrid Encryption Scheme to Ensure Hadoop Based Cloud Data Security."International Journal of Computer Science and Information Security 14, no. 4 (2016): 480.
- S. Kaisler et al. “Big Data: Issues and Challenges Moving Forward”. English. In: System Sciences (HICSS), 2013 46th Hawaii International Conference on. IEEE, Jan. 2013, pp. 995–1004.
- Fhom, H. S. (2015) ‘Big Data: Opportunities and Privacy Challenges’, arXiv.org, p. 823.
- Quan, Q., Tian-Hong, W., Rui, Z. and Ming-jun, X. (2013) ‘A model of cloud data secure storage based on HDFS’. IEEE, pp. 173–178. doi:10.1109/ICIS.2013.6607836.
- Owen O’Malley, Kan Zhang, Sanjay Radia, Ram Marti, and Christopher Harrell. Hadoop Security Design, Technical Report, 2009.10 6
How to Cite
More by these Authors
- Hybrid Recommendation ArchitectureforCloud Computing Applications2024 • Vol. 10, Issue 1
- Implementation to Find Navigational pattern of Log Files Using Hadoop Technology2022 • Vol. 8, Issue 6
- Strong Authentication Policy for Cloud Computing Environment Using Modified Kerberos Authentication Protocol2022 • Vol. 8, Issue 6
- An Analysis for Security of Cloud Data Storage using Client Server Mutual Authentication2022 • Vol. 8, Issue 6