SEEDDUP: A Three-Tier SEcurE Data DedUPlication Architecture-Based Storage and Retrieval for Cross-Domains Over Cloud.

Data deduplication has become a promising technique that significantly reduces space utilization of cloud storage servers and optimizes the network bandwidth. A variety of deduplication techniques have been proposed to enhance the cloud server's storage efficiency. Most of the deduplication schemes do not address global indexing and user privacy issues. This paper elucidates a novel three-tier secure data deduplication architecture (referred to as SEEDDUP) for data storage and retrieval in the cloud. SEEDDUP provides data deduplication with proper indexing and user privacy. In this work, the optimal chunk size, for a given file size and format, is calculated using Cuckoo Search Algorithm. The chunk existence in the cloud is verified by the hash value generated via SHA3-512. To improve data deduplication speed, Merkle Hash Tree based MapReduce (MHTMR) is used for fast index lookup, which improves the performance at data storage and retrieval. In addition, data are encrypted based on its sensitivity level (low and high) using Niederreiter Public Key Cryptosystem. With this new SEEDDUP architecture, only legitimate users can request data successfully for limited times (k) and spurious data requests cannot be processed or handled in the cloud. Experimental results show that the proposed SEEDDUP can reduce latency, achieved good throughput and deduplication efficiency (chunk size variance and security measures) in data deduplication. [ABSTRACT FROM AUTHOR]