Deduplication is the technology that singles out the data that needs to be backed up. The ‘duplicate’ data is identified by patterns or by generating a unique hash for each data set and verifying against the existing data sets. Usually Deduplication software is bundled with VTLs, D2Ds which are nothing but secondary storage.
NetApp has come up with a Deduplication solution (A-SIS) that operates not only on secondary storage but also on primary storage. NetApp has integrated the solution with Data ONTAP® software and the WAFL® file system. Have a look at the following NetApp webpage to know more about the product from NetApp.
http://www.netapp.com/products/storage-systems/near-line-storage/asis-dedup.html
Polysius is one of the leading engineering companies equipping the cement and minerals industries. Polysius has tried out the solution. To know more about its experience and an overview of NetApp’s solution visit the following link.
http://www.enterprisestorageforum.com/sans/features/article.php/3707306
What can be cooked?
Deduplication is always an interesting technology which is getting quickly adopted. When data growth is in exponential, Deduplication is one among the solution to put a check. It started all the way on operating at secondary storage and now into primary storage.
I think this intelligence piece can be inserted into Operating Systems, Databases and applications that handle internal storage architecture like Exchange. These inventions will really shrink the data to be stored and can check the growth of Storage.
Lets wait and watch where we going!!!
