Deduplication

Data deduplication is a technique for eliminating duplicate copies of repeating data. At filesystems implemented at least on ZFS and NetApp proprietary Write Anywhere File Layout filesystems.

Deduplication is applied in Volume level in NetAPP arrays (NetApp FAS) and can be configured under Storage Efficiency tab in ONTAP GUI.

ZFS deduplication

• zfs get all | grep dedup

Activities

• Deduplication on NetApp arrays can be applied on mounted volumes but enough space is required. Check for needed free space before applying deduplication.
• Read JFrog Artifactory deduplication implementation: https://www.jfrog.com/confluence/display/JFROG/Checksum-Based+Storage

Related terms

• Dell EMC Data Domain
• MSDP

See also

• ONTAP: volume show, volume rename, lun show, lun mapping show, releases, system show, storage disk show, storage aggregate show or aggr show
• ZFS: ZFS deduplication, ZFS snapshot, zfs list, zpool status, zpool create, zfs create, zfs get all, zfs set, zfs mount, zfs umount, zfs rollback
• Deduplication, ZFS deduplication
• Storage: Fibre Channel, Disk arrays, Disk array shelves, Disk array controller, CD-ROM, DVD, Tape library, LTO, HDD, SSD, SCSI, iSCSI, SAS, SATA, SEDs, OPAL, Magnetic storage, WORM