1. Mike Resseler
Deduplication in Windows Server
2012 R2
EMEA Microsoft Evangelist
Veeam Software
@MikeResseler

2. Deduplication?
Installation - Config
Architecture
VDI!
Results / Conclusions
More Tips

3. What is Deduplication?

5. In-line versus Post Process
Source versus Target
File-, Block- or Chunk-Based

6. Single Instance Storage
Hard Links
Picture: flickr.com/photos/woolamaloo_gazette/

7. Planning
•
•
•
•
•
Determine target deployments
Hardware requirements
Unsupported Configurations
Evaluate Savings
Policies

8. Great:
{ File share | Virtualization Files | OS deploy files | Backup Files }
Maybe:
{ LOB | Web Servers | HPC |Static content providers }
Poor:
{ Hyper-V hosts | WSUS | SQL / Exchange Servers | Files > 1TB}

9. Installation

10. DDPEval <VolumePath:>
Examples:
C:> DDPEVAL.EXE ServerTestshare
C:> DDPEVAL.EXE E:Test
C:> DDPEVAL.EXE F:
Will produce output similar to the following:
Data Deduplication Savings Evaluation Tool
Copyright 2011-2012 Microsoft Corporation. All Rights Reserved.
Evaluated folder: E:Test
Processed files: 34
Processed files size: 12.03MB
Optimized files size: 4.02MB
Space savings: 8.01MB
Space savings percent: 66
Optimized files size (no compression): 11.47MB
Space savings (no compression): 571.53KB
Space savings percent (no compression): 4
Files with duplication: 2
Files excluded by policy: 20
Files excluded by error: 0

11. Windows Server 2012
1 single CPU – 4GB Ram - SATA

12. GUI Based
Through Server Manager
PowerShell
Import-Module ServerManager
Add-WindowsFeature –name FS-Data-Deduplication
Import-Module Deduplication

13. Video: Enable Dedup

15. Can it be duplicated?
Empty volume?
Resources?
Unsupported Config?

16. 3 Days default (last modified)
Schedule: every hour
Exclusions: edb | jrs
Garbage collection /
data scrubbing on Saterday

17. Video: Enable Volume - GUI

18. Video: Enable Volume - GUI

19. Architecture

20. Filter Driver
Service Based (ddpsvc)
Garbage Collection
Optimization
Scrubbing

22. Jobs
•
•
•
•
Start-DedupJob
Optimization (-type Optimization)
Data Scrubbing (-type Scrubbing)
Garbage Collection (-type GarbageCollection)

23. Video: Start-DedupJob

24. Settings | Policies

25. Settings

26. Decisions

27. PowerShell

28. PowerShell
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Disable-Dedupvolume: Disables further data deduplication activity on one or more volumes
Enable-Dedupvolume: Enables data deduplication on the specified volumes, using default settings
Expand-Dedupfile: Expands an optimized file into its original location
Get-DedupJob: Returns status and information for currently running or queued deduplication jobs
Get-DedupMetadata: Returns a DeduplicationMetadata object for every volume that has data deduplication
metadata
Get-DedupSchedule: Returns the DeduplicationJobSchedule objects defined on the system
Get-DedupStatus: Returns a DeduplicationStatus object for every volume that has data deduplication metadata
Get-DedupVolume: Returns a DeduplicationVolume object for each volume that has data deduplication metadata
New-DedupSchedule: Creates a new data deduplication schedule and returns a DeduplicationSchedule object
Remove-DedupSchedule: Deletes the specified DeduplicationSchedule object
Set-DedupSchedule: Sets data deduplication schedule settings
Set-DedupVolume: Sets data deduplication volume settings
Start-DedupJob: Queues a new data deduplication job of the specified type for the specified volumes
Stop-DedupJob: Cancels one or more specified data deduplication jobs
Update-DedupStatus: Scans one or more specified volumes to compute fresh data deduplication savings information
and returns a DeduplicationStatus object
Get-command –Module
Deduplication

30. Video: PowerShell

31. VDI!

32. Overview

33. Why?
• Space!
• Caching…
• But: Post-processing method! So space needed
first

34. How?
• Enable-DedupVolume
C:ClusterStorageVolume1 –Usagetype HyperV
• Set-DedupVolume C:ClusterStorageVolume1
–OptimizePartialFiles (preview)
• In case of low storage: Start-DedupJob
C:ClusterStorageVolume1 –Type Optimization

35. Conclusions

36. Benefits

37. Picture:
flickr.com/photos/glasgows/

38. Picture:
flickr.com/photos/drmartin/

39. Capacity optimization
Scale & Performance
Reliability & Data integrity
Management w/ Familiar Tools

42. BranchCache
Failover Clusters
DFS Replication
SIS: No!

43. Backups

44. DDPEval <VolumePath:>
Examples:
C:> DDPEVAL.EXE ServerTestshare
C:> DDPEVAL.EXE E:Test
C:> DDPEVAL.EXE F:
Will produce output similar to the following:
Data Deduplication Savings Evaluation Tool
Copyright 2011-2012 Microsoft Corporation. All Rights Reserved.
Evaluated folder: E:Test
Processed files: 34
Processed files size: 12.03MB
Optimized files size: 4.02MB
Space savings: 8.01MB
Space savings percent: 66
Optimized files size (no compression): 11.47MB
Space savings (no compression): 571.53KB
Space savings percent (no compression): 4
Files with duplication: 2
Files excluded by policy: 20
Files excluded by error: 0

45. Please evaluate the session
before you leave
