Some things never change, or do they? vSphere is getting new and improved features with every release. These features change the characteristics and performance of the virtual machines. If you are not up to speed, you will probably manage your environment based on old and inaccurate information. The Mythbusting team has collected a series of interesting hot topics that we have seen widely discussed in virtualization communities, on blogs and on Twitter. We’ve put these topics to the test in our lab to determine if they are a myth or not.
2. Why We Need To Bust Some Myths
• vSphere evolves
• Old beliefs are no longer true
• Keep current on the latest virtualization news
and best practices with…
2
#VSVC5353 Mythbusting Goes Virtual
3. The Myths
1.
Snapshots have no performance impact
2.
Distributed vSwitch offers better performance than standard vSwitch
3.
VAAI enabled arrays can run unlimited number of VMs per LUN
4.
iSCSI offers better performance than NFS
5.
Reservations always increase performance
6.
Multiple vCPUs are always better than single
3
#VSVC5353 Mythbusting Goes Virtual
5. What is a Snapshot?
• Preserves state and data of a VM at a specific point in time
• Data includes virtual disks, settings and memory (optionally)
• Allows you to revert to a previous state
• Typically used when doing changes and by backup software
• ESX 3, ESX(i) 4 had issues with deleting snapshots
• ESXi 5 improved snapshot consolidation
5
#VSVC5353 Mythbusting Goes Virtual
6. Snapshot File Types
File
Description
.vmdk
Original virtual disk
delta.vmdk
Snapshot delta disk
.vmsd
DB file with relations
between snapshots
.vmsn
Memory file
• Snapshot grows in 16MB chunks
– Requires locking
6
#VSVC5353 Mythbusting Goes Virtual
7. Locks – Prior to ESXi 4.1
• Locks are necessary when creating, deleting and growing snapshots,
power on/off, create VMDK and vMotion
• Used SCSI-2 reservation
– Locks entire LUN
7
#VSVC5353 Mythbusting Goes Virtual
8. Locks – ESXi 5
• Uses Atomic Test & Set (ATS / hardware assisted locking) VAAI primitive
– Locks only individual VM
– Requires vSphere Enterprise, VAAI enabled array and VMFS-5
8
#VSVC5353 Mythbusting Goes Virtual
9. Performance
• Locking
– ATS increase performance up to 70% compared to SCSI-2
reservation
• Normal operations
– Number of snapshots
– Snapshot age
– Snapshot size
• Be careful with snapshots in production
9
#VSVC5353 Mythbusting Goes Virtual
10. Myth: Snapshots have no performance
impact
• Improvements to snapshots management and locking
• Snapshots still have impact on performance
10
#VSVC5353 Mythbusting Goes Virtual
14. vDS Benefits
• Central control of virtual switch port
configuration, portgroup naming, etc
• Link Aggregation Control Protocol
(LACP)
• Health check, rollback/recovery
• RSPAN/ERSPAN
• NIOC, PVLAN, bi-directional traffic
shaping, network vMotion
• SR-IOV support
14
#VSVC5353 Mythbusting Goes Virtual
15. Putting It To The Test
• Create two VMs on two hosts
– Using vSS and vDS
• Perform network data transfers using VM,
connected through vSS then through the vDS
• Compare the results
15
#VSVC5353 Mythbusting Goes Virtual
16. Test Results
• Surprisingly, test results showed that data transfer times were
roughly 100Mbps FASTER when using vSS
16
#VSVC5353 Mythbusting Goes Virtual
17. Myth: Distributed vSwitch offers better
performance than standard vSwitch
• vDS and VSS offer similar performance
• vDS offers many more capabilities and much greater management
efficiency
17
#VSVC5353 Mythbusting Goes Virtual
19. VAAI Summary and Configuration
Maximums
• Hardware assisted locking can increase performance up to 70%
compared to SCSI-2 reservation
• Requires vSphere Enterprise, VAAI enabled array and VMFS-5
Configuration Maximums
• LUN Size: 64 TB
• VMs per Host : 512
• LUNs per Host (FC & iSCSI): 256
• NFS Mounts per Host: 256
• Powered On VMs per VMFS datastore: 2048
19
#VSVC5353 Mythbusting Goes Virtual
20. Putting It To The Test
• 2 ESXi hosts, vSphere 5.1, 32 VMs, IOmeter
• Case 1: 8*8 TB datastores without VAAI
• Case 2: 1*64TB datastore with VAAI
20
#VSVC5353 Mythbusting Goes Virtual
22. Considerations for Datastore Consolidation
• Default 1 path per LUN
• Check if MPIO is supported
• LUN Queue Depth
• Disk.SchedNumReqOutstanding (DSNRO)
• All eggs in one basket – DR
22
#VSVC5353 Mythbusting Goes Virtual
23. Myth: VAAI enabled arrays can run
unlimited number of VMs per LUN
• Hardware assisted locking helps reducing locking and latency
• Increases VMs per LUN to a certain degree but not unlimited
• Carefully look at other components end-to-end to maximize
performance and density
23
#VSVC5353 Mythbusting Goes Virtual
25. iSCSI vs. NFS Features And Functions
• iSCSI = block based
• iSCSI = SAN
• Multipath included
• Hardware iSCSI is an option
• Both use Ethernet network and
offer jumbo frames
25
• NFS = file based
• NFS = NAS
• No built in HA or load
balancing (relies on network)
• Easier to configure
• More readily available
• Shared filesystem
#VSVC5353 Mythbusting Goes Virtual
26. Putting It To The Test
• Create 2 datastores, 1 NFS, 1 iSCSI (software)
• Both datastores are connected to the same
shared storage
• Create a single VM on a host that has
connections to both datastores
• With the VM on the iSCSI datastore, perform IO
tests
• svMotion the VM to the NFS datastore, and
perform IO tests
• Compare the results
26
#VSVC5353 Mythbusting Goes Virtual
27. Test Results
iSCSI vs. NFS Test Results from Jason Boche’s Lab
1600
1400
1200
1000
800
iSCSI (SW)
NFS
600
400
200
0
1
27
2
3
4
5
Notes:
Tests are a composite
score based on seq
read, seq, write, and
random seek + rw for a
period of 5 minutes
each
#VSVC5353 Mythbusting Goes Virtual
28. Myth: iSCSI offers better performance than
NFS (for virtualization)
• Both NFS and iSCSI are solid options for
vSphere storage
• Ensure you are knowledgeable of the
pros and cons offered by each to make
the right choice for your company
28
#VSVC5353 Mythbusting Goes Virtual
30. Reservations
• Specifies the guaranteed
minimum allocation for a
specified resource
• Insurance that resources are
available
• Default is 0 (no reservation)
30
#VSVC5353 Mythbusting Goes Virtual
31. Memory Reservation
• VM with memory reservation that hasn´t accessed its full memory
can be used by other VMs
– Different OS handles memory differently
• After VM has accessed its full reservation, the memory can´t be used
by other VMs, even if the VM isn´t using it
• Memory is wasted
31
#VSVC5353 Mythbusting Goes Virtual
32. CPU Reservation
• VM with CPU reservation of 5 GHz that is idle
• Other VMs cannot reserve these 5 GHz but they can use it
• CPU is not wasted
32
#VSVC5353 Mythbusting Goes Virtual
33. Reservations Pros and Cons
Pros
• Can improve performance when host is overcommitted
• Can improve performance even when host isn't overcommitted
Cons
• Can affect performance for other VMs
• Can affect admission control
– Host
– High Availability
– Distributed Resource Scheduler
• Can reduce VM density
33
#VSVC5353 Mythbusting Goes Virtual
34.
35. Myth: Reservations always increase
performance
• Reservations don´t always provide better performance
• Insurance if host is overcommitted
• Can increase performance for Java workloads
• Use reservations for business critical applications only with caution
35
#VSVC5353 Mythbusting Goes Virtual
39. Putting It To The Test
• Create 1 VM with 1 vCPU
• Run single and multi-threaded CPU tests
• Power off the VM and add multiple vCPUs
• Re-run single and multi-threaded CPU tests
• Compare the results
39
#VSVC5353 Mythbusting Goes Virtual
40. Test Results
numbers are in millions of I/Os per second
1vCPU
4vCPU
Multi threaded app
Single threaded app
0
40
1000
2000
3000
4000
5000
6000
7000
#VSVC5353 Mythbusting Goes Virtual
41. Myth: Multiple vCPUs are always better than
single
• Tests show that multiple vCPUs give a massive performs boost IF you
have an application that can take advantage of it
• A single threaded app just needs one vCPU
• KNOW YOUR APP
41
#VSVC5353 Mythbusting Goes Virtual
42. Summary
1.
Snapshots can have performance impact
2.
Distributed vSwitch and Standard vSwitch offer similar
performance
3.
VAAI enabled arrays increase VM density per LUN
4.
iSCSI and NFS offer similar performance
5.
Reservations can increase performance
6.
Multiple vCPUs are better for multithreaded applications
42
#VSVC5353 Mythbusting Goes Virtual
43. Thank you for your
participation
Join the conversation…
More conversations on line
Michele Ballinger
@ballingertweets
Visit us on the Web:
www.software.dell.com
Learn More on Foglight
http://www.quest.com/performancemonitoring/foglight-forvirtualization.aspx
Foglight on Facebook
facebook.com/Foglight
Foglight for Virtualization on Twitter
@DellVirt
The Foglight for Virtualization Community
http://communities.quest.com/community/
vfoglight
43
Performance Monitoring