1° Sessione - Tecnologie hyperconvergenti e di virtualizzazione storage: VMware vSAN & HCI

53
© 2016 VMware Inc. All rights reserved. VMware Fundamentals VMware Virtual SAN – The Next Generation Enterprise Storage Ing. Christian Faini Solutions Architect | VSAN SME | SAP SME | VMware Italy 22 Novembre 2016

Transcript of 1° Sessione - Tecnologie hyperconvergenti e di virtualizzazione storage: VMware vSAN & HCI

© 2016 VMware Inc. All rights reserved.

VMware FundamentalsVMware Virtual SAN – The Next Generation Enterprise Storage

Ing. Christian FainiSolutions Architect | VSAN SME | SAP SME | VMware Italy

22 Novembre 2016

2

Contents

1 What is HCI and VMware Hyper-Converged Software

2 How VMware Hyper-Converged Software helps your IT

3 Understanding the benefits of VMware Virtual SAN 6.5

4 Additional Resources & Licensing

vRealize Cloud Management

Software-Defined Data Center

VMware Cloud Foundation™

vRealize Cloud Management

VMware Cross-Cloud Services™

VMware vCloud® Air™

VMware vCloud® Air™ Network

4

Hyper-Converged InfrastructurePowered by vSAN

Enabling VMware Cross-Cloud Architecture™

Continuing the Blistering Pace of AdoptionFastest Growth Since ESX

vSAN Customer Adoption

Q1'14 Q2'14 Q3'14 Q4'14 Q1'15 Q2'15 Q3'15 Q4'15 Q1'16 Q2'16

400

Companies in Fortune 1000 (US)

109

Countries have vSAN Presence

Industry Verticals use vSAN

100%

200% YoY bookings growth

5,500+ Customers

6

Hyper-Converged Infrastructure Architecture

HYPER-CONVERGED SOFTWARE

Compute, storage and networking

Tightly integrated software stack

Storage

Virtualization

Management

INDUSTRY-STANDARD HARDWARE

Convergence ofphysical storage on

x86 hardware

Building-blockapproach

7

Industry-Leading Hyper-Converged SoftwareFrom the market leader in virtualization software and management

VMware Hyper-Converged Software

x86 Server Hardware

vSphere

vCenter

Virtual SAN

VMware Hyper-Converged Software

Market-leading hypervisor

Radically simple enterprise-class storage

Most flexible deployment options

Unified management

8

The Best Building Block for the Software-Defined Data Center

NSX: Leading network virtualization platform for the SDDC

vRealize Operations: Advanced storage management and planning

vRealize Log Insight: Real-time log management of Virtual SAN

Horizon: Single platform for virtual and hosted desktops

x86 Server Hardware

vSphere

vCenter

Virtual SANVMw

are

HC

S

SDDC software

Why VMware Hyper-Converged Software?

9

Radically Simple

>100Pre-Certified Ready

Nodes to Match Existing Infrastructure

1Integrated SW stack

<1msLatency with all-flash

systems

>100KIOPS per node

$1/GBAs low as $1 per

usable GB of all-flash Virtual SAN

50%Lower TCO

1Platform for business

critical apps, Openstack and containers

>6M IOPS per cluster

Highest Performance

Lowest Cost

$ Any App,Any Scale

10

What are Customers Powering with VMware HCS?

VMware vSphere + Virtual SAN

End User Computing Test/Dev

ROBOStagingManagementDMZ

BusinessCritical Apps DR / DA

11

Most Widely Deployed HCI Solution in the MarketTo

tal C

usto

mer

Cou

nt

Q2’13 Q2’14 Q2’15

VMware HCS

#2 HCI Vendor**

VMware HCS

#1 >20,000 CPUs in Q4’15Units Deployed*

>3,000 customers>500 new/quarter

Customer Adoption*#1

~200% YoY in Q4’15Revenue Growth*#1

* Source: VMware internal analysis, January 2016. Compared to leading HCI vendors only. ** Source: IDC MarketScape Hyperconverged Market, Dec 2014. SEC S-1 Form, December 2015.

Broadest HCI Deployment Options

12

Choice streamlines VMware Hyper-Converged Software (HCS) deployment

Virtual SAN Ready NodesCertified Solutions

VMware HCSVirtual SAN + vSphere + vCenter

HCI Appliance

VMware HCSVirtual SAN + vSphere + vCenter

VxRail Manager

Partner EcosystemAppliance

COMMONSOFTWARE

STACK

x86 Server Hardware

NEW APPLIANCE

NOWEXPANDED

x86 Server Hardware

VMware Virtual SAN 6.5

13

5th Generation of leading radically simple, enterprise-class storage

14

VMware Virtual SANRadically Simple Hypervisor-Converged Storage for VMs

• Software-defined storage optimized for VMs

• Embedded in the hypervisor

• Runs on any standard x86 server

• Supports hybrid and all-flash configurations

• Delivers enterprise-level scalability and performance

• Managed through per-VM storage policies

• Deeply integrated with the VMware stack

Overview

Virtual SAN Datastore

vSphere + Virtual SAN

VM VM VMVM VM VM

Storage Policy-Based Management:

15

vSphereStorage Policy-Based Mgmt

Virtual SAN

Capacity

PerformanceAvailability

2 Failures to tolerate

Object Space Reservation 10 GB

Flash Read Cache10 %

• Intelligent storage placement at scale

• Dynamic adjustments in real time

• Automated policy enforcement

App-centric Control Plane That Across Storage Tiers

16

Virtual SAN Datastore• Virtual SAN is an object store solution that is presented to vSphere as a file system.

• The object store mounts the volumes from all hosts in a cluster and presents them as a single shared datastore.– Only members of the cluster can access the Virtual SAN datastore– Not all hosts need to contribute storage, but its recommended.

vsanDatastore

caching devicesEach host: 5 disk groups max. Each disk group: 1 SSD + 1 to 7 HDDs/SSDs

VSAN network VSAN network VSAN network VSAN networkVSAN network

caching devices caching devices caching devices caching devices

capacity devices capacity devices capacity devices capacity devices capacity devices

17

Accelerating Innovation

VSAN 5.5March 2014

VSAN 6.0March 2015

All Flash64 Node ClusterX2 Hybrid PerformanceVSAN SnapshotsVSAN ClonesRack Awareness

VSAN 6.2March 2016

VSAN 6.1September 2015

Stretched ClusterReplication - 5 Min RPORoot Cause AnalysisHealth Monitoring

DeduplicationCompressionErasure Coding (RAID 5/6)Quality of Service Performance & Capacity MonitoringExpanded Virtual SAN Ready Nodes

Reduce TCO with iSCSI Support

Deliver vSAN benefits to physical, non-virtualized workloads

Eliminate cost and complexity of separate physical array

Expand to business critical apps using Oracle RAC

Enjoy core vSAN features and policy management in vCenter

vSAN Datastore

iSCSI Target

iSCSI Initiator iSCSI Initiator

Network

Physical Application

SQL with Failover Clusters

Managed through one tool, vCenter

New in

vSAN 6.

5

Save up to 20%* per ROBO – eliminate standard switches between 2-nodesReduced network complexity with reliable, low-cost crossover cables Better compliance with separate vSAN data traffic and witness VM traffic

Savings:2 Node ROBO avg cost: $11-12K USD2 10G switch cost: $2-$3K USDTotal cost savings with cross connect cable approximately 15-20%

* Source: VMware Internal Analysis based on stated pricing.

Central Data Center

Lower ROBO Costs and Complexity with 2-Node Direct Connect

vSAN Datastore

vSAN

WitnessTraffic

witness

New in

vSAN 6.

5

Respond Faster with Cloud Automation

Leverage new cmdlets and REST APIs for faster responsiveness

Build cloud-like automation with full featured PowerCLI

Combine vSAN automation into existing workflows and tools

vSphere and vSAN

vSAN Datastore

New Full-Featured PowerCLI cmdlets

PowerCLIcmdlets

New in

vSAN 6.

5

Support for NVMe for workloads requiring high performanceNEW: 512e drive support to enable larger capacity HDDsLatest networking technologies like 100Gbps

* Source: VMware Internal Analysis based on stated pricing.

Scale to tomorrow with latest hardware innovations

vSphere vSAN

vSAN Datastore

512e

New in

vSAN 6.

5

22

VMware HCS is Radically SimpleOne, integrated software stackOne platform for compute, storage, networkingPolicy-based automation and management

Adobe picked VSAN for the Adobe Marketing Cloud Platform. “Virtual SAN has automation capabilities that allow us to deploy compute resources and storage resources in minutes, not hours or days.”

Case Study

A U.S. Government Agency chose Virtual SAN for building a simple, scalable private cloud environment as well as a Horizon-based desktop virtualization environment.

Case Study

(1) IT Issue: Complexity

23

Two clicks to deploy!

Virtual SAN Simplifies StorageIf You Know vSphere, You Know Virtual SAN

24

Virtual SAN Simplifies and Automates Storage Management Per-VM Storage Service Levels From a Single Self-tuning Datastore

Storage Policy-Based Management

Virtual SAN Shared Datastore

vSphere + Virtual SAN

SLAs

Software Automates Control of Service Levels

No more LUNs/Volumes!

Policies Set Basedon Application Needs

Capacity

Performance

Availability

Per VM Storage Policies

Virtual SAN Seamlessly Integrates with VMware Stack

25

Ideal for VMware Environments

vMotionvSphere HA

DRSStorage vMotion

vSphere

VMware Horizon

Virtual Desktop

vRealize OperationsvRealize Automation

IaaS

Cloud Ops and Automation

Site Recovery Manager

Disaster Recovery

Site A Site B

Storage Policy-Based Management

SnapshotsLinked Clones

vSphere Data ProtectionvSphere Replication

Fault Tolerance

Data Protection

26

Enhanced Virtual SAN Management with New Health ServiceBuilt-in tool designed to deliver troubleshooting and health reports about Virtual SAN subsystems

• Built-in performance monitoring• Health and performance APIs and SDK• Storage capacity reporting• And many more health checks…

Performance & Capacity Monitoring

New in

6.2

• Cluster Health• Network Health• Data Health• Limits Health• Physical Disk Health

Advanced Troubleshooting & Health Reporting

NEW IN VIRTUAL SAN 6.2

28

Lowest Cost HCI solutionsSwitch to server-side economicsTCO savings of 50%Space efficiency with dedupe & compressionAll-flash for as low as $1 per usable GB

Realized CAPEX Savings of 50% along with OPEX savings of 60% per applicationCase Study

“We reduced our storage costs by 60% replacing our traditional storage with Virtual SAN”

Video

(2) Business Issue: Cost

29

Benefit from Server-Side Economics and Smaller Footprint

Traditional Storage

Source: Gartner Competitive Profiles & Vendors/Resellers public website prices *10GbE vs. FC*$/GB refers to disk prices raw GB only

Server Storage

Magnetic Disk (HDDs)

$0.49/GB*

$0.10/GB

Flash (SSDs)

$22.48/GB*

$1.85/GB $364/Port

Networking

$1235/Port

Eliminate fiber-channel networking

Consolidate on smaller footprint

Lower power/cooling/OPEX

Pay less for server-side components

30

Easily Ride the Declining Cost Curve of Storage

2006 2008 2010 2012 2014 2016 2018$0.00

$2.00

$4.00

$6.00

$8.00

$10.00

$12.00

$14.00

Global Storage Cost Trend

$/G

B

• Delay purchases to benefit from rapidly declining prices

• Grow storage along with compute

• Take advantage of new hardware technologies coming to market

31

Slash All-Flash Storage Costs With Space Efficiency Features

Erasure Coding (RAID 5/6)• Predictable 50% to 100% increase in effective storage

capacity while maintaining the same protection levels• Independent of workload and dataset• Single parity protection or double parity protection

(failures to tolerate equal 1 or 2)

Space Efficiency features work together to provide up to 10x reduction in dataset size

Up to 7x storage reduction with deduplication and compression

7x

Increase in usable storage capacity

for FTT=2

100% ORIncrease in usable storage capacity

for FTT=1

50%

* Actual deduplication and compression storage reduction will vary based on workload and configuration.

Deduplication and Compression• Software-based• Minimal (<5%) CPU and memory resource impact

maintains high VM performance• Optimal efficiency: highly granular 4K block size• Continuous benefits as data grows, more VMs added

32

Deduplication and Compression for Space Efficiency• Nearline deduplication and compression per disk group level.

– Will be called “Space Efficiency”

• Space Efficiency enabled on a cluster level• Deduplicated when de-staging from cache tier to capacity tier

– Fixed block length deduplication (4KB Blocks)

• Compressed after deduplication

Beta

esxi-01 esxi-02 esxi-03

vmdk vmdk

vSphere & Virtual SAN

vmdk

All Flash Only

33

RAID-5 Erasure Coding• With “FTT=1” availability RAID-5

– 3+1 (4 host minimum)– 1.33x instead of 2x overhead

• 20GB disk normally takes 40GB, now just ~27GB

RAID-5

ESXi Host

parity

data

data

data

All Flash Only

ESXi Host

data

parity

data

data

ESXi Host

data

data

parity

data

ESXi Host

data

data

data

parity

34

RAID-6 Erasure Coding• With “FTT=2” availability RAID-6

– 4+2 (6 host minimum)– 1.5x instead of 3x overhead

• 20GB disk normally takes 60GB, now just ~30GB

All Flash Only

ESXi Host

parity

data

data

RAID-6

ESXi Host

parity

data

data

ESXi Host

data

parity

data

ESXi Host

data

parity

data

ESXi Host

data

data

parity

ESXi Host

data

data

parity

35

Total Space Efficiency Savings Enable “All-Flash First” Choice

$1/GBAll-Flash for as low as $1 per

usable GB

0

4

8

12

Virtual SAN 6.2 Storage Uti-lization Improvement*

2x

10x

New in

6.2

* Actual deduplication and compression storage reduction will vary based on workload and configuration.

Why Choose All-Flash? Most Cost-Efficient Performance

36

VSAN AF on Dell FC630 (w/

Space Efficency)

$148,618 

$31,960 

$92,688 

$121,696 $23,970 

$19,960 

$86,766 

$14,970 

VSAN Hybrid on Dell 730xd

SWHW

SnS

Virtual SAN Hybrid Virtual SAN All Flash

$1.17

$0.74

Note: Refer to slide notes for environment details

18%

37%

Hybrid vs. All-Flash $/IOPs Comparison

37

$195,000

$34,230

$117,000

$47,940

$38,352

$73,112

$37,112

$21,528

$19,176

$35,984

$11,984

Lowest Cost: All-Flash Virtual SAN vs Competition

Nutanix NX-3160Pro SW License

All-Flash Virtual SAN

HW

SW

Support$68,272

$130,624

• Nutanix price list: http://www.peppm.org/Products_asdf09876/nutanix/price.pdf - street assumed @50%

• Comparable VSAN hardware configuration created on SuperMicro reseller website: www.thinkmate.com– see notes for spec - no discount assumed on top of online provided price

• Nutanix support includes Hardware + Software support, VSAN support is 3yr production SnS only whileHW price includes HW support – 3yr NBD onsite service

-48%

Hybrid HCI Appliance vs. All-Flash Virtual SAN

All-Flash SAN Array

All-Flash Virtual SAN

All-Flash Array vs. All-Flash Virtual SAN

• VSAN HW includes SSDs only, since compute required on both sides

• All Flash array support is estimated at 20% of street for 3-years 24x7

• All Flash street discount estimated at 50%; HW & SW are bundled together shown as HW above

• 2X server workload dedup assumed for VSAN 3x for All Flash Array

• VSAN ADV licenses included

$312,000

$120,522

-60%

New in

6.2

38

Best Performing HCI SolutionKernel-embedded storageUp to 100,000 IOPS per all-flash nodeElastic and linear scalability

“What used to take users 30 to 45 minutes to accomplish, in the old environment, now takes less than 5 minutes. That frees up valuable time for our teachers that they can use to help students.”

Case StudyVideo

“We actually had clinics calling us up to say how much faster the apps were running. It seems like the more applications we migrate to Virtual SAN, the more departments are requesting to be on it.”

Case StudyInfographic

(3) IT Issue: Performance

39

Efficiency of a Single, Hyper-Converged Software Stack

StorageVM

vSphere vSphere + Virtual SAN

One in every server

Kernel-embedded for optimized I/O data path

Major advantage in resource utilization• 2x CPU efficiency and 3x memory efficiency

All features work natively• Native vMotion and DRS

✖ Overhead of virtual appliance

✖ Long data paths

✖ Bolted-on integration

40

Tiered All-Flash and Hybrid Options

Caching

DataPersistenceVirtual SAN

All-Flash

100K IOPS per Host+

sub-millisecond latency

Writes cached first,Reads from capacity tier

Capacity TierFlash Devices

Reads primarily from capacity tier

SSD PCIe NVMe

Hybrid

40K IOPS per Host

Read and Write Cache

Capacity TierSAS / NL-SAS / SATA

SSD PCIe NVMe

Over 6M IOPS with Elastic and Linear Scalability

41

4 8 16 32 64

160K320K

640K

1280K

2560K

400K800K

1600K

3200K

6400KVSAN Hybrid VSAN All-Flash

Number of Hosts In Virtual SAN Cluster

IOPS

Notes: based on IOMeter 70/30 Read/Write benchmark

6M+ IOPS in 64 Node Cluster

42

Performance of Virtual SAN from StorageReview.com

• Comparable 4-node hardware configurations were tested

• Virtual SAN config was priced at less than half of the competitive system

• VMmark, an accepted industry test, measured how many workloads the clusters could handle– A “tile” is a standardized workload

Big differences in performance and consolidation ratios

Series1

0 2 4 6 8 10 12 14 16 18 20

#2 CompetitorVSAN

Nutanix could notcomplete 10 tiles

Virtual SAN completed 18 tiles, resources to spare

80%more work at half the

price

Source: StorageReview.comhttp://www.storagereview.com/why_we_don_t_have_a_nutanix_nx8150_review http://www.storagereview.com/vmware_virtual_san_review_vmmark_performance

43

HCI for Any App, Any ScaleGranular scale up and outBuilt for business critical applications Designing for the future of cloud-native apps ““In the past, we had no

ability to add storage or scale to meet our growing needs. Today with Virtual SAN, I can add more disk on the fly without even thinking about it, and memory upgrades have become a breeze.”

Case Study

“In VSAN, I simply add drives into a chassis anywhere in my system. If I need more space, I buy a simple chassis, and continue to add drives. Much more scalable. There really is not limit to it.” Video Review

(4) IT Issue: Scale/Growth

Scale UPAdd more Disks

IOPSCapacity

10 TB

100 TB

8.8 PB

Scale OUT

Add more nodes

Elastic Grow or shrink on demand

Granular Add single nodes or disks

Non-disruptive No app downtime

Virtual SAN Enables Elastic Scaling of Performance and CapacityNo More Complex Forecasting & Large Upfront Investments

44

45

Virtual SAN – Enterprise AvailabilityToday

vSphere & Virtual SAN

• Set “failures to tolerate” for high availability

• Virtual SAN provides rack awareness– Allowing for full rack failures through

smart placement mechanism

• Easily add a second site to stretch your Virtual SAN cluster between sites– Deliver zero-minute RPO

• Maximize protection by replicating to a third site with or without Site Recovery ManagerRack 1 Rack 2 Rack 3 Rack 4

witness

5ms RTT, 10GbE

vSphere & Virtual SAN

vmdk vmdk witness

vSphere & VSAN

Site Recovery Manager

46

Virtual SAN Stretched Cluster with vSphere Replication and SRM

– Live migrations and automated HA restarts between stretched cluster sites– Replication between Virtual SAN datastores enables RPOs as low as 5 minute– 5 minutes RPO is exclusively available to Virtual SAN 6.x– Lower RPO’s are achievable due to Virtual SAN’s efficient vsanSparse snapshot mechanism– SRM does not support standalone Virtual SAN with one vCenter Server

Any distance >5 min RPOsite a

vSphere + Virtual SAN Stretched Cluster

< 5 ms RTT over >10/20/40 gbpsActive Active

site b

<=200 ms RTT over 100 mbps

L3 no multicast<=200 ms RTT over 100 mbps

L3 no multicast

L2 with Multicast

site x

vSphere + Virtual SAN

VR

DR

vCenter

vCenter

witnessappliance

SRM

SRM

47

Performance, Scale and Availability for Any ApplicationNew

in

6.2

E X PA N D E D B U S I N E S S - C R I T I C A L A P P L I C AT I O N S S U P P O R T

SAP Core Ready

SAP HANA Enabled

Tested and validated deployments

SAP

Data locality specific for VDI

Bundles Virtual SAN licenses for lowestcost VDI storage

Horizon

Oracle RAC Ready

Tested and validated deployments

Reference architecture papers

Oracle

Technology Direction

September 2016

Extend vSAN to Containers and CNA

Photon Controller

Cluster Managers

vSphere• Works off-the-shelf with

Docker, Swarm, Kubernetes, …• Persistent Docker Volume

Driver

vSphere Integrated Containers• Docker API Compatibility• Persistent Volume Driver• VM-like container isolation

Photon Platform• vSAN proven storage services

available with Photon• 100% API managed vSAN• Designed for DevOps

VM

vCenter Server

Primary Cluster

Photon vSAN for Photon

Primary Cluster

vSphere vSAN 6.5

VIC

c

new

Storage policies

VM / VMDK policy profile

Policy Gold

Availability

Capacity reservation

IOPS Limits

Value

FTT = 2

40G

1000

Automated VM-level placement and provisioning on both vSAN and traditional storage

Single-click policy changes to control data services, like QoS, at the VM or VMDK level

Simple, scalable automation platform

The Only Policy Framework that Spans HCI to Traditional Storage

Policy

Space efficientvSAN 6.5 VVols 2.0

vSphere

x86 Servers SAN/NAS

vSAN Packaging

53

vSAN 6.5 Packaging SummaryvSAN STD

vSAN ADV

vSANENT

FeaturesStorage policy-based management

Read / Write SSD Caching

Distributed RAID

Virtual Distributed Switch

vSAN Snapshots & Clones

Rack Awareness

Replication (5 min RPO)

Software Checksum

All-Flash Hardware

iSCSI Access

Deduplication & Compression (All Flash only)

Erasure Coding (All Flash only)

Stretched Cluster

QoS – IOPS Limits

New feature in vSAN 6.5Existing feature in vSAN 6.2

vSAN for ROBO• 25-VM Pack of

vSAN STD• One per site max• Supports all-flash HW

NEW: vSAN ADV for ROBO• 25-VM Pack of

vSAN ADV• One per site max

Additional Resources

55

http://www.vmware.com/products/virtual-san/

http://vmware.com/go/vsanlab

https://blogs.vmware.com/virtualblocks/

[email protected]