Cisco - Update on Server Load Balancing

Citation preview

1301 0953_05F9_c2

1

© 1999, Cisco Systems, Inc.

Update on Server Load Balancing Session 1301

1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

2

1

Agenda • Overview of Load Balancing • Load Balancing Algorithm • Application Aware • Global Load Balancing • Network Director

1301 0953_05F9_c2

3

© 1999, Cisco Systems, Inc.

Always Remember

Cisco Provides Proven Reliable Load Balancing Solutions 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

4

2

Response Time (Seconds)

Load Balancing Algorithm Effects

1.2 1 0.8

Network Bandwidth: 1.56 Mb/sec. (T1) Server Speed: 6Mb/sec. Average File Size: 5K Maximum Capacity (3 million hits)

0.6 Maximum Capacity of Server

0.4 0.2 1000000

2000000

3000000

Arrival Rate 1301 0953_05F9_c2

5

© 1999, Cisco Systems, Inc.

LocalDirector www.cisco.com Virtual IP

User

Internet or Intranet

Router

Switch LocalDirector

• Dynamically balances traffic across multiple physical servers • Works for all TCP services (FTP, HTTP, news) • Requires no server software • Transparent to end users 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

6

3

Local Load Balancing Benefits LocalDirector LocalDirector Switch

• High availability • Scalability • Server management 1301 0953_05F9_c2

7

© 1999, Cisco Systems, Inc.

High-Availability Solution For Mission Critical Applications Router

Users

Switch

LocalDirector

Switch

Internet/ Intranet

• No single point of failure • Ideal for mission-critical application • Identifies failed servers and applications and redirects around them 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

8

4

Performance and Scalability 60 60

70 70

50 50

Productivity

Access

.5 .5

Meg Meg

80 80 90 90

Per/Sec Per/Sec

Proven Success in High Traffic Internet Sites

Growth Commerce

Workgroup

• Over 240 Mbps throughput Mission Critical

1301 0953_05F9_c2

• 20,000 connections per second

© 1999, Cisco Systems, Inc.

9

Server Connection Management • • • • • • • 1301 0953_05F9_c2

Easily place servers in and out of service Graceful shutdown Application-specific servers Maximum connections Hot-standby server Load balanced based on source IP Restrict based on service or IP address

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

10

5

Specifications LD 416 • 80 mbps throughput • 300 MHz

• 240 mbps throughput with Fast EtherChannel® • 450 MHz

• 32 MB RAM • 3 10/100 interfaces • 7000 connections per second

1301 0953_05F9_c2

LD 430

• 384 MB RAM • 4 10/100 • 18,000 connections per second

11

© 1999, Cisco Systems, Inc.

DistributedDirector EMEA Web Site US Web Site

DRP

ASIA Web Site DRP

DRP DistributedDirectors

• Optimize global server deployment • “Regionalize” content 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

12

6

DistributedDirector Benefits

• Redundant data center is ultimate in reliability • Enables global scalability of intranet and internet services

1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

13

What Is DistributedDirector? • Two pieces: Standalone software/hardware bundle Special Cisco IOS ®-based software on Cisco 2501, 2502, and Cisco 4700M hardware platforms—11.1IA release train Cisco IOS software release 11.3(2)T and later on DRP-associated routers in field

• DD is not a router! • Dedicated box for DD processing 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

14

7

Network Director • Next generation server load balancing • Unprecedented high availability Eliminate single points of failure

• Unprecedented scalability Allow immediate incremental or large scale expansion of application servers

• New dynamic server feedback Balance load according to actual application availability and server workload 1301 0953_05F9_c2

15

© 1999, Cisco Systems, Inc.

Network Director—What Is it? • Hardware and software solution that distributes IP traffic across server farms • Cisco IOS router

Network Director

• Implements the Cisco MultiNode load balancing architecture • Implements the Cisco dynamic feedback protocol for balancing decisions 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

16

8

Network Director—Features • Defines single system image or “virtual address” for IP applications on multiple servers

Network Director

• Load balances across multiple servers • All the features of LocalDirector 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

17

Network Director Architectures

• MultiNode load balancing architecture Defines communication between NDSM and FAs Separates load-balancing decision from session-traffic path Enables distribution of load-balancing function among multiple switches and routers Enables high availability and high performance 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

18

9

Components ND Services Manager • Software runs on LocalDirector • Makes load balancing decisions • Uses MultiNode load balancing to instruct FAs of correct server destination • Uses server feedback protocol to maintain server capacity and application availability information

Backup Services Manager

ND Services Manager

Backup Services Manager • Enables 100% availability for ND services manager • No sessions lost due to primaryservices manager failure 1301 0953_05F9_c2

19

© 1999, Cisco Systems, Inc.

Components Forwarding Agent • • • • •

Cisco IOS router and switch software Uses MultiNode load balancing to communicate with NDSM Sends connection requests to NDSM Receives server destination from NDSM Forwards data to chosen server

Workload Agents

Workload Agents • • • • •

Forwarding Agent Runs on either server platforms or management consoles Maintains information on server work capacity and application availability Communicates with NDSM using server Feedback protocol For IBM OS/390 systems delivers work load manager data

1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

20

10

Architectures MultiNode Load Balancing Architecture • Communication protocol between the NDSM and FAs • Distributes load balancing between multiple routers and switches

DFP

MNLB

• Separates load-balancing decision from packet forwarding

1301 0953_05F9_c2

21

© 1999, Cisco Systems, Inc.

How Does ND Work? Initialization

Workload Agents

• NDSM locates Forwarding Agents • NDSM instructs each FA to send session requests for defined Forwarding Agent virtuals to NDSM

ND Services Manager

• NDSM locates WLAs and receives server operating and application information Client 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

22

11

How Does ND Work? Session Packet Flow 1. Client transmits connection request to virtual address 2. FA transmits packet to NDSM NDSM selects appropriate destination and tells FA

3 2

3. FA forwards packet to destination 4. Session data flows through any FA router

1

4

NDSM is also notified on session termination Client 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

23

Network Director: The Next Generation • Unprecedented high availability Eliminate single points of failure

• Unprecedented scalability Allow immediate incremental or large scale expansion of application servers

• New dynamic server feedback Balance load according to actual application availability and server workload 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

24

12

Application Aware Load Balancing

• Analyze TCP handshake • Web probing systems • Dynamic feedback protocol

1301 0953_05F9_c2

25

© 1999, Cisco Systems, Inc.

LUI 3.1: Server and Application Probes

Mirrored Servers

Web Application Probes LUI 3.1 Solaris 2.x/ NT 4.0 1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

26

13

Partnership With Hewlett Packard

Dynamic Feedback from Application To Network Infrastructure

Hewlett Packard Web Qos Recognizes 100% if Application & Database Connectivity is unavailable.

1301 0953_05F9_c2

27

© 1999, Cisco Systems, Inc.

Summary

• LD, DD and ND • Application aware • MultiNode architecture • Cisco load balancing solution are proven reliable

1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

28

14

Please Complete Your Evaluation Form Session 1301

1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

29

1301 0953_05F9_c2

© 1999, Cisco Systems, Inc.

30

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

15