How to Transform Your Static Data Center into a Dynamic Data Center

November 05, 2008

IT managers have recently been forced by rapidly changing market dynamics and regulations to find ways to lower their static data center's computing costs and resource consumption. Transforming an industry-standard, system-based, static data center into a virtualized, automated, dynamic data center can lower costs and increase efficiency. Through virtualization and automation, Knowledge Center contributor Daniel Kusnetzky explains how you can transform your static data center into a dynamic data center.

Knowledge CenterData centers, especially those based upon industry-standard systems and software, have historically been static environments. That is to say, one consisting of a server configured to support a single operating system, data management system, application framework and a number of applications. Systems then access both storage and the network using a pre-assigned configuration that can only be changed with a carefully planned set of manual procedures.

As the users of mainframes and single-vendor midrange systems discovered nearly three decades ago, this type of static thinking leads to a number of problems and must be replaced by the careful use of virtualization and automation. Although adopting dynamic, adaptive thinking is an important step, it is still important to remember that physical machines (including systems, network and storage), must be running for all of this to work. This is a lesson the managers of industry-standard, system-based data centers are just learning now.

How to avoid overprovisioning

Today’s industry-standard, system-based data centers often evolved without an overarching plan. So, each business unit or department selected systems and software to satisfy only its own requirements. Selections were made to support only that business unit or department’s own flow of business. This means that most data centers have become a warehouse--something a few would call a museum--for “silos of computing.” Each silo of computing was purchased with an eye only to each individual business unit or department’s needs. Each silo was often managed with its own management tools (that may not play well with other tools the organization is relying on for the management of other silos).

Business units and departments purchased sufficient system, software, storage and network resources to handle their own peak periods. Sufficient resources were also purchased to provide enough redundancy so that business solutions were always up and available.

This approach also had an expensive side effect: those resources ended up sitting idle, waiting for peak periods a great deal of the time. If all of the organization’s idle resources are considered, a great deal of the organization’s IT investment has been wasted. After all, they are not available for the day-to-day processing requirements of the organization. It is clear that this approach--an approach that seemed reasonable and prudent only a few years ago--is now a luxury that many organizations can no longer afford. Organizations have been forced by a global market (and rapidly changing market dynamics and regulations) to include efficiency and making best use of their resources in their list of priorities.

How to overcome problematic manual processes

When outages occur in the static data center, many organizations turn to error-prone manual processes and procedures to determine what’s happening. They will isolate the problem, move resources around so that the business can keep running, fix the problem, and then move resources back to their normal configuration. It’s also necessary to get physical machines turned on and loaded with the appropriate software. The network must be restarted or reconfigured. Storage systems must be restarted and reconfigured. Speed of recovery is heavily dependent upon getting the physical systems back up and configured.

Each of these steps can take a great deal of time, require costly expertise that the organization doesn’t normally have on staff, and is subject to human error. Another complication is that each of the computing silos is based upon different application and management frameworks. This means that staff expertise which works well in solving one part of the problem is not the same staff expertise needed to solve other parts of the problem.

It is clear that manual processes don’t scale well. This, of course, is the reason mainframe and midrange-based data centers turned to automation decades ago. Organizations want to work with a dynamic data center that has the ability to deal with planned and unplanned outages--to roll back the clock--without dealing with any of the painful issues mentioned earlier.

Managers of industry-standard, system-based data centers have dreams of moving beyond a static environment. They imagine what it would be like if their data center did the following six things that a dynamic data center does:

1. If it automatically found unused, and therefore wasted, resources on a moment-to-moment basis. Included on this list of unused and wasted resources are systems, software, storage and networks.

2. If it automatically repurposed those resources in a coordinated, policy-based fashion in order to make the most optimal use of them. High-priority tasks would be given resources first.

3. Once repurposed, the data center resources would automatically be assigned to useful tasks.

4. Each workload would be provided with the resources it needed without being able to interfere with or slow down other tasks.

5. Unneeded resources would be freed up so that they could be powered down to reduce power consumption and heat generation if the organization so desired. These resources could be powered back up, provisioned for the tasks at hand and put to work as needed later.

6. New resources would need to be added only when currently available resources were really exhausted.

What’s clear is that everything must adapt in real time, in a coordinated way--otherwise problems are simply being shuffled about rather than being solved.

How to achieve your dreams of a dynamic data center

Over the past few years, virtualization and automation products have become available for industry-standard systems, operating systems and applications. It is now possible for an organization to work with a “logical” or “virtual” view of resources. This logical view is often strikingly different than the actual physical view.

What does this really mean? System users may see a single, physical computer as if it were many different systems running different operating systems and application software. Or they may be presented the view that a group of systems are actually a single computing resource. Other virtualization technology may allow individuals to access computing solutions with devices that didn't exist when developers created an application. It may also present the image that long-obsolete devices are available for use in the virtual environment, even though none are actually installed.

In the end, the appropriate use of these layers of technology offer organizations a number of benefits. These benefits include improved levels of scalability, reliability and performance, far greater agility than possible in a physical environment, and more optimal use of hardware, software and staff resources. This requires IT decision makers to think beyond the server to achieve broader goals.

There have been many successful implementations of this type of virtualization using products from several suppliers. There are products available that act as an operating environment for the whole data center. Resources are discovered automatically and can be automated to meet the organization’s own service level objectives and policies.

IT managers who find themselves forced to grapple with the issues mentioned in this article would be well-advised to learn more about how products of this type could help them meet their objectives, while lowering their overall costs of computing though the deployment of a dynamic data center environment.

Scalable NAS Resources

  • Storage Consolidation Without Performance Compromise

    Given the current state of the economy, storage consolidation is now a high priority for every IT organization. But for IT organizations running performance-sensitive applications, storage consolidation can be a major challenge.

  • Demystifying NAS Clustering

    Data storage needs are on the rise. But beyond simply providing more raw capacity, today¿s storage solutions must also be easy to provision and manage, energy-efficient, and highly scalable in performance and capacity. Download this white paper to learn about HP NAS clustering solutions that help meet today¿s rapidly changing storage requirements.

  • Windows File Server Consolidation: Reference Architecture and Configurations

    Organizations that deploy Microsoft Windows file servers receive many useful services. Traditional file servers, however, lack scalability, so organizations must add file servers as their data storage needs grow. This results in server sprawl, which leads to low utilization of the file servers and sub-optimal availability of storage. Learn how organizations benefit from consolidating their Windows file serving environments using HP Scalable NAS, a highly scalable, manageable and available storage solution.

  • Data Mobility Group TCO Study on ExDS

    Storage administrators are being challenged to manage enterprise data growth and maintain increasing service level commitments while keeping within budgets. This study examines the total cost of ownership of the new HP StorageWorks 9100 Extreme Data Storage System (ExDS9100) and compares it to three competitive approaches. Learn how the HP ExDS9100 is well positioned to deliver massive scalability in both capacity and performance, yet offers considerable cost advantages to meet today¿s storage challenges.

  • Managing Exponential Storage Growth

    In this IT Link podcast hosted by Mike Vizard, Scott Campbell, HP manager of solutions architects, explains why HP is taking a different approach to managing storage using a new XDS architecture specifically designed to handle the requirements of rapidly growing unstructured data storage.

  • Comprehending NAS Clusters

    In this IT Link podcast hosted by Mike Vizard, Efren Molina, PolyServe technical specialist for HP, explains how NAS cluster technology is being used to help customers keep costs in line even as their storage requirements continue to balloon.

  • Coming to Terms with Storage Management

    In this IT Link podcast hosted by Mike Vizard, Logicalis vice president of consulting Eric Linxweiler explains why storage management software is becoming a strategic issue as the amount and types of data that needs to be managed continues to explode.

  • Massively Scalable NAS: Pre-Empting Tomorrow’s Data Overload with Today’s Technology

    NAS has always been simple, unless IT managers wanted to grow their NAS storage significantly. For the first time, storage administrators are thinking in terms of managing petabytes of storage, making massive storage build-outs a necessity. Learn how companies can affordably meet these demands with a simply managed, highly scalable NAS environment.

  • Transparent Business Continuity and Availability through HP Scalable NAS

    This solution brief explores HP’s next generation of Scalable NAS and how it caters to every business continuity need by being highly available and easy to deploy while adding levels of affordable, fault tolerant data protection and availability.

  • Scalable NAS: Insights from customers, analysts and HP

    When IT administrators are looking for networked storage solutions, they often look to NAS because they can use the Ethernet infrastructure they are familiar with to build pools of storage for significantly less money than SAN with equivalent capacity. Unfortunately, traditional NAS doesn't scale and administrators find themselves having to add NAS platforms to keep up with growing storage demands. As a result, many administrators have started looking for alternative solutions.

  • Scalable, Always Available Solution for Digital Media

    Learn how HP's Scalable NAS solution offers central management and administration, scalable capacity and improved utilization, with a lower total cost of ownership (TCO)

  • Create an On-demand Streaming Media Storage Solution with HP Scalable NAS

    Watch this demo and learn how HP's next generation of Scalable NAS is well suited for streaming media serving solutions.

  • Roswell Park Cancer Institute Improves Scalability and Performance with HP Storage Solution

    When Roswell Park Cancer Institute (RPCI) needed to remain on the front line of research and to continue providing high-quality care for patients, they chose a comprehensive HP storage solution and improved storage capacity, performance and scalability.

  • HP Storage Removes Bottlenecks, Consolidates Storage and Increases Revenue for Crest Animation

    When Crest Animation looked to take on an increased workload and handle High Definition and 2K film animations, the company chose a comprehensive HP storage solution that has given the company a unified, highly reliable storage infrastructure.

  • Create a Scalable Infrastructure for Oracle

    Oracle Database and the Oracle E-Business Suite are at the heart of most commercial data centers. HP's Scalable NAS solution Create a scalable infrastructure for Oracle consolidation and file serving.

  • Streaming Media Content Reference Architecture

    The new Web 2.0 business model, where the data is the business, utilizes the Internet to disseminate information in many different ways.

  • Scalable NAS for Oracle Demo

    NAS has been rapidly evolving as a storage alternative for Oracle databases, and for good reason: NAS is often the simplest, most cost-effective storage approach for Oracle.

  • Consolidation for an Optimized Storage Environment

    Windows File Server and Storage Consolidation using HP EVA File Services.

  • Scalable, Fault-Tolerant NAS for Oracle: The Next Generation

    For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason