Value And Benefits Of A Clustered Data Integration Architecture

Posted by Brad Loetz on Sep 13, 2011 11:39 AM


Thinkronization Newsletter - September 2011

This edition of “THINKRONIZATION”, now a Remedi monthly eNewsletter (after a brief hiatus), examines the value and benefits of a clustered architecture as it relates to the design of your integration infrastructure. Depending on your organization and requirements, clustered environments offer distinct advantages over other configurations. We often work in, or configure, clustered integration architecture for our clients. That being said, we also work in, or configure, integration architecture environments using a virtual machine strategy. But the the virtual machine approach is a topic for another edition.

ecommerce-website-integrationInstalling Sterling Integrator Into A Clustered Environment

One out of every three businesses has implemented clustered architecture. Whether application or hardware clustering, this technique provides optimal scalability to handle increases in volume, and well as redundancy for failover duty.

The point of clustering is simple: it’s a synergy thing. You get more processing power. It spreads the load across the system evenly. It increases your up time, with less downtime and failures. It makes maintenance easier. You can use a clustered architecture with a virtual server environment, which means more power with less hardware.

Remedi Electronic Commerce Group recently installed Sterling B2B Integrator in a clustered environment for a client company that manufactures adhesives in the United States with sales globally.

Client Challenge
The client was in a sticky situation...how to install and configure Sterling Integrator (SI) 5.0 in a reliable and cost-effective manner?

Our Solution
Our solution was to install and configure Sterling Integrator 5.0 into a clustered environment. We also implemented a maintenance plan, to ensure the client understood how the system was set up and how to keep it running smoothly.

The Results
The deliverable was the installation, configuration, and documentation of an SI 5.0 clustered (2-node) environment. In addition, we tested for load balancing and failover, the application server(s) were tuned to optimize performance, and the interface adapters were configured and tested.

We developed a system maintenance and monitoring plan to ensure ongoing operational stability. We conducted an environment review and knowledge transfer session to educate client resources on system administration. Outsourcing this project allowed the client’s resources to focus on the implementation and migration phase of the project.
  • Hardware (and OS): Windows 2003
  • Software (and version): Sterling Integrator (GIS) v5.0
  • ERP: SAP

Don’t Put All Of Your IT Eggs In One Basket

In today’s tough economic climate, it is imperative to maximize your IT investment. A clustered environment, also known as server clustering, is a technique to provide scalable processing power.

Simply stated, as your demand grows, you can add to your architecture as needed. Application clustering turns multiple servers into a collective entity, maintaining the same information, sharing tasks and providing load balancing. This configuration increases efficiency, makes business integration more streamlined and powerful while providing redundancy. If one server fails, there is a backup in place, reducing or eliminating downtime while also providing a failover system.

Hardware clustering is another method which requires specialized hardware to be installed in a single server, which controls the entire cluster.

Clustered installations improve reliability, meaning electronic payments, invoices and orders are seamlessly processed with fewer failures. Clustered environments mean volume surges can be easily addressed, as servers can be easily added or removed as needed.

The results are clear. With application clustering, you get more processing power with less hardware. Clustered installations are typically in one location, simplifying maintenance and creating less downtime. Finally, shared loads mean less opportunity for failure.

A virtual server approach is another option, especially for smaller companies who do not require a high level of scalability and redundancy. Virtualization software can divide the resources of one single machine to multiple virtual machines. This consolidated approach takes up less space and helps control software licensing fees in smaller, more static IT environments. By reallocating existing resources and redistributing existing power, you can create more flexible servers, while reducing equipment expenditures and energy costs.

Clustering Resources Provides Optimal Staffing Flexibility

Our recurring theme in this edition focuses on the benefits of clustering. The same ideology is applicable to human resources within IT, as well. Think of the IT team as the clustered architecture. The team needs to be scalable, so personnel and/or expertise can be added or deleted as needed. At times, certain specialized skills are needed. Other times, sudden departures or family leave situations may require temporary failover support. A data integration and EDI services firm, such as Remedi, can serve as the load balancer, helping to increase efficiency, perform specialized tasks and provide redundancy.

There are several approaches to staffing in a clustering mindset, including adding any or all of the nodes outlined below.

Integration Consulting
  • Project based consulting for a particular project with a specific deliverable or outcome, such as an integration software implementation or the development of a specific integration solution.
  • Staff supplementation provides integration specialists to assist with the day-to-day activities. As with most companies, there are just not enough people to get backlogs under control and this option can give you an additional expert to help during those busy times.
Managed Services

Managed services allows clients to maintain control of their strategic integration infrastructure by keeping it in-house, yet lets clients focus on things core to their business by having Remedi maintain the integration infrastructure and orchestrate external/internal integration activities.

Managed services are attractive to those looking to have flexible and nimble staff in difficult economic times, or in times of rapid organizational growth. It also provides benefits in terms of budget management and staff redundancy.

Recruiting & Placement

Recruiting and placement services help clients find candidates and populate integration positions on the team and assists candidates in finding the right full-time integration opportunity. Our knowledge, expertise and tenure in business data integration enables us to thoroughly screen candidates and provide the best list of candidates to clients, and best opportunities to candidates.

Two ways clients hire a candidate include:
  • Full time: There are many experienced integration professionals interested in the right full-time position. We will help identify a short list of qualified candidates for your review, interview and immediate hire.
  • Contract to hire: This “try before you buy” approach will help you determine how the candidate fits within your team and evaluate their management, technical and social skills. These candidates are utilized in a contract capacity until parties agree on a full-time relationship.