The Trusted Guide to Marketing Thought Leadership

Data-Driven Management And Transformation


mThink Knowledge's picture

mThink Knowledge - Posted on 05 October 2004

Printer-friendly versionSend to friend
Authored by: 
Courtenay Huff;
Mark Selcow, Merced Systems, Inc.;
John Rusconi, Accenture
PDF File: 
Accenture
Performance management methods in contact centers define and clarify goals, increaseproductivity and improve results.

In the 2003 bestseller Moneyball, author Michael Lewis recounts how Oakland A’s General Manager Billy Beane used data-driven management to reshape a laggard Major League Baseball team into a world-class winner.

“At the bottom of the Oakland experiment was a willingness to rethink baseball: how it is managed, how it is played, who is best suited to play it, and why.”

Two of Beane’s methods stand out. First, instead of focusing on traditional metrics like RBIs, home runs and stolen bases, Beane discovered that winning baseball games was more strongly correlated with lesserknown statistics like on-base average and with his hitters’ ability to refrain from wild swings at the ball under pressure. Second, he focused on elements of the game where success metrics hadn’t been developed in the past due to lack of data – fielding, for example. Beyond tracking fielding errors, a player’s performance was judged qualitatively by coaches and scouts.

Using a new playbook, Beane began to recruit players with high on-base averages, and he began to provide consistent training and performance tracking to focus his players on getting on base and scoring runs. He also trained his organization to track new types of fielding statistics to gain a data advantage in recruiting and player development. Then, critically, he made a full management commitment to get his entire organization aligned around the new metrics and philosophy. By 2003, the A’s were one of the winningest teams – with one of the lowest cost structures – in Major League Baseball.

Shift to today’s contact center. If Billy Beane was managing a customer contact operation, what meaningful measures would he use to guide his team to sustainable advantage? What processes are intuitively managed that could be better run based on statistical facts? Would Beane change his culture and reward his managers to hire, promote, train and field a new team lineup based on these insights?

These questions are being asked by today’s most aggressive contact center leaders, who believe there is much more productivity to be gained in their centers by using performance management concepts. And those who have implemented projects have seen quantifiable results.

Performance Management

Performance management is an oft-heard buzzword in today’s corporate world. Its meaning varies by the industry, function and operating context, but the general concept revolves around a core notion: the systematic use of data throughout the enterprise to define and clarify goals, increase productivity, and improve results. Performance management rests on the premise that there are efficiency and quality gains to be captured by methodically uncovering and leveraging truths that live in existing systems and current stores of data. It’s this sort of data-driven, fact-based performance management that drives behavioral excellence, linking together performance goals with reports, processes and decision making (see Figure 1).

Performance management adoption has grown rapidly in the recent environment of cost reduction, transparency and compliance where access to data and early detection of problems and trends is mandatory. The concept has gained popularity with the increased adoption of methods for process improvement and excellence, such as Six Sigma and lean manufacturing.

The Contact Center

Contact centers are a strong environment for data-driven management: rich in underused data and under-tracked processes, especially compared with functions like finance or manufacturing. Often, data exists but it is costly to access, organize and put in proper context because it lives in dozens of different stores and silos. And often, vital components of the center go undermeasured due to data living in paper or in binders. As a result, many centers favor those management metrics that are the easiest to get to, rather than those that correlate highly with profitability and customer loyalty. Like the Oakland A’s and other baseball teams before Moneyball, many contact centers use timehonored measures but miss the opportunity to truly redefine and improve performance.

Cost reduction is a strong argument for data-driven management in today’s call center. With wide disparities in employee productivity and quality even at the best-managed sites – where top agents often outperform laggards by a 3-to-1 ratio – improvements in performance metrics can fall straight to the bottom line. And the same is true of improvements in the variability of supervisor performance and other roles.

During the last couple of baseball seasons, many teams have begun emulating the A’s methods to transform their organizations to better compete. Given the large financial opportunity for operational savings and customer loyalty impact in the contact center, it’s likely that as performance management proves itself in this environment, the same competitive ripple effect will take place.

Going Deep: ‘Moneyball Metrics’ In The Call Center

There are many opportunities to truly impact contact center performance through deep insight and data-driven management. Here are some uncommon and unobvious metrics that we have found to have a major impact on performance:

  • Coaching frequency – Can be tracked using Web forms and is always highly correlated with subsequent agent performance improvement;
  • AHT (average handle time) or ASA (average speed of answer) variation – Permits superior forecasting and scheduling, which in turn permits smaller shifts, as a result of separating controllable and random variation;
  • Supervisor effectiveness indexes – Comparative impact of coaching, agent improvement under their management and impact of rotating team leaders;
  • Balanced scores – Indexes of agent or team performance with data from multiple data sources, weighted by importance;
  • Bonus calculations – Weighted averages, eligibility rules (such as attendance or quality minimums), dollar payouts; and
  • Metric tracking sessions – Frequency with which supervisors and other managers check and use statistics on their teams to make better, fact-based decisions.

Finding these “moneyball metrics” involves a disciplined process of gathering hard-to-get data, cleansing it, determining dependent variables and their desired business impact, and statistically correlating the base data with dependent variables.

Cultural Impact Of Performance Management

For performance management to work, it is crucial to recognize its cultural impact and take steps to weave the process into the human fabric of the center. Just as Billy Beane worked to align his scouts, players and coaches around the new model, contact center managers must do the same. Specifically, successful contact center performance management:

1. Requires management to implement and enforce the following.

  • Use data consistently, hold people accountable and build your incentive systems around the new model;
  • No more excuses – Everyone knows what they’re accountable for, process of commitment; and
  • Re-examine processes – Hiring, training, quality, and other functional processes can all benefit.

2. Requires a buy-in process.

  • Get people to buy in and use it;
  • Be patient for “ahas” where people reach new levels of understanding. For example, everyone thinks they are above average performers, but when they see where they rank on a team or unit, and managers observe the variation in per-person performance on their teams, behavior will change. Note that this won’t happen until people see and believe the data;
  • Be clear that it’s not big brother. On the contrary, people get excited about owning their own performance and can even start teaching each other how to use it; and
  • Transparency – The more you reveal, the greater the impact on acceptance.

Making Performance Management Work

What does it take to do performance management right in the call center, thereby reaping the full benefits? Like Billy Beane, having a clear vision of what you want to achieve and of the steps for getting there is half the battle. Having the right tools is also critical. Billy Beane’s key analyst used a standard laptop filled with data and analysis to guide Beane’s decision making and management. Like this laptop, performance management software systems help call centers organize their data and align everyone in the organization around facts and a common vision. Often, performance management projects are organized around the implementation of such systems.

Here are some simple rules to maximize results in performance management projects, as well as key phases and components of a successful implementation.

Basic rules for a successful project:

1. Have a simple vision. While you may want to integrate dozens or hundreds of metrics in your performance management system, try to pick and emphasize the key Moneyball metrics that drive your business:

  • Think big, but start small. You can always add metrics, reports and dashboards to the project scope later, but it is critical to find the right business-driving metrics up front.
  • Pick the right software architecture. You want maximum flexibility to change and iterate, so find the right product technology.

2. Build the right data foundation. Collect and integrate the data in your centers from all possible sources (automatic call distribution, interactive voice response, HR, CRM, quality, workforce management, training, etc.) – as multidata-source metrics can be the most powerful:

  • Be sure to include data on the entire business, including employee life cycle information (hiring, training, coaching, incentives, etc.) in addition to productivity and quality data, as Moneyball metrics may lie in these data.
  • Personalize each person’s view so they can see their own data, that of their team, and any other relevant contextual information (rank, percentile, attainment, etc.) that will help motivate behavior change.

3. Capture data that lives in paper and in spreadsheets. Much like the fielding statistics example from Moneyball, information on hiring, training, coaching, surveys, and other key processes can be unleashed if it is included in a centralized data repository.

  • Use Web forms to digitize your paper processes. The best software tools will include forms as part of their workflow modules.
  • Track the completion of forms to build process metrics such as coaching frequency, recognition consistency, and timely delivery of performance appraisals.

4. After rollout, run experiments. It was Beane’s willingness to run more experiments than the competition that led to a winning strategy, and the same is true for contact center performance management. Create new metrics and reports and introduce new incentives and rewards. Even let supervisors set their own goals and create their own development plans.

  • Be sure to pick a system that permits frequent changes to metrics, reports, and dashboards by business users. You shouldn’t have to call the vendor or rely on the IT department to make changes.
  • Enable people to take action based on the information they see, then track what actions corresponded with the best possible result for ongoing process improvement.
  • Ask yourself if your performance management process meets the needs of the individuals it supports, helps you to streamline management processes and improves decision making (see Figure 2).

Summary

Managing a contact center for top productivity and performance is no easy task. But neither is building a baseball team that wins more regular season games than all but one other team – all while having the lowest payroll in baseball.

Performance management, whether in baseball or the contact center, is about thinking about people and tasks in new ways and putting in place the right tools and processes to drive performance toward specific goals. It’s about moving away from casual or intuitive management to management by data and facts.

About the Author
Title: 
Associate Partner
Accenture
Courtenay Huff is an associate partner in Accenture’s Human Performance practice and specializes in developingnew learning approaches, fostering adoption and implementing change.

Sponsors