RSS

Tag Archives: diversity and inclusion

CEOs Want to Know the Impact of Diversity ROI on Initiatives but Aren’t Getting It!

A study of CEOs analyzing what CEOs want from their Diversity organizations concluded that CEOs want to see the impact and ROI of their Diversity investments but instead receive only activity and satisfaction data. So, why aren’t Diversity & Inclusion Executives, Managers, Practitioners, etc. measuring their impact and sharing with their CEOs? After all, this is not exactly a revelation. Some of the leading reasons are lack of resources, lack of support from the CEO, lack of funding, lack of skills, etc. My take: these are all just excuses since there are a huge number of resources, books, workshops, etc., available. This strongly suggests that many Diversity Practitioners need a serious skill update or should excuse themselves out of the job. If they remain without these skills, at some point, they may face elimination and/or extinction.

This is the 21st Century, with its emphasis on cutting edge as well as “State of the Practice” technological and analytical advances, yet Diversity Practitioners are using old-fashion measurement skills where the wheels immediately come off of their measurement system wagons. We haven’t been in the “Old West” of Diversity measurement for quite a few decades. State of the Art Diversity ROI processes have been here for quite some time.

Accountability Trends

Many enlightened business managers often take a professional business approach to Diversity, with ROI being part of the strategy. Top executives who watched their diversity budgets continue to grow without appropriate accountability measures have become frustrated with this approach. In an attempt to respond to the situation, they have turned to Diversity Return on Investment (DROI®). Top executives are now demanding DROI® calculations from Diversity departments where they were not required previously.

So, what factors prevent us from mastering Diversity ROI measurement? Here are a few excuses I hear that Diversity Practitioners say are consistently challenging and “Small Doses” to begin to address them:

Assorted Medicine Pills in Caps

Small Doses to Bust Up Measurement Myths and Misconceptions

Issue-1: Lack of Skills and Orientation
Many Diversity staff members neither understand ROI nor do they have the basic skills necessary to apply the process within their scope of responsibilities. Diversity ROI Measurement and evaluation is not usually part of the preparation for the Diversity job or taught as part of a university education focused on diversity. Also, the typical Diversity training program or intervention does not focus on results, but more on diversity awareness concepts, activities, or other issues. Staff members attempt to measure results by measuring learning only instead of the full range of Diversity performance intervention outcomes (at all 7 levels) that drive business. Consequently, this is a tremendous barrier to implementation that must be changed such that the overall orientation, attitude, and skills of the Diversity staff member are focused on business results, impact, and/or outcomes.

Small Dose-1: Build DROI® Skills and Measurement Orientation
Don’t wait until you are asked about the DROI® of your Diversity intervention to gain competency and business acumen in this area, start learning about DROI® today! Attend a Diversity ROI Webinar, Workshop, Read books on Diversity ROI, Use DROI® Tools, etc. (Note: DROI® is a registered trademark of Hubbard & Hubbard, Inc., All Rights Reserved.)

Issue-2: Faulty Needs Assessment
Many existing Diversity interventions are not based on an adequate needs assessment. Some diversity interventions have been implemented for the wrong reasons based on requests to chase a popular fad or trend in the industry. Even worse, they schedule training for everyone in the organization costing thousands or millions of dollars with NO measurable DROI®. If the intervention is not needed, the benefits from the program will be minimal or wasted. A DROI® calculation for an unnecessary program will likely yield a negative value. This barrier can be eliminated by training and certifying Diversity Executives and Practitioner in programs such as Diversity ROI Certification, training and measurement workshops, etc.

Tools and Templates 4

Remember: “If there is no verified need you cannot calculate Diversity ROI Impact”

Small Dose-2: Learn the Detailed Steps to Conduct a Comprehensive Needs Assessment
Needs analysis is the cornerstone of any Diversity performance analysis effort. It provides you with appropriate justification for either developing or not developing your Diversity intervention. You must conduct a needs analysis, no matter how abbreviated, before any Diversity intervention takes place.
The objectives of a needs analysis are to:

  • Describe the target population
  • Describe the exact nature of a performance discrepancy (Ideal versus Actual Performance)
  • Determine the cause(s) of the discrepancy
  • Recommend the appropriate solution(s)

Issue-3: FEAR
Some Diversity departments do not pursue DROI® measurement implementation due to fear of failure or fear of the unknown. Fear of failure appears in many ways. Designers, developers, facilitators, and program owners may be concerned about the consequences of a negative DROI®. They fear that the DROI® measurement process will be a performance evaluation tool instead of a process improvement tool. Also, the DROI® process will stir up the traditional fear of change. This fear is often based on unrealistic assumptions and a lack of knowledge of the process.

Small Dose-3: Overcome FEAR by Taking Action
The best way to overcome FEAR is by (a) taking action, (b) generating results, (c) evaluating the outcome, and (d) implementing improvements. FEAR is often based on a lack of knowledge so the antidote is to “learn” and “master” the DROI® skills and processes.

Issue-4: Discipline and Planning
A successful DROI® evaluation implementation requires much planning and a disciplined approach to keep the process on track. Implementation schedules, evaluation targets, DROI® analysis plans, measurement and evaluation policies, and follow-up schedules are required. The Diversity Change Management team may not have enough discipline and determination to stay on course. This becomes a barrier, particularly if there are no immediate pressures to measure the return. If the current senior management group is not requiring a DROI® evaluation, the Diversity Change Management team may not allocate time for planning and coordination. Also, other pressures and priorities often eat into the time necessary for an effective DROI® evaluation implementation. Only carefully planned implementation efforts succeed.

Linkage Graphic using Puzzle Piece

Develop Strategic Capabilities and Follow-thru

Small Dose-4: Build DROI® Discipline and Planning Focus
There is really no substitute for implementing a thorough approach to a DROI® evaluation process. The practice of Diversity ROI evaluation should be an “industry standard of professionalism and competence” in the Diversity and Inclusion field and discipline. To do otherwise sets us apart from other professional discipline such as Marketing, Sales, Operations, etc. that require standard metrics and analyses to determine their effectiveness and impact. Diversity ROI impact analysis must be implemented using effective project planning and management skills as well as following the DROI® methodology according to each step in its design.

Issue-5: False Assumptions
Many Diversity staff members have false assumptions about the DROI® process that keep them from attempting DROI®. Typical assumptions include: (a) The impact of intervention cannot be accurately calculated, (b) Operating managers do not want to see the results of Diversity expressed in monetary values. They won’t believe it, (c) If the CEO does not ask for the DROI®, he or she is not expecting it, (d) CDO denial – “I have a professional, competent staff. Therefore, I do not have to justify the effectiveness of our programs”, (e) Learning or this type of intervention is a complex but necessary activity. Therefore, it should not be subjected to an accountability process, etc. These false assumptions form perceptible barriers that impede the progress of a DROI® evaluation implementation.

Performance Measurement

Use Evidence-based Data for Credibility

Small Dose-5: Eliminate Any False Assumptions
Credible processes rooted in strategic performance-based sciences to calculate Diversity ROI have been in existence for over 30 years. Yet, Diversity practitioners have been slow to enroll and learn what it takes to be fully competent and capable in this scientific discipline. Let’s face it; the DROI® evaluation process and its associated analytics are here to stay. It’s only realistic that Diversity practitioners eliminate any false assumptions, wishful thinking and/or outdated measurement paradigms that prevent them from being effective. In the future, there is likely to be even more demands for DROI® analysis feedback, demonstrated credibility and intervention performance value that tie to the organization’s bottom line.

Dr H Book Tower Graphic for Proposals

Sample Diversity ROI Resources by Dr. Hubbard

Using these processes has the added benefit of improving the effectiveness of all Diversity interventions we conduct. Only those Diversity Practitioners who can operate as full strategic business partners will have what’s needed to survive for the long term. Do You Have What It Takes To “Survive”, “Thrive”, and “Drive” Real Business Performance using  Diversity & Inclusion? The next move is yours!

Dr. Edward E. Hubbard is President & CEO of Hubbard & Hubbard, Inc. and is recognized as the pioneer and founder of the Diversity Measurement and Diversity Analytics fields. He is the author of over 40 plus books including the ground-breaking “Measuring Diversity Results”, “How to Calculate Diversity Return on Investment”, “The Diversity Scorecard: Evaluating Diversity’s Impact on Organizational Performance”, “Diversity Training ROI”, “The Executive’s Pocket Coach to Diversity and Inclusion Management”, “Measuring the ROI Impact of ERGs and BRGs”, “The Diversity Discipline”, “The Hidden Side of Employee Resistance to Change”, and many more. Dr. Hubbard is available Keynote presentations, Strategic Diversity and ROI Consulting, Training, etc. He can be reached at edhub@aol.com.

Advertisements
 

Tags: , , , , , , , , , , , ,

The Power of Diversity ROI Measurement Alignment : Part 2

In part one; I discussed four of nine steps to improve the alignment of diversity metrics with the bottom line of the business. In this segment (Part 2), I will outline the remaining steps of the methodology which cover a wide range of actions and metrics to build practical approaches to verify the strategic business needs of the organization.

Let’s continue examining the remaining alignment steps…

Step 5: Develop Interventions that are Practical, How-To Approaches

A lot of organizations will say they have diversity measures in place. However, when you actually check them, you see that they are activity counts. They’ll look around and say they’ve established a council or have had a particular celebration on a particular day. And while those are important, senior leaders don’t always see these things as bottom-line outcomes. They’re not looking at how the Diversity process increased market penetrations in key ethnic markets or how the Diversity process has added ‘X’ number of customers. Progressive companies show how they have utilized diversity and inclusion technologies to integrate Diversity process into productivity improvement issues, product quality issues and innovation challenges.

To have credibility, Diversity interventions must be developed in a way that seamlessly integrate with key organizational priorities at critical levels and are designed in a way that employees can use them right away to improve the organization’s functioning. To accomplish this, it may require having the flexibility to move away from pure “academic images” of Diversity theory and venture into the realm of the “live-lab” of real organizational problems and challenges. It means working “hand-in-hand” with line managers as strategic business partners to solve some of the messy problems of performance improvement and change. As Diversity professionals, we must ask ourselves…who am I developing this intervention for…to go along with the latest fad that other organization’s are using or for my internal (or external) clients to help solve their real business challenges? These challenges must be verified with an effective Business Needs Analysis in order to show the benefits and ROI impact.

It is important to stay clear of theories and fads that are not strategically tied to producing organization-enhancing results. Sure, some of them can help create “out-of-the-box” thinking that may help produce new, practical approaches that could generate value. However, these ideas need to be well researched and tested for their practical strategic value and potential impact.

It is also critical to limit “Diversity and Inclusion speak” when working with internal clients and sponsors. As a Diversity professional, we should know the nuances of Diversity and Inclusion processes; however your audience does not have to be masters of it. It may take a while to gain credibility from their vantage point. This credibility will come faster when you are able to demonstrate specific, measurable results in quantitative and qualitative terms. The results and outcomes of the Diversity initiatives must show how the results are tied to the organization’s bottom-line impact. The results you obtain will improve your level of credibility, commitment and involvement, not the merits of theories and fads alone.

Step 6: Get a Handle on Diversity R.O.I. (DROI®)

DROI® is a registered trademark of Hubbard & Hubbard, Inc. All rights reserved.

It is absolutely essential to master the technologies of Diversity ROI (DROI®) analytics and measurement processes for all of the interventions you provide. It is critical to identify interventions, programs, and activities that have a measurable impact on organizational performance.

I have always thought of Diversity as a professional discipline and field of study. However, if it is to be taken seriously as a discipline and field of study, it must possess a structure, framework and critical components that are consistent with other serious disciplines. For example, if we examine the disciplines of Marketing, Sales Operations, and the like, we would find they all have well-defined competencies, proven theories, and applied sciences that under gird their application. These theories and sciences provide a recognized structure, strategy and a set of measurable standards to guide those who work in the field.

If we examine the disciplines that include doctors, engineers, lawyers, and others, they must be certified to practice their craft. There are also certifications for human resource professionals such as the PHR and SPHR certifications offered by the Society for Human Resource Management (SHRM) for Human Resource Professionals, the HPI certification for Trainers by the American Society for Training and Development (ASTD), or the CPT certification for Organization Development professionals offered by the International Society for Performance Improvement (ISPI).

The Hubbard Diversity Measurement and Productivity (HDM&P) Institute offers seven diversity certifications based in its Diversity ROI® and Diversity ROI Analytics® methodology:

  • Certified Diversity ROI Professional® (CDRP)
  • Certified Diversity Trainer® (CDT)
  • Certified Diversity Advisor® (CDA)
  • Certified Diversity Performance Consultant® (CDPC)
  • Certified Diversity Business Partner® (CDBP)
  • Certified Diversity Strategist® (CDS)
  • Certified Diversity Intervention Specialist® (CDIS)

These fields of study contain specific, identifiable roles that are performed, areas of expertise that allow a practitioner to build specialized concentrations of skills and knowledge within the discipline, detailed outputs produced by these roles, as well as a model of measurable competencies that define specific behaviors that enable the work to be completed with a high degree of accuracy and effectiveness.

As a professional discipline, Diversity ROI practices must align with key objectives and outcomes to operate with similar standards built on a solid framework of both concept and science. These practices must be delivered through the work of competent, credible Diversity professionals using clear standards of excellence linked to business performance. Using our talents and skills, based upon a competency-rich Diversity Discipline Framework™, Diversity professionals will be able to integrate the ideas underlying Diversity and Inclusion with specific measurement strategies and organizational systems theory to create a Diversity-enriched climate that utilizes diverse resources more effectively. Getting a handle on ROI means identifying units of measure for the interventions and activities that have a measurable impact on performance. We must consistently apply measurement sciences, track our interventions, and publish them as Diversity ROI studies such that they can be utilized as “best practices”.

Sample measures which support a Diversity ROI measurement alignment strategy include covering key Diversity Scorecard perspectives such as:

Workforce Profile Perspective

  • Diversity Hit Rate
  • #/ % Minorities as Officials and Managers
  • #/% Diversity Survival and Loss Rate
  • #/% Turnover by Length of Service

Workplace Climate and Culture Profile Perspective

  • % Favorable Ratings on Cultural Audit Demographic Group
  • “Employer of Choice” Ratings versus Top 5- 10 Competitors
  • Retention Rates of Critical Human Capital
  • # and Type of Policies and Procedures Assessed for Diverse Workforce Impact

It is important to design evaluations and utilize metrics that are practical and reflect a systemic analysis. For example, use before and after measures which examine Diversity intervention results compared to key measures which are already established and utilized in the organization.

It is also imperative that you are cautious and careful with the procedure to demonstrate how you isolated the Diversity ROI value from all other possible interventions (that could have contributed to the organizational benefit).  Be careful what you take credit for. In a Diversity ROI study, it is important that you only list those outcomes you can control which demonstrate a “chain-of-impact” to the outcome. Diversity intervention outputs are “inputs” that fuel contributions to line results. There are usually many intervening variable in the outcome production process. Isolation techniques must include utilizing scientific processes such as control groups, time-series analysis, forecast estimates, etc., to attribute Diversity’s contribution to specific business outcomes and benefits (separate and apart from other contributors).

Step 7: Make Some “Hard-Nose” Decisions About What is Needed

It is essential to conduct a comprehensive Business Assessment or “Needs Analysis” to determine what interventions are necessary to meet the intent of the aligned business objectives.  For example, when evaluating an organizational challenge, a practitioner may be partial to a favorite diversity intervention regardless of the problem or need. It is crucial that a scientific approach is taken where effective data collection helps determine the appropriate response, not what the practitioner favors.  Performing a comprehensive Needs Analysis is the cornerstone of implementing a solid, credible performance improvement process. It helps practitioners make “hard-nosed” decisions and provides an appropriate justification for either developing or not developing a diversity intervention.  We must conduct a needs analysis, no matter how abbreviated, before any intervention development takes place.

If a Diversity Training intervention is required, for example, the objectives of the Needs Analysis are to:

  • Describe the exact nature of a performance discrepancy
  • Determine the cause(s) of the discrepancy
  • Recommend the appropriate solution(s)
  • Describe the learner population

In general, Needs Analysis consists of the following steps.

  • Step 1: Identify and describe the performance discrepancies.
  • Step 2: Determine the causes of the discrepancies.
  • Step 3: Identify those performance discrepancies that are based on lack of skill or knowledge. Then identify the skills and knowledge needed that is related to diversity and diversity competence.
  • Step 4: Determine whether diversity training or another intervention is a viable solution.
  • Step 5: Recommend solutions.
  • Step 6: Describe the performer’s and organization’s role in behaviorally specific terms that relate to diversity excellence and performance.

How Are Diversity Training Analysis and Evaluation Linked to Diversity Measurement Alignment?

A needs analysis establishes the criteria for measuring the success of training after its completion. A thorough needs analysis should answer the question:

“What good will training do?”

A thorough Diversity ROI training evaluation will answer the question:

“What good did training do and what was the Return on Investment (DROI)?”

An effective Diversity ROI training evaluation cannot be conducted unless a thorough needs analysis has been completed. We cannot determine what was accomplished by a Diversity training intervention or program unless we have first defined what the program was intended to accomplish. The Diversity training needs analysis provides baseline measures against which to judge our Diversity training efforts and will help us make the hard-nosed decisions about what is the best way to meet our internal/external client’s need.

Step 8: Get Away From a Program Orientation

Diversity is not a program; it is a process of systemic organizational change. Programs have a beginning and an end. However, people will never be finished with their differences. Therefore Diversity interventions and the metrics that support them must reflect a range that supports the systems and processes that drive real organizational performance.  The context for diversity performance is the organization’s business and its objectives. To be relevant and aligned, it is critical to think in terms of the business, its goals, objectives and its performance needs. It requires Diversity practitioners connect to and work in concert with all levels of the organization.

It is reported that many top and senior executives truly support their Diversity organizations and process, but feel they should play a stronger strategic role in the growth and development of the organization. They expect Diversity practitioners to help increase productivity and provide solutions that generate a stronger competitive edge. In effect, both top and line managers are seeking Diversity professionals who can function as “strategic business partners” to solve real business problems which have a bottom-line impact on the organization’s day-to-day and strategic priorities. To successfully align and link Diversity strategies with the organization’s strategic business plan, you must actively pursue top and line managers regarding their specific business problems and speak their language. For example, if we are working with the Finance department, we must be able to talk about their problems and potential solutions using Diversity in financial terms, impacts and consequences. If the problem is focused in the operations area, we must talk in operational terms, etc.

Step 9: Stick With It!

Developing a Diversity ROI measurement capability is a “skill”. And like any skill we must learn what it is, understand its applications, use it, study the feedback from its use and refine the skill until we build a level of competency. This is an expectation for anyone that offers themselves up as an “expert” in a particular discipline or field of study. We expect doctors, engineers, social scientists, technicians, etc., to have mastered their craft in order to trust the solutions and alternatives they suggest. The same is true for Diversity professionals. We must hold ourselves to a high standard whether or not our C-Suite executives and others ask for it.

A critical element of meeting that standard is a strategic alignment with the strategy, structures and systems that drive the organization’s performance. It is imperative to take advantage of learning and listening opportunities that broaden our understanding, build Diversity ROI capability as well as business acumen.

It’s not easy. It will take a lot of work and a heavy persistence for excellence at your craft. It requires that we possess an internal standard that says we do not accept being mediocre at our craft. Developing this expertise won’t happen overnight or without setbacks and frustrations, but it can be done and is worth the struggle. This means that as Diversity professionals, we must develop a “strategic alignment mindset” that places our Diversity ROI measurement efforts on par with any discipline that drives business results and success!

 

Tags: , , , , , , , ,

“Evaluation, Reliability, and Validity: How Credible are Your Diversity Initiative Assessments of Progress and Results?”

Performance MeasurementEvaluation is a task that every Diversity Practitioner will face at one time or another. No matter what your role such as Trainer, Consultant, Chief Diversity Officer (CDO), Council Member, ERG/BRG Leader, etc., conducting an evaluation to assess key aspects of your Diversity and Inclusion initiatives is inevitable.

Two Definitions of Evaluation

People do not always agree on one definition of evaluation. Following are statements that reflect two different definitions:

  • “Evaluation is the systematic process of collecting and analyzing data in order to determine whether and to what degree objectives have been or are being achieved.”
  • “Evaluation is the systematic process of collecting and analyzing data in order to make a decision.”

Notice that the first ten words in each of the definitions are the same. However, the reasons-the “Why!”-for collecting and analyzing the data reflect a notable difference in the philosophies behind each definition. The first reflects a philosophy that as an evaluator, you are interested in knowing only if something worked, if it was effective in doing what it was supposed to do. The second statement reflects the philosophy that evaluation makes claims on the value of something in relation to the overall operation of a Diversity intervention, project, or event. Many experts agree that an evaluation should not only assess program results but also identify ways to improve the program being evaluated. A Diversity program or initiative may be effective but of limited value to the client or sponsor. You can imagine, however, using an evaluation to make a decision (the second definition) even if a program has reached its objectives (the first definition).

For some, endorsing Diversity Evaluation is a lot like endorsing regular visits to the dentist. People are quick to endorse both activities, but when it comes to doing either one, many Diversity Practitioners are very uncomfortable.

Evaluation: An Essential Element of Success

Evaluation is an absolutely essential ingredient when you are attempting to close performance gaps or improve performance. It is the only way to determine the connections between performance gaps, improvement programs, and cost-effectiveness. Evaluation is one of the most cost-effective activities in diversity performance improvement, because it is the one activity that, if applied correctly, can ensure success. It is often resisted, however, because of the fear that it could document failure. Evaluation is the process that helps us make decisions about the value of all the activities we have been engaged in and whether they are a worthwhile investment for the organization. Without systematic evaluation we are left with “wishful thinking” or self-service impressions that are often wrong and sometimes dangerous.

All evaluation studies must satisfy two criteria: reliability and validity. Establishing these criteria up front will help you communicate your expectations to the C-Suite and any vendors who deliver programs and assist in your Diversity initiatives. Reliability, the simpler of the two, requires all evaluation methods give the same results each time we measure. This protects you against measures that change constantly and produce different results every time they are used, because of the measuring instrument. Reliability is relatively easy to achieve, yet its importance is often overlooked. To overcome this you must utilize specific Diversity science procedures and instruments for measuring the aspects of Diversity performance and goal achievement that are reflected in the initiative’s objectives, strategies and the organization’s performance gaps. Next, you have to standardize these procedures such that they measure in the same way every time. These activities can be perfectly compatible with the way correctly designed Diversity initiatives are structured and administered.

The second criterion, validity, requires that all evaluations measure exactly and only what it is supposed to be measuring. This criterion is one of the requirements most often violated in Diversity performance and other assessments. For example, if we attempt to measure the amount of knowledge employees gained in a Diversity Competency Training program using a “Reaction” form that asks them how much they learned, the results will indicate how much employees “think” they learned, not how much they “actually” learned. Reaction forms too often report high amounts of learning when little occurred and vice versa (Clark, 1982). Consequently, training reaction evaluation could be reliable but not valid in these cases, because the actual results were the opposite of what the invalid instrument reliably reported! If the instrument reported the same invalid result each time it was used, it is still reliable—which is why we need both reliability and validity for all evaluation activities.

An example of a valid measurement of learning would be a Diversity competency problem-solving exercise or memory test (provided they represented the knowledge and skills the participants learned during the training. The more you make use of Diversity sciences and research evidence about the event being measured, the better your chances of for validity. Performance evaluation systems such as the Hubbard 7-Level Evaluation Methodology, integrates these approaches in the process.

Conducting a comprehensive Diversity Evaluation is the only true way to know if Diversity and inclusion programs or initiatives are delivering the outcome results expected by key stakeholders. It is essential that Diversity Practitioners master critical Diversity and Inclusion evaluation methods using technologies that are rooted in Diversity ROI® science. Why? Because the perceived value and credibility of what we do to be seen as a true Business Partner and Professional depends on it!

 

Tags: , , , , , , ,