Business Performance Assessment Program Best Practice 12 – Define Issue Materiality

StrategyDriven Business Performance Assessment Program Best Practice ArticleBusiness performance assessments seek to identify meaningful improvement opportunities for an organization, typically in the areas of safety, performance reliability, and operational efficiency. Meaningful or material opportunities are those representing a performance improvement that satisfies a regulatory requirement, exceeds the organization’s financial return on investment threshold, and/or provides a not easily replicable advantage over competitors. As such, assessors should evaluate potential performance improvement opportunities for their materiality; focusing on those offering the organization meaningful gains.[wcm_restrict plans=”47775, 25542, 25653″]

Determining Materiality

Materiality represents the threshold at which a performance improvement opportunity is significant enough to warrant the investment of time and resources required for its implementation. Consequently, materiality is relative to the size and circumstances of the individual organization being assessed. Some questions to consider when evaluating an identified performance improvement opportunity’s materiality include:

  • Is the improvement required by statute or regulation?
  • Did the deficiency result in a regulatory required reportable condition?
  • Does the improvement mitigate or eliminate an unsafe personnel or equipment condition?
  • Has the deficiency resulted in a significant production, customer, and/or financial loss (often defined as 10 percent or more)
  • Is the shortfall chronically impacting ongoing operations, current or future initiatives, and/or reported business results?
  • Will the operational efficiency and/or reliability gain meet or exceed the organization’s return on investment threshold when considering the cost of implementing the improvements?
  • Can the improvement provide the organization with a not easily replicable competitive advantage that will meet or exceed the organization’s market share goals?
  • Does the improvement reinforce the organization’s values?

While material findings should meet one or more of the above conditions, these findings should possess all of the following characteristics:

  • Relevance: Material findings will influence management’s decisions
  • Reliability: Omission or misstatement of a material finding will impair management’s ability to make good decisions
  • Completeness: Material findings must be complete in order to present an accurate and fair view of the conditions to be improved or resolved

Final Thought…

Focusing on material findings is not intended to suggest that all observed facts should not be documented. On the contrary, documenting and assessing all observed facts in aggregate is necessary to identify material findings. (See StrategyDriven Evaluation and Control Program Model – Information Development Model) Additionally, these documented observation facts can contribute to other evaluation activities including causal analysis and individual performance reviews.

Assessors should also define the materiality of the corrective actions they recommend. All corrective actions have an implementation cost and just as an organization’s business initiatives should clear a return on investment threshold. Performing corrective actions for the sake of being viewed as ‘taking action’ is damaging to an organization as it robs from it the scarce resources that would otherwise be applied to more valuable activities.[/wcm_restrict][wcm_nonmember plans=”47775, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Business Performance Assessment Program Best Practice 12 – Define Issue Materiality for just $2!

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Decision-Making Warning Flag 1d – Distinction Without a Difference

StrategyDriven Decision Making Warning Flag | Distinction Without a DifferenceWhat is six to one is a half dozen to another.”

Author Unknown

While two or more things may be truly the same, people may attempt to characterize them as being different; drawing attention to characteristics or features that are either exactly or materially the same. These individuals seek to draw a distinction between the subject items where no difference exists.[wcm_restrict plans=”49475, 25542, 25653″]

Asserting that a distinction exists without a true difference places the decision maker and his/her organization at risk. These mischaracterizations of factual conditions distort the foundation upon which conclusions are draw and actions taken. As such, this logic error must be avoided. While not all inclusive, the four lists below, Process-Based Warning Flags, Process Execution Warning Flags – Behaviors, Potential, Observable Results, and Potential Causes, provide insight to instances where decision makers make distinctions without a difference; unduly enhancing or diminishing a particular conclusion. Only after a problem is recognized and its causes identified can the needed actions be taken to move the organization toward improved performance.

Process-Based Warning Flags

  • Decision making process does not require outcome quantification prior to option development (see StrategyDriven Decision-Making Best Practice article, Identify the Target)
  • Decision making process does not include rigorous fact documentation and characterization tools and/or methods
  • Decision making process does not include a Devil’s Advocate to challenge group think and logic errors (see StrategyDriven Strategic Analysis Best Practice article, advocatus diaboli, The Devil’s Advocate)

Process Execution Warning Flags – Behaviors

  • Decision makers draw conclusions and then seek support for those conclusions
  • Decision makers obsessively focus on immaterial factual quantities or qualities
  • Decision makers narrowly focus on minute factual details
  • Decision makers quickly dismiss opposing or challenging opinions

Potential, Observable Results

  • Unnecessary or prolonged conflict between individuals
  • Decision failure resulting in sub-optimal results, missed opportunities, significant expense, equipment damage, and personnel injury

Potential Causes

  • Decision maker bias for or against the compared item
  • Decision maker is generally an optimist or pessimist
  • Decision maker inflated/misguided perception of the materiality of a quantity or quality
  • Decision maker commits other logic errors when characterizing facts or conclusions leading to the errant perception of differences (see StrategyDriven Decision-Making Warning Flag article, Logic Fallacies Introduction)

Final Thought…

There are some instances where drawing a distinction without a difference has beneficial outcomes. These often occur in a motivational setting such as when a coach encourages his/her team not to beat the opponent but to dominate them. In both instances, the coach is encouraging his/her team to win – no difference – but a distinction is drawn to inspire and motivate the team.[/wcm_restrict][wcm_nonmember plans=”49475, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Decision-Making Warning Flag 1d – Distinction Without a Difference for just $2!

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Business Performance Assessment Program Warning Flag 6 – Massaging the Message for the Boss

StrategyDriven Business Performance Assessment Program Warning Flag ArticleConstructively critical business performance assessments often present executives and managers with a difficult to accept performance message. While intended to improve overall organizational performance, leaders may take these assessments as an affront to their authority or condemnation of their performance and some leaders may even retaliate against assessors. (See StrategyDriven Evaluation and Control Best Practice article, Don’t Break the Mirror) Additionally, lead assessors and team members seeking to gain the approval of those executives and managers who may positively influence their careers might themselves be overly concerned about the evaluation’s messaging.[wcm_restrict plans=”47837, 25542, 25653″]

Lead assessors and team members frequently respond to leadership’s adverse reaction or their personal ambitions by softening the tone of their business performance assessment reports. In extreme cases, they may even alter the report’s perspective in order to please management. Such action greatly diminishes the assessment’s value; robbing the organization of opportunities to improve. While not all inclusive, the four lists below, Process-Based Warning Flags, Process Execution Warning Flags – Behaviors, Potential, Observable Results, and Potential Causes, provide insight as to whether self assessment reports are being erroneously adjusted to accommodate personnel desires rather than reflecting actual performance. Only after a problem is recognized and its causes identified can the needed actions be taken to move the organization toward improved performance.

Process-Based Warning Flags

  • Business performance assessment process does not ensure significant independence of the assessment team, particularly the lead assessor, from those executives and managers whose area of responsibility is being evaluated
  • Executive sponsors can be those whose area of responsibility is being assessed
  • Business performance assessment guidelines allow management to alter the final report’s wording irrespective of the evaluation team’s input
  • Assessment guidelines allow for nondescript phraseology
  • Assessment procedures drive qualitative over quantitative analysis
  • No mechanism is in place to protect assessors from retaliatory action
  • No mechanism exists to allow assessment team members to provide feedback on the evaluation process and final report, particularly anonymous feedback

Process Execution Warning Flags – Behaviors

  • Lead assessors and team members omit information that may, in their perception, make their superiors look bad
  • Lead assessors and team members promote the performance of those superiors who participate in their performance evaluations and promotion decisions
  • Executives and senior managers silently mistreat assessment team members, including the withholding of feedback, job assistance, and future assignments; particularly those hindering the employee’s development and advancement
  • Executives and senior managers levy personal attacks against the individual(s) making the report, with or without the person being present, when the assessment findings are less than flattering (see StrategyDriven article, Warning Flag – ad hominem: Personal, Not Issue Attacks)
  • Executives and senior managers commit open reprisals against the assessment participants, including poor performance ratings, withholding pay raises and promotions, reassignment, demotions, and terminations

Potential, Observable Results

  • Business performance assessment findings are typically ‘happy and glad’ (See StrategyDriven Business Performance Assessment Program Warning Flag article, Identifying Mostly Strengths
  • Business performance assessments result in only incremental improvements leading to slow/stalled performance improvement
  • Organizational performance falls behind that of competitors

Potential Causes

  • Insecure leaders demand positive performance reports for their area of responsibility
  • Executives and managers do not understand or appreciate the tremendous value of an effective business performance assessment program
  • Executives and managers are more concerned about their individual success than that of the organization
  • Lead assessors and team members are more concerned about their individual success than that of the organization
  • Lead assessors and team members prioritize pleasing the boss over improving the organization
  • Lead assessors and team members believe that making the boss look good will help advance their career

[/wcm_restrict][wcm_nonmember plans=”47837, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Business Performance Assessment Program Warning Flag 6 – Massaging the Message for the Boss for just $2!

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Business Performance Assessment Program Best Practice 11 – Identify Risk-based Business Performance Assessments

StrategyDriven Business Performance Assessment Program Best Practice ArticleOrganizations expend significant personnel and financial resources on well-performed business performance assessments and the implementation of follow-up performance improvement actions. To reap the appropriate return on their investment, executives and managers must carefully select the self assessments to be performed such that they directly support achievement of organizational goals and values while mitigating its most significant risks.[wcm_restrict plans=”47770, 25542, 25653″]

Identifying high-value business performance assessments is an iterative process derived from the organization’s risk assurance map. (See StrategyDriven Risk Management Best Practice articles, Map Corporate Risks to Operational Processes and Integrated Risk Assurance Oversight Matrix.) After development of the risk assurance map, including the incorporation of all internal and external oversight activities, the following evaluation should be performed (in the listed order) in order to identify the highest-value assessments to be performed:

  1. Identify those performance areas assigned a high risk score for which no internal assessment is being performed.
  2. Identify those performance areas related to organizational goals and values for which no internal assessment is being performed.
  3. Identify those performance areas for which there are regulatory assessments but no corresponding internal assessment. Particular attention should be given to those areas for which the failure to comply with a regulation could have a moderate to significant adverse organizational impact.
  4. Identify those high-risk, organizational goals and values performance areas for which one or a very few internal assessments are being performed and consider assessing these areas in the ‘off years’.

Having identified a collection of high-value assessments, planners should organize these evaluations into a well-integrated self assessment calendar. (See StrategyDriven Self Assessment Program Best Practice – Assessment Calendars.)

Final Thought…

Organizational risks and goals as well as regulatory requirements change over time. As such, risk assurance maps should be updated from time-to-time, often on an annual basis aligned with the updating of the organization’s risk matrix. Once updated, a new map evaluation should be performed to ensure the highest-value self assessments continue to be pursued.[/wcm_restrict][wcm_nonmember plans=”47770, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Business Performance Assessment Program Best Practice 11 – Identify Risk-based Business Performance Assessments for just $2!

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.

Business Performance Assessment Program – Combination Assessments

StrategyDriven Business Performance Assessment Program Principle ArticleSomething is not right… performance seems okay but the organization is not moving forward, not learning, not developing, as it should. The spark of innovation, the passionate drive to excel is gone from the leadership team and workforce. Sales may be stagnate or declining. Or perhaps asset experience one too many failures to be considered normal.[wcm_restrict plans=”47729, 25542, 25653″]

Whatever the circumstance, executives and managers often find it difficult to isolate the cause of stagnate or diminished performance to any reasonable degree. They recognize, however, the need to identify and eliminate the underlying, deep-rooted issues so to ensure continuity of operations and viability of their organization. With limited time, financial, and personnel resources, how can these hard to identify issues be surfaced and addressed?

Combination Assessments

Employing a combination of horizontal and vertical self assessment approaches within a single evaluation enables problem isolation and deep insight gathering. (See StrategyDriven Business Performance Assessment Program articles, The Horizontal Cut Approach and The Vertical Slice Assessment Approach) While somewhat more resource intensive than a normal business performance assessment, combination assessments increase the likelihood of problem identification over performance of one or a series of vertical assessments and greater insight gathering over performance of a single horizontal assessment.

Performing Combination Assessments

Combination assessments are performed in a manner that first isolates an issue and then performs a deep dive evaluation to identify its root causes.

Issue isolation begins with a series of increasingly deeper horizontal assessments, each more narrowly focused than the preceding evaluations. The series of horizontal assessments often include:

  1. Review of organizational performance measures individually and in groups to identify performance issues (programmatic performance) or areas (work groups)
  2. Review of underlying data reports providing greater insight into the specific drivers of reflected performance with a focus on identifying programs and work groups involved
  3. Selected ad hoc data analytics to further isolate the programmatic or organizational areas involved

Once the series of horizontal reviews has isolated an issue to a particular program or work group, a vertical self assessment should be performed to obtain insight to the underlying causes of the issue.

Combination Assessment Applicability

Combination assessments should be used in the following circumstances:

  • Stagnate performance is exhibited broadly across the organization
  • Stable performance improvement exhibited at rates less than that of the industry average
  • Apparently random, unrelated asset failures at a rate that is somewhat higher than normal
  • Appearance of a new, higher level of adverse condition performance (e.g. sustained higher rate of attrition over past periods)
  • Executive/Manager gut feel or intuition of an issue but without a specific focus area

[/wcm_restrict][wcm_nonmember plans=”47729, 25542, 25653″]


Hi there! Gain access to this article with a StrategyDriven Insights Library – Total Access subscription or buy access to the article itself.

Subscribe to the StrategyDriven Insights Library

Sign-up now for your StrategyDriven Insights Library – Total Access subscription for as low as $15 / month (paid annually).

Not sure? Click here to learn more.

Buy the Article

Don’t need a subscription? Buy access to Business Performance Assessment Program – Combination Assessments for just $2!

[/wcm_nonmember]


About the Author

Nathan Ives, StrategyDriven Principal is a StrategyDriven Principal and Host of the StrategyDriven Podcast. For over twenty years, he has served as trusted advisor to executives and managers at dozens of Fortune 500 and smaller companies in the areas of management effectiveness, organizational development, and process improvement. To read Nathan’s complete biography, click here.