One of the key things learnt from 6Sigma is the ability to accurately measure and analyze the information your organization collects. This can be as technical or as general as your organization needs, the key is to understand the level of specificity your organization needs and analyze from there. A Black belt will be able to give you in depth analysis, but a good one will give you exactly what your organization needs. We’ll start the discussion with Multi- Vari Analysis.
What is Multi-Vari Analysis?
Simply put this puts a face to the data. Once you have collected all of your information Multi-Vari studies take the data and illustrate the patterns of variation within the data. It helps you identify group or correlations between subgroups and over time. When you can identify the groups, you can make assumption or draw conclusions based on the data. For example if your data shows the your staff made more errors on product X you can draw the conclusion that your improvement efforts need to be focused on that particular product.
What is it used to assess?
Multi-Vari studies are useful in many ways but the most standard uses are
- to illustrate data in graphics.
- to show how work is influence by defined variables.
- to show the impact of specific material, departments or methods.
- the effects of external factors such as noise, delivery delays etc.
When you need to show stakeholders, influencers or project staff what you have found multi- vari studies are a great way to produce a visual. Since most people learn by doing, a visual representation allows them to see what they have done and to show leadership the gains or losses accordingly.
We’ve talked about accuracy, repeatability and reproducibility in your MSA’s but now we need to talk about data integrity.
Numbers shouldn’t lie, but when they do it is usually because somewhere along the line the integrity of the data didn’t hold up.
Before you begin your analysis there are two questions you should ask yourself:
- Does my data have known reference points?
- Does the data match control documents? If you’re looking at product returns, does the data match the information on your financial documents?
Accuracy and Precision
The next thing to think about is accuracy and precision. When you are evaluating the accuracy of your data, what you are looking for is how close the average is to the anticipated value. Your precision will tell you how much variation occurs in you data. Think about it in terms of playing pool. Your accuracy tells you how close you were to making the shot and your precision shows you how far apart the balls were from the pocket.
The third thing to look at is any bias your data might have. Formally the definition of bias is the deviation of what was measured from the actual value. What that means is how far off your measurement is from the actual number. The goal is to reduce bias as much as possible, I say reduce because you will never be able to eliminate it. You will need to decide what acceptable bias limits are. If you have a worker who is consistently late and you’re measuring organizational tardiness, you know your bias is going be about 10 minutes.
Next you can move on to stability. Stability is defined as your error rate. The less errors, the more stable the process. All stability does is tell you when accuracy or bias changes in your process. What you should be looking for it to do is serve as an alarm, letting you know that something has changed. This alerts you to areas in your process that are no longer stable.
Last but not least, you have linearity. What this tells you is if your bias is consistent. If something happens once, it’s an outlier. It’s not consistent which means you don’t want to hinge a change or a new process on something that may or may not happen again.
MSA is a big subject and we are far from done with it. Next week we will continue to talk about MSA Windows in Minitab and how to interpret them. In the meantime if you have any questions give us a call and let us help!
We all know my affinity for MSA but it wouldn’t be fair if we didn’t talk about the measurements for a bit. Six Sigma is built on measurements and the corner stone of effectiveness is to have measurements that are appropriate. So let’s dig in and figure out what defines appropriate measures.
What makes it appropriate?
There are four key areas to consider when you are trying to determine if your metrics are appropriate:
- Is it sufficient?-When you consider this you will need to look at how available the metric is. Ask yourself if you can readily gather the data. If you have to collect it and the collection times require more energy and resources than you can give, it may be time to rethink this metric.
- Is it relevant?-What will this metric tell you? Does it help you understand or identify your problems? If it doesn’t then maybe you need to take a step back and figure out what you need your metric tell you.
- Is it representative?-When you are looking at this metric, you should see a balanced representation of the people and the steps involved in your process. If you can’t see these things, take another look at your goals. Are you measuring the right things?
- Is it contextual?-When this information is put together with all of the other information you collect, do you see the big picture? In other words is the data painting a picture that makes sense to your and the people involved?
So MSA like everything else in Six Sigma is a tool and the thing that we need to remember is that for it to be effective, we have to make sure we are using it appropriately. Check your systems and let me know how they are working. If they aren’t working, give us a call.
Okay for the last two weeks, I’ve been talking about Measurement System Analysis and before I move on to a new topic I have one final post on why you should be thinking about MSA. Here it goes…
Why you use it
- You use MSA to compare you customer’s expectations to your inspection standards. This is a very quick illustration of a value stream map and a good way to ensure that you are providing the best service for your customer.
- It gives you a snapshot of where the training in your organization should be.
- It gives you the opportunity to evaluate your trainers in a truly neutral fashion. The data doesn’t lie and you can assess the training in your organization from a truly objective perspective.
- Creates an opportunity to analyze your existing systems and evaluate new systems.
Why is it important?
- Allows you to measure the amount of variation in your measurement systems.
- Allows you to compare user variation.
- Allows you to compare two or more measurement systems.
- Helps you develop a baseline for measurement systems.
- Helps you develop a system to evaluate the moving pieces in your organization.
- Gives you a true before and after picture.
- Gives you a true measurement of variation and the causes of it.
- Evaluates your training programs.
So I am a big fan of MSA as you can tell, but the bottom line is that it can really affect your organization in the best way. It forces you to be accountable and it forces you to pay attention to the changes. Give it shot and if we can help, let us know.
Everything we measure generates variation, especially when there are multiple hands involved. To be honest even with just one person performing the same function, there will be some variation. Variation is not the enemy, uncontrolled variation is our nemesis!
When creating a Measurement System Analysis (MSA) there are 3 characteristics that you should focus on before you try any of the bells and whistles.
Is it accurate?
You need to know how accurate your measurement system is. If you can’t correctly count the number of variations happening can you really call them variations? Your measurement system is only as good as your accuracy, so it makes sense to spend a fair amount of time ensuring that not only are you counting defects, but you are counting the correct defects. This goes back to knowing why you want to measure something. If you want to find out why your shipments are late, measuring the number of birds around your facility won’t help. So accuracy needs two things: measuring the right data and ensuring the data is being measured in a way that answers your question.
Is it precise?
We’ve talked about precision and for a refresher precision is the reduction in variation. When you have identified your improvement area in the process, you are now ready for precision. So you are going to take one process, completed by the same person, in the same order every single time. Once you have identified this, you can began to reduce the variation and create precision.
Can you reproduce it?
The thought behind automating any process is ultimately making it scaleable, that is can you repeat the success? This is what determines a successful process from a failed one. Any process is good in theory, but where you get a great process is when you find one that can be repeated with the same amount of variation no matter who does it. That’s your end goal folks.
So we’ve covered the 3 basic characteristics of a Measurement System Analysis, so have a conversation with your belt and figure out your current state and your future. Your MSA will heavily influence your future, so take this conversation seriously. If you need more help, give us a call and let us help.