How to qualify a second-source motor

What evidence turns a second-source candidate into a released part, and how many units have to be tested before the result means anything?

A second source exists to remove a single point of failure from a supply chain. It only does that if the second part can be substituted without a change notice to the customer, without a mechanism change, and without a different field failure rate. Qualification is the work of establishing all three, and it is the only thing that separates a second source from a second supplier of an unqualified risk.

The structure of the work is the same as any motor change: fit, performance, life, and now a fourth claim that a single-source change does not carry, which is that the two sources stay equivalent over time.

Define equivalence before you test anything

Write down what equivalent means for this part, in measurable terms, before samples arrive. Otherwise the qualification becomes a negotiation about which differences matter, conducted after the differences are already known.

  • Interchangeable dimensionally, with the same mounting datum, pilot, shaft and lead-out. State which dimensions are controlled and which are reference.
  • Within a stated band of the incumbent on no-load speed, no-load current, stall current, torque constant and, for a gearmotor, backlash and drag.
  • Equal or better on the life-limiting mechanism identified for this application, demonstrated at the application duty cycle.
  • Manufactured under change control that requires notice before any change to winding, magnet, brush system, bearings, gear material, lubricant, or manufacturing location.

Characterize both sources, not just the new one

The most common qualification error is testing the candidate against the incumbent's data sheet. The data sheet is a nominal. The population you actually receive has a center and a spread, and both matter. Characterize a sample of production incumbent parts at the same time and on the same equipment as the candidates, or the comparison contains the measurement system's differences as well as the parts'.

Evidence tiers, and what each one closes
Tier Typical sample What it closes What it cannot close
Dimensional layout5 to 10 units, full dimensional reportFit, interface and drawing conformancePopulation spread. Ten parts do not describe a tolerance capability
Electrical and mechanical characterization30 or more units per sourceCenter and spread of the performance parameters, and the difference between sourcesBehavior in the mechanism, and anything time dependent
In-mechanism functional test10 to 30 mechanismsWhether the mechanism works with the candidate across its own tolerance rangeWear, drift and any failure that takes time to appear
EnvironmentalAs required by the application, usually 5 to 15 units per conditionCold start, hot running, humidity, vibration, shippingLife at duty. Environmental testing and life testing are different questions
Life at the application duty cycleSet by the reliability you have to demonstrate, see belowThe wear claim, which is the only claim that matters after year oneNothing, if the sample was too small. See the curve below
Process qualificationNot a sample. An audit and a documented control planThat the parts you tested resemble the parts you will receiveNothing you can substitute for it with more testing

How many units the life test needs

If a life test runs to completion with zero failures, the result is not "it works". It is a statistical bound, and the bound depends entirely on how many units ran. The relationship is exact for a pass or fail test with no failures.

R = (1 − C)^(1/n)

R
reliability demonstrated at the end of the test
C
confidence level, as a fraction
n
number of units tested to the full duration with zero failures
The zero-failure success-run relation. It assumes every unit ran the full duration under the specified conditions and that a failure would have been detected. It says nothing about units that ran a shorter time.
520355065805060708090100Units tested with zero failuresDemonstrated reliability (%)90 % confidence95 % confidence22 units: 90 %45 units: 95 %
What a zero-failure test demonstrates, as a function of how many units ran. The curve is the equation above, plotted directly. Small samples demonstrate far less than they feel like they do.

Two numbers are worth memorizing. Twenty two units through a full-duration test with zero failures demonstrates 90 percent reliability at 90 percent confidence. Forty five units demonstrates 95 percent. Five units, which is a common practical sample, demonstrates about 63 percent reliability at 90 percent confidence, which is not a useful statement about a production part.

Qualify the process, not only the parts

The fourth claim, that the two sources stay equivalent, is closed by process controls rather than by measurements on parts. This is the part of a qualification that gets deferred and then never done, and it is what determines whether the second source is still equivalent in three years.

  1. A control plan that names the characteristics under control and the method and frequency of control for each.
  2. Capability evidence on the characteristics that matter, from a stable process, not from a sorted sample.
  3. A change notification agreement covering material, process, tooling, sub-tier supplier and manufacturing location, with a stated notice period before shipment of changed parts.
  4. Lot traceability that allows a field failure to be tied back to a build lot, on both sources.
  5. A first-article process for any changed revision, on the same terms as the original qualification.
  6. An agreed re-qualification trigger list, so a change does not have to be argued about when it happens.

Running two sources

Once both are qualified, the mechanism has to keep working with either, at any point in each source's tolerance range. That is a different requirement from working with each source's nominal.

  • Build the worst-case combinations deliberately: the slowest candidate against the tightest mechanism, the highest drag against the lowest supply voltage.
  • Keep both sources in production at a meaningful rate. A source that has not shipped in two years is not a second source, it is a lapsed qualification.
  • Monitor the same parameters on incoming material from both, on the same equipment, so drift in either is visible before it becomes a field trend.
  • Keep the comparison data. When a field problem appears, the incoming characterization history is what distinguishes a source difference from a design margin problem.

When time is short, test in risk order

A full qualification is weeks of work, and it is often started because a supply problem is already happening. When the schedule cannot carry the whole program, run it in the order that retires the most risk per day rather than in the order the document lists.

  1. Fit first. It is hours of work, it is unambiguous, and a fit failure ends the evaluation before anything expensive starts.
  2. Then whatever is structurally different. If the candidate has a different bearing type, a different brush system or a different gear material, that is the claim most likely to fail, and it is worth starting the long test on it immediately even while other work continues.
  3. Then performance in the mechanism, across the mechanism's own tolerance range rather than on one good unit.
  4. Then the life test, started as early as possible because it is the long pole and its duration cannot be compressed without changing what it measures.
  5. Process controls in parallel throughout. They are documentation work and they do not compete with bench time.

Starting the life test early is the single most useful scheduling decision, and it is the one most often deferred until the other results are in. A life test started in week one and confirmed in week eight is a qualification. The same test started in week eight is a risk acceptance with a test running behind it.

Who wrote it, who checked it, and what has been corrected since.

Every article on this site carries this block. A correction is recorded here with its date rather than edited silently into the text.

Written by
Micro Motion application engineering
Reviewed by
Micro Motion manufacturing engineering
First published
Last reviewed
Reading time
8 minutes

Corrections

No corrections have been issued for this article. When a figure, a number or a statement here is found to be wrong, the correction is recorded in this block with its date rather than edited silently into the text.

Report an error in this article