Engineers: 5 Steps to Cut Scrap When Selecting Equipment Tolerances
News

Engineers: 5 Steps to Cut Scrap When Selecting Equipment Tolerances

Use five practical checkpoints—functional need, drawing limits, process capability, measurement capability, and cost—to set standards-backed equipment...

Default Author

PCS Precision

Choose the loosest tolerance that still guarantees the part’s function, then confirm your manufacturing process and inspection equipment can actually hold and verify it. Work through five checkpoints in order: functional need, drawing limits, process capability, measurement capability, and cost. Start with ISO 286 for size tolerances and the measurement uncertainty approach set out in NISTIR 5170, then run the checklist in the next section.


TL;DR:

  • Ensuring measurement equipment meets process capability is essential, as a 4:1 accuracy to tolerance ratio is common and may be insufficient for borderline parts.
  • Use ISO 286 standards for critical fit features and ISO 2768 for non-critical dimensions to balance precision with cost-efficiency during drawing creation.
  • Confirm the manufacturing process can consistently meet the selected tolerances by comparing them with actual process data like Cpk or Cm, not just machine specifications.
  • Explicitly state measurement uncertainty and include guard bands in inspection criteria to prevent misclassification caused by equipment limitations.
  • Incorporate functional limits into design reviews and early collaboration with suppliers to optimize tolerances, reduce scrap, and lower manufacturing costs.

PCS Precision
pcsprecision.com.au
Keep Your Measurements Within Tolerance
PCS Precision helps manufacturing teams manage calibration, measurement accuracy, and equipment servicing for more reliable inspection decisions.
Book a calibration

Table of Contents

Tolerance versus measurement accuracy: why the distinction matters

Engineering tolerance is the permitted range of variation on a drawing, the difference between the maximum and minimum acceptable size for a feature. Measurement accuracy and uncertainty describe something different: how close an instrument’s reading comes to the true value, and how much doubt remains around that reading. Confusing the two leads to bad decisions, because an “as-measured” result is never the true value; it carries its own uncertainty band that must be accounted for before you decide a part is in or out of tolerance.

This is where gage-to-tolerance ratios come in. Historically, a 10:1 ratio between instrument accuracy and part tolerance was the rule of thumb; in practice, a 4:1 ratio is now common because instruments with higher capability are often unavailable or uneconomical, as NISTIR 5170 explains.

  • Tolerance is a drawing requirement, fixed by function and process.
  • Accuracy and uncertainty describe the measurement system, not the part.
  • Gage ratios (10:1 historically, 4:1 commonly today) are shortcuts, not guarantees against misclassifying borderline parts.

Which standards to consult for tolerance classes

Two ISO documents cover most of what a designer needs. ISO 286-1:2010 sets out the code system, terminology and concepts of basic hole and basic shaft used to define fits between mating parts. The companion tables in ISO 286-2:2010 give the actual limit deviations for standard tolerance classes on holes and shafts, so you look up the class in Part 1’s logic and the numbers in Part 2’s tables.

For features that do not affect fit or function critically, ISO 2768 provides general tolerances for linear and angular dimensions, saving you from tolerancing every dimension individually.

  • Use ISO 286 tables for initial sizing of any feature involved in a fit.
  • Apply ISO 2768 general tolerance classes to non-critical dimensions only.
  • Refine both with an assembly-level stack-up check before finalising the drawing.

A step-by-step checklist for selecting tolerances

Work through these steps in sequence rather than jumping straight to a tolerance value. Skipping steps is the most common reason a tolerance looks fine on paper and then causes scrap or field failures.

  1. Define the functional limit. Identify what the feature actually needs to do and the range within which it still works, independent of manufacturing.
  2. Convert to a drawing limit. Translate that functional need into a contractual dimension and tolerance the supplier can build to, referencing ISO 286 or ISO 2768 as appropriate.
  3. Check process capability. Compare the drawing tolerance against your process’s demonstrated Cpk or Cm using historic production data, not assumed machine specifications.
  4. Check inspection capability. Confirm your measurement equipment can resolve the tolerance with enough margin, and add a guard band if uncertainty is a meaningful fraction of the tolerance band.
  5. Weigh cost against performance. Tighter tolerances raise machining, fixturing and inspection costs; loosen anything that does not affect fit, function or safety, then iterate.

Pro Tip: Bring functional limits, not just drawing tolerances, into design-for-manufacture meetings: suppliers can often propose a cheaper process once they know how much margin they really have.

Print this sequence and run it live during a design review. The NISTIR 5170 report notes that sharing functional limits with suppliers, alongside drawing limits, can reduce scrap and cost when both sides align their inspection regimes to the same understanding of what “in tolerance” means.

Matching machined parts prepared for inspection

Translating assembly tolerances into component tolerances

An assembly requirement rarely maps to a single part. You need a method to distribute the allowable variation across the components that make up the stack, and the method you choose changes how tight each component tolerance needs to be.

  1. Worst-case analysis sums the maximum and minimum contribution of every component tolerance. It is the most conservative method and suits safety-critical or low-volume assemblies where a single bad combination cannot be tolerated.
  2. RSS (root-sum-square) analysis treats each component tolerance as a statistical distribution and combines them by root-sum-square rather than simple addition, producing looser, more realistic component tolerances for high-volume production where extreme combinations are unlikely.
  3. Monte Carlo simulation models the assembly numerically across thousands of random combinations, which suits non-linear relationships or assemblies with many contributing dimensions where RSS assumptions break down.

NISTIR 6223 outlines these assembly models and methods in more detail, along with optimisation-based approaches for more complex tolerance synthesis problems. A typical workflow starts with the assembly requirement, picks a method based on volume and risk, allocates tolerances to each component, then checks the result against process capability before it goes on a drawing.

Measurement uncertainty and setting sensible guard bands

Measurement uncertainty is the range within which the true value of a dimension is believed to lie, and it is distinct from error: error is the difference between a single reading and the true value, while uncertainty describes the confidence you can place in any reading at all. Every acceptance decision made against a tolerance is really a decision made against a measured value plus its uncertainty, not the true value itself.

  • The gage-maker’s rule historically called for a 10:1 ratio between instrument accuracy and part tolerance.
  • A 4:1 ratio is now the more common practical target, because 10:1 instruments are often unavailable or too costly for the job.
  • Both ratios can still misclassify borderline parts, which is why NISTIR 5170 recommends explicitly accounting for measurement uncertainty and applying guard bands rather than relying on a fixed ratio alone.

Measurement uncertainty must be considered explicitly when deciding whether a part is in tolerance, according to NISTIR 5170; a guard band tightens the acceptance limit inside the drawing tolerance so that measurement doubt does not let a genuinely out-of-tolerance part pass. In procurement and inspection specifications, state the required instrument uncertainty, the calibration standard it must be traceable to, and the acceptance criteria you expect the supplier to apply.

Getting tolerances onto drawings without ambiguity

A drawing is a contract, and ambiguity there becomes a dispute later. State explicit limits and datum references for every critical feature rather than leaving them to a general tolerance block.

  • Call out critical features with explicit upper and lower limits and clear datum references.
  • Apply an ISO 2768 tolerance class to non-critical dimensions and state the class on the drawing.
  • Add inspection method, sampling plan or required measurement uncertainty wherever the default shop-floor process would not be obvious to a supplier.

What experienced engineers do differently

Tightening a tolerance to compensate for a weak assembly design or an unreliable process just moves the problem downstream. Experienced engineers validate tolerances against prototypes and real measurement trials before locking a production release, and they bring design, manufacturing and metrology teams into the conversation early rather than handing over a finished drawing and hoping the numbers hold up.

— Kaz

Where traceable calibration fits into tolerance decisions

Every tolerance decision assumes your measurement system tells the truth, and that assumption only holds when the equipment behind it is properly calibrated. PCS Precision provides NATA-accredited calibration and traceable measurement services that reduce the uncertainty sitting between a reading and the true value, which matters most when you are trying to justify a tighter tolerance rather than a looser one. For teams that need extra measurement capability for a short validation run, hire equipment is available alongside the standard calibration service. This kind of measurement support complements sound design-for-manufacture work; it does not replace the functional analysis and process checks covered above, and pairing accredited calibration with routine calibration practice keeps inspection results trustworthy over time.

Sources

FAQ

Is 0.05 mm a good tolerance for a machined part?

Whether a given tolerance is appropriate depends entirely on the feature’s function and the process making it: many turned or milled features can achieve tight tolerances but non-critical dimensions may not require them. Check any tolerance against your process capability data and, where the feature is non-critical, consider whether an ISO 2768 general tolerance class would do the job at lower cost.

What do the h6 and H7 tolerance classes mean?

These are standard tolerance classes from the ISO 286 system, where a lowercase letter describes a shaft tolerance and an uppercase letter describes a hole tolerance, with the number indicating the tolerance grade. The exact limit values are read from the ISO 286-2 tables for the relevant size range and H7/h6 is a widely used fit combination for a close sliding or locational fit.

What are the main types of engineering tolerances?

Tolerances broadly cover dimensional limits (size), geometric tolerances (form, orientation, location and runout), and general tolerances applied to non-critical features under a standard such as ISO 2768. Which type applies depends on whether the feature affects fit, function or appearance only.

What is the ISO standard for tolerances?

There is no single ISO standard covering every tolerance; ISO 286 covers linear size tolerances and fits, while ISO 2768 covers general tolerances for dimensions not individually toleranced. Designers typically use both together, referencing ISO 286 for critical fits and ISO 2768 for everything else.

How does measurement uncertainty affect equipment tolerance selection?

Measurement uncertainty determines whether a reading close to a tolerance limit can be trusted, which is why NISTIR 5170 recommends accounting for it explicitly with guard bands rather than relying on a fixed gage ratio alone. Reducing that uncertainty, through accredited calibration such as the services PCS Precision provides, gives designers more confidence to hold tighter tolerances where function genuinely requires them.

Default Author

PCS Precision

Your Cart