Independent and not affiliated with the FDA, MHRA, ISPE, PDA, or any agency. Get the appgoutham@madhadi.com
madhadi.comData Integrity & GxP Quality
Browse all topics -> Articles Templates & Procedures Learning paths GlossaryScenariosToolsRegulatory ReferencesLearning PathsTopics About Start here

Calibration and Metrology Programs in GMP: Tolerances, Traceability, and Out-of-Tolerance Handling

How a GMP calibration and metrology program works in practice: setting tolerances, maintaining NIST-traceable standards, building a measurement uncertainty budget, choosing intervals, and running an out-of-tolerance investigation when an instrument fails.

A flow meter on a buffer preparation skid reads 100.0 L when it actually delivers 96 L. Nobody knows, because the meter has not been checked against a reference in fourteen months. Three months of batches were made with the wrong buffer volume. That is what a calibration program exists to prevent, and it is why calibration is one of the first things an inspector pulls when they walk onto a manufacturing floor. Every weight you record, every temperature you trend, every pressure you hold during a sterilization cycle traces back to an instrument, and that instrument is only as trustworthy as its last calibration.

This article covers how a real GMP calibration and metrology program is built and run: the regulatory basis, how tolerances and intervals are set, how traceability to national standards actually works, the roles involved, and the part that trips people up most, what to do when an instrument comes back out of tolerance.


What a calibration program is and why GMP requires it

Calibration is the documented comparison of a measuring instrument against a reference standard of known, higher accuracy, under defined conditions, to determine the error of the instrument. If the error is within an allowed limit (the tolerance), the instrument passes. If not, it is out of tolerance and the program forces an investigation.

Metrology is the broader discipline: the science of measurement. A metrology program covers the whole population of measuring and test equipment in a facility, the standards used to calibrate them, the intervals, the uncertainty budgets, and the data those instruments generate.

Regulatory basis

In the United States, the core requirement is 21 CFR 211.68(a) for automatic, mechanical, and electronic equipment, and more specifically 21 CFR 211.160(b)(4), which states:

“The calibration of instruments, apparatus, gauges, and recording devices at suitable intervals in accordance with an established written program containing specific directions, schedules, limits for accuracy and precision, and provisions for remedial action in the event accuracy and/or precision limits are not met.”

That single sentence is the skeleton of every program: a written procedure, a schedule, accuracy and precision limits, and remedial action when limits are not met. 21 CFR 211.160(b)(4) requires that instruments, apparatus, gauges, and recording devices be routinely calibrated, inspected, or checked according to a written program designed to assure proper performance, and 21 CFR 211.68 extends the same expectation to automated production equipment.

For active pharmaceutical ingredients, ICH Q7 (2000), Section 5.3 requires that control, weighing, measuring, monitoring, and test equipment critical to assuring API quality be calibrated according to written procedures and an established schedule. The EU GMP EudraLex Volume 4, Chapter 3 carries the same expectation for measuring, weighing, recording, and control equipment, with calibration records retained.

For laboratory instruments specifically, USP General Chapter <1058> Analytical Instrument Qualification (AIQ) sets the framework, and 21 CFR 211.160 requires that laboratory controls include calibration of instruments at suitable intervals. The underlying metrology vocabulary and method come from ISO/IEC 17025 (the standard most calibration labs are accredited to) and the International Vocabulary of Metrology (VIM, JCGM 200:2012).

A fourth edition, ISO/IEC 17025:2025, published 27 September 2025, supersedes the third (2017) edition. It does not rewrite the core competence model; it adds explicit expectations for managing digital calibration data, electronic signatures, and the validation of software used in measurement or reporting, and it sharpens the existing push toward setting calibration intervals from documented performance history rather than a fixed schedule alone. Accreditation bodies are running a three-year transition that closes 30 September 2028, so a calibration vendor holding 2017-edition accreditation today is not out of compliance; confirm which edition a vendor’s scope covers, and always verify the current edition and clause numbers before citing this standard in a procedure.

The quality rationale

Calibration is a controlling activity for data integrity and product quality at the same time. If the instrument is wrong, then every record it produced since the last good calibration is suspect. A balance that drifts high releases sub-potent product. A thermocouple that reads two degrees high lets a sterilization cycle run cold. The program is the mechanism that bounds how far an instrument can drift before you catch it, and how much material is at risk when it does.

Calibration, verification, adjustment, and qualification are not the same word

People use these interchangeably and then write procedures that confuse them. An inspector will test whether you know the difference, because the difference decides what evidence you must keep.

TermWhat it isWhat it producesWhen you use it
CalibrationDocumented comparison of the instrument against a reference standard to determine the errorAs-found (and as-left) error at each test point, with pass/fail against toleranceThe scheduled program activity for every measuring instrument
Verification / checkConfirming the instrument is within tolerance at one or a few points, without a full multi-point calibrationA pass/fail against tolerance, no full error mapDaily balance check with a control weight; between-calibration confidence check
AdjustmentPhysically changing the instrument to reduce its errorA new as-left condition; must be preceded by a recorded as-foundOnly after as-found is captured, when the instrument is off but repairable
Qualification (AIQ / IQ-OQ-PQ)Documented evidence that an instrument or system is fit for its intended use across its operating rangeQualification protocols and a summary reportAt install and after major change; calibration is a prerequisite input, not a substitute
StandardizationDetermining the exact concentration, titer, or factor of a reagent or working solution against a primary or certified reference materialA verified concentration or correction factor applied to subsequent results, not an error map of an instrumentTitrants and volumetric solutions used in a titration-based assay, where the chemistry drifts even though the instrument (the burette or titrator) is still in calibration

The trap is treating a daily verification as if it were a calibration, or adjusting an instrument first and calling the post-adjustment reading the calibration result. A verification tells you the instrument is probably fine today; it does not give you the multi-point error map you need to manage intervals or assess impact. And adjusting before recording as-found destroys the only data that tells you whether past results were trustworthy. Standardization is its own trap in a QC lab: a titrator can be perfectly in calibration while the titrant itself has drifted off its labeled normality, so a procedure that only schedules instrument calibration and never schedules reagent standardization has a hole in it. See analytical instrument qualification for how calibration sits inside AIQ.


What goes in the program: the documents and their contents

A working program is more than a list of due dates. It has a defined document hierarchy.

The governing SOP / calibration master plan

The top-level procedure (often a calibration and metrology SOP or master plan) defines:

  • Scope: which equipment is in the program and which is explicitly excluded (reference-only or indicating-only devices, see below).
  • Classification: how instruments are designated critical, non-critical, or reference-only, and the criteria for each.
  • Tolerance-setting methodology: how acceptance limits are derived from process requirements.
  • Interval-setting and adjustment rules.
  • Traceability requirements for standards.
  • Out-of-tolerance (OOT) handling and impact assessment.
  • Labeling, identification, and the unique equipment ID scheme.
  • Roles and responsibilities.
  • Records and retention.

The instrument calibration master list (the inventory)

This is the single source of truth for what exists and when it is due. A typical record looks like this:

Equip IDDescriptionLocationClassificationRange / spanToleranceIntervalLast calNext dueStandard used
TI-2041RTD, bioreactor jacketSuite 2Critical0 to 150 °C±0.5 °C12 mo2026-02-102027-02-10TS-118 (dry block)
PI-3307Pressure gauge, autoclaveSterile prepCritical0 to 60 psig±1% FS6 mo2026-05-222026-11-22TS-204 (pressure cal)
BAL-1102Analytical balanceQC labCritical0 to 220 gper USP <41>12 mo + daily check2026-04-032027-04-03OIML E2 weights
FM-0915Mass flow meter, WFI loopUtilitiesCritical0 to 200 L/min±2% reading12 mo2026-01-152027-01-15TS-330

“Per USP <41>” on BAL-1102 is shorthand for a specific calculation, not a single number pulled off a datasheet. The measurement uncertainty section below works through that calculation on this same balance, including the minimum weight it implies.

The individual calibration procedure (the work instruction)

Per instrument or per instrument family, the procedure that the technician follows. It specifies the standard to use, the number and value of test points, the as-found and as-left recording, environmental conditions, and the pass/fail logic.

The calibration certificate / record

The completed record for one calibration event. It must contain, at minimum:

  • Instrument ID and description.
  • Date of calibration and due date.
  • Standard(s) used, with their ID and certificate / due date (this is the traceability link).
  • Environmental conditions (temperature, humidity) where they affect the measurement.
  • Test points with the nominal value, the standard’s value, the instrument reading, and the calculated error.
  • As-found data (before any adjustment) and as-left data (after adjustment).
  • Pass / fail determination at each point against the tolerance.
  • Technician identity and date, reviewer / approver signature.
  • A statement of measurement uncertainty for accredited work.

The as-found / as-left distinction is the most important single feature of the record and is covered in detail below.


Tolerances: how to set acceptance limits

The tolerance is the maximum allowable error at which the instrument is still acceptable. Getting tolerances right is where engineering judgment lives, and where many programs quietly fail an inspection.

The chain you have to respect

There are three different numbers people confuse, and an inspector will probe whether you understand the difference:

  1. Process requirement (the tightest real need). What does the process actually need this measurement to be within? Example: a hold step requires the solution to be 2 to 8 °C, and you control to a 4 to 6 °C operating band.
  2. Instrument tolerance (calibration acceptance limit). The error you will accept at calibration. This must be tighter than the process requirement, not equal to it, because the instrument tolerance consumes part of the available margin.
  3. Standard accuracy / Test Accuracy Ratio (TAR). The reference standard must be more accurate than the instrument it checks. The classic rule is a 4:1 Test Accuracy Ratio: the standard is at least four times more accurate than the tolerance of the unit under test. Where 4:1 cannot be achieved, you use a Test Uncertainty Ratio (TUR) of at least 4:1 based on full measurement uncertainty, and you document the justification when it is lower.

A worked tolerance derivation

Process need: a lyophilizer shelf must hold the product at -40 °C with the process validated for a shelf range of -42 to -38 °C, so the allowable process band is ±2 °C.

You do not set the instrument tolerance at ±2 °C. You set it tighter so that instrument error plus normal control variation still fits inside the validated band. A common practice is to allocate the instrument no more than a quarter to a third of the process band. So you set the calibration tolerance at ±0.5 °C.

Now the standard: by the 4:1 rule the dry-block or reference thermometer used to calibrate it must be accurate to at least ±0.125 °C. If your reference is only ±0.2 °C, you have a 2.5:1 ratio, which is below 4:1, and you must either get a better standard or formally justify and document the reduced ratio with a guard-band on the acceptance decision.

What a guard-band actually does: when the standard’s uncertainty is a meaningful fraction of the tolerance, an instrument reading right at the tolerance edge might be truly out, because the standard itself could be off by its uncertainty. Guard-banding shrinks the acceptance limit by some portion of the measurement uncertainty so you only pass instruments comfortably inside the tolerance. With a ±0.5 °C tolerance and a ±0.2 °C standard, a common approach is to accept only if the as-found error is within ±0.5 °C minus the standard uncertainty, so within about ±0.3 °C. That reduces the risk of accepting a bad instrument (the consumer’s risk) at the cost of occasionally rejecting a good one. The decision rule, and whether you guard-band, must be written in the procedure, not improvised per calibration; ILAC G8 describes the guard-banding decision rules used with measurement uncertainty.

Common tolerance conventions

  • ±% of full scale (FS): error is a fixed band across the whole range. Easy, but at the low end of the range the relative error is large. A 0 to 100 psi gauge at ±1% FS is ±1 psi everywhere, which is 10% of reading at 10 psi.
  • ±% of reading: error scales with the value. Better for instruments used across a wide range.
  • ±absolute units: e.g. ±0.5 °C. Common for temperature.

The three conventions look similar on paper and behave very differently in use. Take one 0 to 100 psi gauge and apply each convention, then read the allowed error at three points across the range:

Reading±1% FS (±1 psi flat)±1% of reading±0.5 psi absolute
10 psi±1.0 psi (10% of reading)±0.1 psi (1% of reading)±0.5 psi (5% of reading)
50 psi±1.0 psi (2% of reading)±0.5 psi (1% of reading)±0.5 psi (1% of reading)
90 psi±1.0 psi (1.1% of reading)±0.9 psi (1% of reading)±0.5 psi (0.6% of reading)

If the process operates near the bottom of the range, ±% FS is the loosest of the three at the point that matters and can pass a gauge that is badly wrong where you actually use it. If the process operates near full scale, the conventions converge. The lesson is to set the tolerance at the reading the process actually runs at, and state the basis. Always state at which points the tolerance applies and the units. “±2%” with no basis (of reading? of span?) is an audit finding waiting to happen.

Acceptance criteria for the tolerance itself

A tolerance is set correctly when: it is traceable to a documented process or product requirement; it is tighter than that requirement with margin retained; the standard achieves at least a 4:1 ratio (or a justified lower ratio); and the same tolerance is consistently reflected in the master list, the procedure, and the certificate. A mismatch between the tolerance on the certificate and the tolerance in the master list is a frequently cited finding.


Traceability: what “NIST traceable” actually means

People say “NIST traceable” loosely. The real requirement is metrological traceability: an unbroken, documented chain of calibrations, each with a stated measurement uncertainty, linking your working instrument back to a recognized national or international measurement standard (in the US, the National Institute of Standards and Technology; the SI realization more broadly).

The chain in practice

National standard (NIST / national metrology institute)
        ↓  (accredited cal, ISO/IEC 17025)
Primary / reference standards (your accredited cal lab)
        ↓
Working standards (your metrology lab's masters: weights, dry blocks, pressure modules)
        ↓
Field / process instruments (the balance, gauge, RTD on the floor)

Each arrow is a calibration event with a certificate, a stated uncertainty, and a due date. Break any link, use an expired working standard, use a standard with no certificate, and the traceability is gone for everything calibrated with it.

What makes traceability defensible

  • The reference / working standards are themselves calibrated by an ISO/IEC 17025 accredited laboratory (accreditation body such as A2LA, UKAS, or another ILAC-MRA signatory), currently transitioning from the 2017 to the 2025 edition of the standard through the September 2028 deadline. Accreditation, not just a certificate, is what gives the uncertainty statement weight.
  • Each calibration certificate states measurement uncertainty and references the standards used.
  • Standards have their own calibration interval and are tracked in the same program. A working standard that is overdue invalidates work done with it after its due date.
  • The certificate carries enough detail to reconstruct the chain: standard IDs, their certificate numbers, and their due dates.

Worked example of a broken chain

A technician calibrates twelve process gauges in March using pressure module TS-204. In a periodic standards review you find TS-204’s own calibration expired in February. Every one of those twelve calibrations was performed with an out-of-date standard. You now cannot claim those gauges were verified, you treat them as suspect, and you re-calibrate them with a valid standard and assess impact on anything those gauges measured. This is why standards are kept on a tighter leash than field instruments.


Measurement uncertainty: building the budget, and the 2026 USP <41>/<1251> revision for balances

Every number above, the tolerance, the TAR, the traceability chain, assumes you can actually state how much doubt surrounds a measurement. That number has a name: measurement uncertainty. Most programs mention it once on a certificate and move on. The regulation is about to stop letting them get away with that for balances, and the general direction, documented uncertainty instead of a pass/fail tolerance alone, is the same direction ISO/IEC 17025:2025 pushes for the whole calibration program.

Why this changed

USP General Chapters <41> Balances and <1251> Weighing on an Analytical Balance were revised, with the revision officially effective 1 February 2026. The chapters are not new; what changes is the center of gravity. The prior approach leaned on a calibration tolerance and a periodic check with a reference weight: pass or fail. The revised chapters move the working requirement toward a documented measurement uncertainty for the balance and a minimum sample weight derived from the balance’s own repeatability, so that “the balance passed its calibration” and “this specific sample weighing is trustworthy” become two separate, both-answered questions. That is the same metrology discipline ISO/IEC 17025 has long required of accredited labs, now showing up explicitly inside a USP general chapter that every QC lab already follows, whether or not the lab itself holds 17025 accreditation. A balance that is in calibration can still produce an untrustworthy result if the sample weighed on it is too small for that balance’s repeatability, and that is precisely the gap the revised chapters close.

What it requires

For every balance used to weigh material where the weighing result matters to a GMP decision, two documented outputs are now expected, not optional extras:

  1. A measurement uncertainty statement for the balance, built from the real contributors to error (repeatability, the reference weight’s own calibration uncertainty, linearity, display resolution), combined into one number, not copied from a datasheet.
  2. A minimum weight, below which that balance cannot deliver the relative accuracy the application needs, determined from the balance’s own repeatability rather than assumed from the readability of the display.

Neither output is a one-time calculation filed and forgotten. Both are tied to the balance’s actual performance, so they are repeated whenever the balance is requalified, relocated, or shows a meaningful shift in its routine repeatability check.

How to build the uncertainty budget, step by step

  1. Collect repeatability data. Weigh a check weight near the operating load at least ten times without resetting the balance between readings, and calculate the standard deviation of those ten readings. This is the single most informative contributor, because it reflects the balance as it actually performs today, not as it performed when new.
  2. Pull the reference weight’s own uncertainty. Take the expanded uncertainty from the calibration certificate of the weight used in step 1, and the coverage factor the certificate states (almost always k = 2). Divide the expanded uncertainty by that coverage factor to get the weight’s standard uncertainty.
  3. Add the balance’s linearity contribution. Use the manufacturer’s stated linearity specification, or a linearity check across the range, and treat it as a rectangular (uniform) distribution: divide the half-width of the specification by the square root of 3.
  4. Add the display resolution contribution. Take the balance’s smallest readable increment and divide by two times the square root of 3, again treating the rounding of a digital display as a rectangular distribution.
  5. Combine the components. Square each standard uncertainty, add the squares, and take the square root (a root-sum-of-squares combination). This is the combined standard uncertainty.
  6. Apply a coverage factor. Multiply the combined standard uncertainty by k = 2, which approximates a 95 percent confidence interval for a normal distribution with enough effective degrees of freedom, consistent with standard metrology practice (the Guide to the Expression of Uncertainty in Measurement, GUM, and ISO/IEC 17025 clause 7.6 use the same convention). The result is the expanded uncertainty, the number you report and defend.
  7. Derive the minimum weight. Using the repeatability standard deviation from step 1, calculate the smallest sample weight that keeps the relative uncertainty contributed by weighing within the target you need (commonly 0.10 percent unless a process-specific requirement justifies a different value). Round the result up, never down, and apply that number as a hard floor for any weighing performed on that balance.
  8. Record and post. File the uncertainty statement and the minimum weight with the balance’s calibration record, and post the minimum weight at the balance (a label on the enclosure, not only in a document) so an analyst sees it before weighing.

Acceptance criteria

A balance’s measurement uncertainty program is acceptable when: the uncertainty budget includes at minimum repeatability, reference weight uncertainty, linearity, and resolution, each traceable to a real source rather than an assumed value; the combined and expanded uncertainty are calculated, not estimated by eye; the minimum weight is derived from the balance’s own current repeatability, not copied from the manufacturer’s generic specification; the minimum weight is visible at the point of use; and every method or batch record that specifies a sample weight on that balance states a weight at or above the minimum.

Worked example: a 220 g analytical balance, instrument BAL-1102

This is the same balance referenced earlier in the master list table, now carrying its own uncertainty budget.

StepSourceValueStandard uncertainty
Repeatability10 replicate weighings of a 100 g OIML E2 check weight, standard deviation of the readingss = 0.00012 gu(rep) = 0.00012 g
Reference weightCertificate expanded uncertainty for the 100 g OIML E2 weight, k = 2U = 0.00025 gu(cal) = 0.00025 / 2 = 0.000125 g
LinearityManufacturer spec, rectangular distributionhalf-width 0.0002 gu(lin) = 0.0002 / sqrt(3) = 0.0001155 g
Display resolutionSmallest readable increment, rectangular distributiond = 0.0001 gu(res) = 0.0001 / (2 x sqrt(3)) = 0.0000289 g

Combine by root-sum-of-squares:

u(c) = sqrt(0.00012^2 + 0.000125^2 + 0.0001155^2 + 0.0000289^2) = sqrt(4.42 x 10^-8) = 0.00021 g

Apply the coverage factor:

U = k x u(c) = 2 x 0.00021 g = 0.00042 g

So this balance’s expanded measurement uncertainty, at roughly 95 percent confidence, is about plus or minus 0.00042 g (0.42 mg) around any reading in this region of its range.

Now derive the minimum weight, reusing the same repeatability data from step 1 and a target relative accuracy of 0.10 percent (0.001), the common default absent a tighter process-specific need:

minimum weight = (2 x the repeatability standard deviation) divided by the target relative accuracy = (2 x 0.00012 g) / 0.001 = 0.00024 g / 0.001 = 0.24 g

Rounded up for practical use, nothing below 0.25 g should be weighed on BAL-1102 where a 0.10 percent relative accuracy is required. If a method calls for weighing a 0.1 g sample on this balance, the balance is not suitable for that step; either move the step to a balance with better repeatability, use a larger aliquot and dilute, or formally justify and document a looser relative accuracy target for that specific application.

Where this trips programs up

The most common failure is treating the minimum weight as a one-time number pulled from the balance manual rather than a live output of that specific balance’s current repeatability, which drifts with age, wear, and location (a balance that was fine on a solid bench reads differently on one exposed to foot traffic vibration). The second is leaving the number in a validation binder instead of at the balance, so an analyst weighing 0.08 g for a dissolution sample has no way to know the balance cannot support that weight at the needed accuracy. The third is confusing the balance’s readability (the smallest digit it displays) with its repeatability (how consistently it returns the same reading); a balance that reads to 0.01 mg can still have poor repeatability if it is worn, poorly leveled, or sited near a draft, and readability alone says nothing about whether a small sample is trustworthy.

See the companion Worksheet: Measurement Uncertainty Budget and Minimum Weight Determination for a version of this calculation you can run on your own balance, and analytical instrument qualification and statistics in quality: Cpk and control charts for how the repeatability data behind this budget also feeds interval decisions below.


Calibration intervals: setting and adjusting them

The interval is how often you recalibrate. 211.160(b)(4) says “suitable intervals” without specifying numbers, which means you must justify yours.

How to set an initial interval

Drivers for a shorter interval:

  • Higher criticality (direct impact on product quality, safety, or release data).
  • Known drift behavior or a manufacturer recommendation.
  • Harsh duty (vibration, temperature cycling, heavy use, corrosive media).
  • History of out-of-tolerance results.

Typical starting points (these are conventions, not regulation): twelve months for many stable instruments, six months for critical process instruments with tighter tolerances or harsh service, and daily / per-use checks layered on top for balances and pH meters. Justify whatever you choose against criticality and manufacturer data.

Interval adjustment based on history

A mature program does not freeze intervals. It uses as-found data to extend or shorten them, an approach aligned with ILAC G24 / OIML D 10 (guidelines for the determination of calibration intervals). The simple logic:

  • If an instrument is consistently well within tolerance as-found across several cycles, you may extend the interval, with documented rationale and within risk limits.
  • If an instrument comes back out of tolerance or near the limit, you shorten the interval and may trigger an OOT investigation.

This is also why you must record as-found values numerically, not just “pass.” A program that only records pass/fail throws away the data needed to manage intervals and to assess OOT impact.

Fixed interval or performance-based interval: working the decision

Programs get stuck arguing this in the abstract. It resolves cleanly if you walk it one instrument at a time, in this order:

New instrument, or an existing instrument with fewer than two completed calibration cycles on file
↓
No performance history exists yet. Assign a fixed initial interval from criticality, manufacturer data, and duty severity, and start collecting as-found data
Two or more completed cycles, each with numeric as-found data on file
↓
Review the as-found trend across those cycles: consistently well within tolerance, trending toward the limit, or an outright out-of-tolerance result
Consistently well within tolerance, no OOT in the reviewed cycles, and nothing safety-critical overrides it
↓
Move to a performance-based interval: extend it, with the as-found history and the rationale documented, capped at whatever ceiling the SOP sets for that criticality class
As-found is passing but trending toward the limit over successive cycles
↓
Hold the interval where it is, or shorten it, and add an interim verification between full calibrations if the instrument is quality-critical
As-found exceeds the tolerance at any point (a real out-of-tolerance result)
↓
Shorten the interval, route it through the OOT investigation below, and do not extend again until a fresh performance history earns it

A fixed interval is a placeholder for the period before you have data, not a permanent policy choice. The moment as-found history exists, the decision should be driven by that history, and the direction only ever goes two ways: performance earns a longer interval, drift or failure earns a shorter one. A program that never extends anything is leaving inspection time and labor on the table for no quality benefit; a program that only extends and never shortens is not actually looking at its own data.

Acceptance criteria for intervals

Each interval is documented and justified; the justification ties to criticality and history; there is a defined rule for shortening on OOT and for extending on sustained good performance; and the master list, schedule, and physical due-date labels all agree. Overdue instruments still in use is one of the single most common GMP findings, so the schedule must have a hard stop: overdue equals out-of-service until calibrated.


As-found / as-left and the out-of-tolerance investigation

This is the part of the program inspectors push on hardest, because it is where product impact is decided.

As-found vs as-left

  • As-found: the instrument’s error measured before any adjustment, in the condition the floor was using it. This is the data that tells you whether your previous results are trustworthy.
  • As-left: the error after any adjustment or repair. This tells you the instrument is good going forward.

If a technician adjusts the instrument first and only records the post-adjustment reading, the as-found data is destroyed and you can never assess what the instrument was doing during the months it was in service. Recording as-found before touching the instrument is non-negotiable.

What “out of tolerance” means and what it triggers

An instrument is out of tolerance (OOT) when its as-found error at any test point exceeds the acceptance limit. An OOT is not just a maintenance event. It is a quality event, and it must be handled under the deviation system because it means a measuring device was potentially giving wrong values to a GMP process. See deviation management and quality event classification and triage.

The OOT investigation, step by step

  1. Stop and segregate. Tag the instrument out of service. Do not adjust it yet if as-found has not been fully captured.
  2. Capture and confirm as-found. Record the error at every test point. Re-measure to confirm the OOT is real and not a setup error (wrong standard, bad connection, instrument not stabilized).
  3. Open a deviation / quality record. OOT on a critical instrument is documented in the deviation or nonconformance system, not buried in a calibration log.
  4. Define the affected period. The instrument is suspect from the last known-good calibration up to now. Everything it measured in that window is potentially impacted. This is why the previous as-found and as-left history matters.
  5. Quantify the magnitude and direction of error. How far out, and which way? A balance reading 0.3% high is a different risk than one reading 5% low. Direction matters: a thermocouple reading high makes a sterilization cycle run cold (worse for sterility); reading low makes it run hot (worse for product degradation).
  6. Impact assessment on product and data. For each affected batch, lot, or dataset, determine whether the error could have caused an out-of-specification or out-of-trend condition. Use the actual error magnitude against the process margin. If the worst-case corrected value still meets all specifications, impact may be none; if it could have pushed a result across a spec limit, those batches need formal evaluation and possibly an OOS or recall assessment.
  7. Root cause. Why did it drift or fail? Wear, damage, environmental exposure, interval too long, mishandling, prior bad repair. See root cause analysis techniques.
  8. Corrective and preventive action. Adjust/repair and re-qualify the instrument, and where the cause is systemic (interval too long for the duty, recurring drift on a model), shorten the interval, change the device, or add interim checks. See what is a CAPA and CAPA effectiveness verification.
  9. Disposition affected product and records. With QA, decide release, rejection, additional testing, or further investigation for each affected batch. Link to batch disposition decisions and, where a result is implicated, the OOS investigation process.
  10. Close with documented rationale. The conclusion must be defensible on its own: what was affected, what the corrected values show, and why product and data are or are not impacted.

Worked OOT impact example

A balance used for in-process weight checks is found, as-found, reading 0.5 g high at the 100 g point against OIML E2 weights. Tolerance was ±0.1 g. Last good calibration was four months ago.

  • Affected window: four months of in-process checks made on that balance.
  • Direction and magnitude: reads 0.5 g high, so true weights were actually 0.5 g lower than recorded at that point.
  • Impact logic: the in-process limit was 95.0 to 105.0 g. A recorded value of 100.0 g was truly 99.5 g, still inside the limit. But any batch recorded near the lower edge, say 95.2 g, was truly about 94.7 g, below the limit. So you screen the four months of records for any value within 0.5 g of the lower limit, and those batches go to formal evaluation; the rest can be justified as not impacted with the corrected numbers shown.

That is the level of specificity an inspector wants. “We assessed impact and found none” without the arithmetic is not an assessment.

The impact-assessment decision, as a flow

The same logic applies to any out-of-tolerance instrument. Work it one affected record at a time:

Instrument found out of tolerance (as-found error exceeds the limit at any point)
↓
Confirm the OOT is real (re-measure; rule out wrong standard, bad connection, not stabilized), capture as-found, open a deviation
Define the affected window: from the last known-good calibration to now, and the magnitude and direction of error
↓
For each affected batch/result: could the corrected value have crossed a specification or in-process limit?
No, even at worst case the corrected value stays inside all limits
↓
Document as not impacted, showing the corrected numbers; no OOS needed for that record
Yes, or the record sits within the error magnitude of a limit
↓
Formal evaluation with QA; open an OOS/recall assessment where a released result is implicated; disposition the batch

The direction of the error is not a detail. A thermocouple reading high makes a sterilization cycle run cold, which threatens sterility; reading low makes it run hot, which threatens product stability. Screen the affected window against the direction that is bad for that specific process.

Acceptance criteria for OOT handling

As-found is always captured before adjustment; every critical OOT raises a deviation; the affected window runs from last known-good; impact is quantified with actual error magnitude and direction against process limits; affected product is dispositioned with QA; and root cause feeds back into intervals or device selection.


Instrument classification and exclusions

Not every device gets the same treatment, but the line has to be drawn on documented criteria.

  • Critical (GMP) instruments: directly affect product quality, patient safety, or the integrity of release/GMP data. Full program: tolerance, interval, traceable standards, OOT handling.
  • Non-critical / GMP-indicating: used in GMP areas but not making quality decisions (a hallway thermometer for comfort, an indicating-only gauge). Lighter handling, often a verification rather than full calibration, but still controlled.
  • Reference-only / “not for GMP use”: explicitly labeled so no one uses them for GMP decisions. These must be clearly identified, because using an uncalibrated “reference only” gauge to make a real decision is a finding.

Document the classification rationale per instrument. An inspector will pick a device and ask, “why is this non-critical?” and “calibration is not required” is not an answer; “it does not measure a process parameter and is labeled indication-only, per criterion X in SOP-YYY” is.


Roles and responsibilities

RoleResponsibility
Metrology / calibration technicianPerforms calibrations per procedure, records as-found and as-left, tags OOT, maintains standards.
Metrology / calibration leadOwns the master list and schedule, sets and adjusts intervals, manages standards traceability, ensures TAR/TUR is met.
Equipment / system owner (SME)Defines the process requirement that drives the tolerance, confirms criticality, supports impact assessment.
QAApproves the program SOP and tolerances, reviews calibration records, dispositions product affected by OOT, approves deviations and CAPAs.
Manufacturing / lab userUses only in-date instruments, checks the calibration label/status before use, reports suspect readings.
External calibration vendorPerforms accredited calibrations of standards (and sometimes field instruments) under ISO/IEC 17025, provides certificates with uncertainty. Must be qualified as a supplier.

The vendor relationship matters more than people expect. If a third party calibrates your standards or instruments, they are a GMP supplier and need qualification and oversight, including review of their accreditation scope. See supplier and vendor qualification and conducting a supplier audit.


Common mistakes and inspection-finding patterns

These are the patterns that show up repeatedly in regulatory observations and audits. No company names, just the shapes.

  • Overdue calibrations with the instrument still in use. The schedule lapsed and nobody pulled the device. The single most common finding. Fix: hard out-of-service rule and a visible due-date tracker.
  • No as-found data. Records show only “pass” or only post-adjustment values, so OOT impact can never be assessed. Fix: mandate numeric as-found before any adjustment.
  • Tolerance equal to or looser than the process requirement. The instrument tolerance consumes the entire process margin, leaving none for control variation. Fix: derive tolerance with margin retained.
  • Standard accuracy not justified (no TAR/TUR). Calibrating a ±0.1 instrument with a ±0.1 standard. Fix: enforce and document the 4:1 ratio or justify lower.
  • Broken traceability. A working standard used after its own due date, or a standard with no certificate. Fix: track standards inside the program with tighter intervals.
  • OOT handled as a maintenance ticket, not a deviation. The quality system never sees it; no product impact assessment is done. Fix: route every critical OOT through deviation management.
  • Mismatched tolerances across documents. The master list, the procedure, and the certificate disagree. Fix: single source of truth and periodic reconciliation.
  • Vendor certificates accepted without review. Certificate lacks uncertainty, lists no standards, or the vendor’s accreditation scope does not cover the measurement. Fix: define what a certificate must contain and review on receipt.
  • Data integrity gaps in electronic calibration tools. Calibration management software or handheld documenting calibrators without audit trails, shared logins, or editable as-found values. The same ALCOA+ expectations apply to calibration data. See data integrity foundations and audit trail design and review.
  • No measurement uncertainty statement or minimum weight on file for a critical balance. The balance passes its calibration, but nobody can show the uncertainty budget behind that pass or the smallest sample the balance can weigh at the needed accuracy. Fix: build and post the budget and the minimum weight per the revised USP <41>/<1251>, and tie both to the balance’s own current repeatability.
  • A sample weighed below a balance’s own minimum weight. A method or batch record calls for a weight the balance cannot support at the required relative accuracy, and nobody checked. Fix: post the minimum weight at the balance and build it into method qualification.
  • Calibration vendor’s accreditation scope and edition never re-verified. The purchase order from years ago is on file, but nobody has confirmed the vendor’s current ISO/IEC 17025 scope still covers the parameter being calibrated, or which edition of the standard the vendor’s accreditation is transitioning under. Fix: re-verify scope and edition at each vendor requalification, not only at initial qualification.

How calibration ties into qualification and the wider quality system

Calibration is foundational to equipment qualification. You cannot run an IQ/OQ that relies on instrument readings if those instruments are not calibrated and traceable. A temperature mapping study, a pressure hold, an OQ challenge, all of them are only as valid as the calibration of the sensors used. This is why calibration status is a standard prerequisite check in qualification protocols.

Closely related reading:


Interview-ready: questions and strong answers

Q: What does 21 CFR 211.160(b)(4) require for calibration? A written program with specific directions, schedules, limits for accuracy and precision, and provisions for remedial action when those limits are not met. The four pillars: procedure, schedule, tolerances, and OOT remedial action.

Q: What is the difference between as-found and as-left, and why does it matter? As-found is the error before any adjustment; as-left is the error after. As-found tells you whether the data the instrument produced since the last calibration is trustworthy, which is the input to product impact assessment. If you adjust first, you destroy the ability to assess impact. As-found is captured before touching the instrument.

Q: What does NIST traceable actually mean? Metrological traceability: an unbroken, documented chain of calibrations, each with a stated measurement uncertainty, from your working instrument back to a national or international standard. Each link has a certificate and a due date, and the standards near the top are calibrated by an ISO/IEC 17025 accredited lab.

Q: How do you set a calibration tolerance? Start from the process requirement, the tightest real need. Set the instrument tolerance tighter than that, retaining margin so instrument error plus control variation still fits the validated band. Then confirm the reference standard is at least four times more accurate (4:1 TAR, or a justified TUR), so the standard itself is not eating your margin.

Q: An RTD on a sterilizer comes back out of tolerance reading 2 °C high. Walk me through it. Tag it out of service, confirm the OOT is real, capture as-found, open a deviation. The affected window is from the last good calibration to now. Reading high means cycles ran 2 °C cooler than recorded, which is the conservative-bad direction for sterility, so I assess every sterilization cycle in that window against the validated Fo / temperature requirement, with QA, to decide if sterility assurance was met. Root cause the drift, shorten the interval or replace the sensor if systemic, and disposition affected loads.

Q: How do you justify a calibration interval? Tie it to criticality, manufacturer data, duty severity, and the instrument’s own as-found history. Start conservative, then extend on sustained good performance or shorten on OOT, using as-found trend data, consistent with ILAC G24 / OIML D 10. The interval is documented and justified, not just a default twelve months.

Q: What is the 4:1 rule? Test Accuracy Ratio: the reference standard should be at least four times more accurate than the tolerance of the instrument being calibrated, so the standard’s own error is negligible in the pass/fail decision. Where 4:1 is not achievable, use a Test Uncertainty Ratio with full uncertainty and apply guard-banding, and document it.

Q: Why is calibration a data integrity issue, not just an engineering one? Because the instrument produces GMP records. If it is uncalibrated, untraceable, or out of tolerance, every value it generated is suspect, which is a data integrity and product quality problem at once. And the calibration records themselves must meet ALCOA+: attributable, legible, contemporaneous, original, accurate, plus complete, consistent, enduring, and available.

Q: Walk me through how you would build a measurement uncertainty budget for an analytical balance. Collect the real contributors: repeatability from ten replicate weighings of a check weight near the operating load, the reference weight’s own certificate uncertainty divided by its coverage factor, the balance’s linearity specification treated as a rectangular distribution, and the display resolution treated the same way. Square each, sum the squares, take the square root for the combined standard uncertainty, then multiply by a coverage factor of 2 for roughly 95 percent confidence. That is the expanded uncertainty you report, and the same repeatability number also drives the minimum weight calculation.

Q: What changed in the 2026 USP <41>/<1251> revision and why does it matter? The chapters shift the working requirement from a pass/fail calibration tolerance alone toward a documented measurement uncertainty for the balance and a minimum sample weight derived from its own repeatability, effective 1 February 2026. It matters because a balance can be perfectly in calibration and still produce an unreliable result if the sample weighed on it is too small for that balance’s repeatability; the revision makes labs prove they checked for that, instead of assuming the display resolution is the limit.

Q: Why use a coverage factor of 2 instead of some other number? A coverage factor of 2 approximates a 95 percent confidence interval for a normal distribution with reasonably large effective degrees of freedom, which is the standard convention in the Guide to the Expression of Uncertainty in Measurement and in ISO/IEC 17025. It is a convention, not a law of physics, so state it explicitly in the record rather than assuming the reader knows which factor you used.


Practical tips

  • Print the next-due date on the physical calibration label and make “check the label before use” part of operator training. Most overdue-in-use findings die here.
  • Build a “due in 30 days” report and a hard overdue out-of-service rule into the calibration management system, not into a person’s memory.
  • Always record numeric as-found, even when it passes. That data is what lets you manage intervals and assess impact later.
  • Keep standards on a tighter interval than the instruments they calibrate, and audit standards traceability periodically. One expired standard can invalidate dozens of calibrations.
  • When you set a tolerance, write down the process requirement it came from in the same record. Two years later, nobody will remember why it is ±0.5 °C, and an inspector will ask.
  • Treat the calibration vendor like the GMP supplier they are: review accreditation scope, confirm certificates carry uncertainty and standards used, and re-qualify periodically.
  • Trend as-found errors by instrument. A device creeping toward its limit over three cycles is telling you the interval is too long before it ever goes OOT.
  • Post the minimum weight physically at every balance that has one, not only in the validation file. An analyst standing at the bench with a small aliquot needs that number in front of them, not in a binder down the hall.
  • Track your calibration vendors’ ISO/IEC 17025 accreditation edition and scope the same way you track their certificates. The 2017-to-2025 transition runs through September 2028, and a vendor can slip editions mid-contract without telling you unless you ask.
Use madhadi.com as an app Full screen, works offline, one tap from your home screen.