ufzLogo rdmLogo

Test Functions#

Basic Anomalies#

flagMissing

Deprecated since version 2.7.0.

flagIsolated

Flag groups of data that are surrounded by data gaps.

flagJumps

Flag jumps and drops in data.

flagConstants

Flag constant data values.

flagByVariance

Flag low-variance data.

flagPlateau

Flag ofsetted groups of data..

Change Points and Noise#

flagChangePoints

Flag values that represent a system state transition.

assignChangePointCluster

Label data where it changes significantly.

flagByScatterLowpass

Flag data noisy data.

Gap filling#

interpolateByRolling

Impute NAN with aggregation of context.

Multivariate Analysis#

Multivariate outlier detection.

flagLOF

Local Outlier Factor.

flagZScore

Scattering (ZScoring) based outlier detection.

Sampling Alignment#

align

Resample data and flags at uniform frequency.

concatFlags

Resample a variables flags and append them to another variables flags.

resample

Sample data at uniform sampling rate.

reindex

Resample data at new index.

Data Products#

assignKNNScore

K nearest neighbor scoring.

assignLOF

Assign Local Outlier Factor (LOF).

assignUniLOF

Univariate outlier scoring, based on LOF.

assignZScore

Calculate (rolling) Zscores.

calculatePolynomialResiduals

Residuals from polynomial fit.

calculateRollingResiduals

Residuals from sliding window fit.

fitPolynomial

Fit a polynomial model to the data.

fitLowpassFilter

Filter and smooth data with Butterworth filter.

Drift detection and correction#

flagDriftFromNorm

Flags Deviation from central moment.

flagDriftFromReference

Flags data that deviates from a reference.

correctDrift

Correct model defined drifts.

correctRegimeAnomaly

Regimen wise model fitting.

correctOffset

Correct offsets to normal value level.

flagRegimeAnomaly

Flags anomalous regimes regarding to modelling regimes of field.

assignRegimeAnomaly

A function to detect values belonging to an anomalous regime regarding modelling regimes of field.

Flagtools#

forceFlags(field[, flag])

Assign specific flag to all periods.

clearFlags(field, **kwargs)

Assign UNFLAGGED to all periods.

flagUnflagged(field[, flag])

Assign flag to all UNFLAGGED periods.

flagDummy(field, **kwargs)

Pass on data and flags.

transferFlags(field, target[, squeeze, ...])

Transfer flags between variables.

andGroup(field[, group, target, flag])

Combine flags via AND operation.

orGroup(field[, group, target, flag])

Combine flags via OR operation.

Generic Functions#

processGeneric

Apply custom transformation.

flagGeneric

Apply custom flagging rule.

andGroup

Combine flags via AND operation.

orGroup

Combine flags via OR operation.

Outlier Detection#

Univariate Outlier Detection

flagUniLOF

Univariate outlier detection, based on LOF.

flagByStray

Flag outliers with the STRAY Algorithm.

flagOffset

Flag offsetted groups of values.

flagRange

Flag values that exceed fixed bound.

flagLOF

Local Outlier Factor.

flagZScore

Scattering (ZScoring) based outlier detection.

flagPlateau

Flag ofsetted groups of data..

Tools#

copyField

Copy data and flags.

dropField

Drop field.

renameField

Rename field.

selectTime

Apply a mask.

plot

Generate plots.