InstrumentRemoveEpochsByCriteria
This program removes epochs from inputfileInstrument by evaluating a set of removalCriteria expressions. For the data columns the standard data variables are available, see dataVariables.
The instrument data can be reduced by data from inputfileInstrumentReference prior to evaluation of the expressions.
To reduce the data by its median, use an expression like data1-data1mean.
To remove epochs that deviate by more than 3 sigma use abs(data1)>3*data1std
or abs(data0-data0median)>3*1.4826*data0mad.
All arcs in the input instrument file are concatenated, meaning expressions
like data1mean refer to the complete dataset. The removed epochs can be saved
in a separate outputfileInstrumentRemovedEpochs.
| Name | Type | Annotation |
|---|---|---|
outputfileInstrument | filename | all data is stored in one arc |
outputfileInstrumentRemovedEpochs | filename | all data is stored in one arc |
inputfileInstrument | filename | arcs are concatenated for processing |
inputfileInstrumentReference | filename | if given, the reference data is reduced prior to the expressions being evaluated |
removalCriteria | expression | epochs are removed if one criterion evaluates true. data0 is the first data field. |
margin | double | remove data around identified epochs (on both sides) [seconds] |