sensortoolkit.qc._duplicate_removal.remove_duplicates

remove_duplicates(full_df, agg_numeric_by='mean', agg_object_by='first', **kwargs)[source]

Locate and remove duplicate timestamp entries if present in passed dataframe.

Note that this module does not remove duplicate concentration values, only searches for duplicated index (assume time-like) values.

Parameters

full_df (pandas dataframe) – Sensor dataframe at recorded sampling frequency.

Returns

Modified sensor dataframe at recorded sampling frequency with duplicated timestamps removed.

Return type

full_df (pandas dataframe)