Validation and Estimation

The Netstream meter data management (MDM) system is used to provide a common repository and point of management and access to meter data collected from disparate metering systems. Additionally, Netstream MDM also makes an effort to scrutinise the data collected from the various metering systems and provide a validating, editing, and estimating (VEE) capability. Additionally, Netstream MDM provides functionality involving the tracking of end device controls (such as remote disconnect and reconnect) and end device events.

An example of the VEE process is shown below (starting from the meter readings screen and Interval Readings tab). Note that the quality flags for these interval readings indicate Actual readings and that some have passed the VEE validation checks.

Validation is performed automatically by Netstream as new readings are acquired. No user action is necessary to commence validating readings. The validation process works on whole days only. Consequently, any readings for the current day will not be validated until after midnight.

Validation and estimation algorithms used in Netstream

The validation algorithms Netstream uses are mostly specified in Metrology Procedure: Part B Metering Data Validation, Substitution And Estimation published by the Australian Energy Market Operator (AEMO). Netstream uses additional algorithms over and above those specified by AEMO where it is considered appropiate or more likely to impute values closer to the actual readings.

In the following table, the Type and Section refer to the corresponding part of Metrology Procedure: Part B. Algorithms that appear below but are not mentioned in Metrology Procedure: Part B could be considered type 16, 'Agreed'.

Algorithm	Type	Section	Description
Like Day	14	3.3.4	Like day
Average Like Day	15	3.3.5	Takes the average value for the same time period over the previous four weeks at the equivalent time and date.
Linear Interpolation	17	3.3.7	Linear interpolation of cumulative readings where data gap is at most two hours.
Monotonic	N/A	5.2	Checks applicable to cumulative readings.
GESD	N/A	N/A	Generalised Extreme Studentised Deviate. Refer to this NIST document for further information on Generalised ESD.
Correlation	N/A	N/A	Similar to Like Day except the day in question is correlated against many previous days to find the one whose readings most closely resemble this one.