Export Tasks

Various mechanisms are available to get data into and out of Netstream. Export tasks are jobs that take meter readings from Netstream and format them to produce export files. The results are available for download and can be pushed to third parties. Export tasks are optionally scheduled to run at a regular interval - either daily or monthly. When a scheduled export task completes, Netstream automatically updates the date at which each channel of data was sent so that on the next scheduled export you will receive contiguous readings. If, for some reason, meter readings are not available for one or more meters then the export task still executes and sends what it can. If missing readings are subsequently acquired, then they too will be sent on the next export cycle.

Meter data may be delivered to end recipients either by email, FTP (File Transfer protocol), Secure Shell FTP (SFTP) or any combination of these.

Export tasks are displayed under the Import/Export > Export Tasks menu. If you have many tasks the filters may make finding a particular task easier.

To add a new export task click Add above the grid. Refer to How to create an export task for details.
To edit an existing task click .
To remove a task click .
To run a task click and select Run task. Refer to One-off tasks and custom date ranges for details.
To access export files created by a task click and select View archive.

Note:

Depending on your role you may be able to view but not edit a job.

Column Name	Description
Usage Point Group	The set of usage points for export
Task Name	The task name
Task Type	The meter readings type - either load profile or time of use.
File Format	Supported interval data file formats include: SBS and NEM12 v2.5. Supported ToU data file formats include: SBS and NEM13 v1.06.
Schedule	If the task is scheduled will be either Daily or Monthly, otherwise None.
Last Run	Details of the task's most recent execution. Includes a link to the export file if the execution was successful.

How to create an export task

Retail Admin only

Click Add above the grid of export tasks.

Choose a Usage Point Group

Click the name of the group of usage points from which you wish to obtain readings. The search field may aid in quickly finding the desired usage point group.

Step 1 Export Task

Field	Description
Export type	Choose load profile for interval data Time of Use for monthly billing data
Period	Choose day for daily export files or month for monthly exports
Schedule group	Choose daily or monthly as appropriate. If a job is non scheduled then it nevers runs but can be used to make a custom export
Task name	Any name to distinguish this job from others
Enabled	A flag to switch the job off or on. This is useful for temporarily disabling or enabling a job

Click Next to move between steps.

Step 2 Reading Types

Choose the reading types to include in the job. By default, all available reading types are listed.

Step 3 Content Options

Choose the reading types to include in the job. By default, all available reading types are listed.

Various options are displayed according to the desired meter data file format.

Field	Description
File format	The various file formats available are explained here
NEM Participant ID	(NEM format only) The recipient's NEM Participant ID as issued by AEMO
Include Max Demand	(SBS format only) A flag indicating whether to include the maximum demand and time at which the maximum demand was achieved
Include TOU bands	(SBS format only) A flag indicating whether to include ToU tariff bands such as Peak, Shoulder, Off-Peak, etc
Client ID	(Envizi format only) The site's client ID as issued by Envizi

Step 4 Schedule

Optionally schedule the export task to be executed automatically by Netstream at regular intervals. The available schedules are daily and monthly. Export tasks that are not scheduled can be executed by users as described in One-off tasks and custom date ranges.

Step 5 Delivery

Meter data files can be exported either by e-mail, File Transfer protocol (FTP) (RFC 959) or Secure Shell FTP v3 (draft RFC). One or more methods can be used together. Any number of recipients can be specified for each method.

Email recipients must be registered users of Netstream. If you want to send an export file from Netstream to a new user you must first create an account under Admin > User Accounts. Once the user account is created you will then be able to select the user's email address as a recipient of an export.

To push files to an FTP server click the Add button in the FTP section and fill in the FTP server address, user name and password. FTP port 21 is used with no encryption. Anonymous access is not allowed.

Click Done to complete the set-up and save the task. Your task will be visible on the Export Tasks screen.

One-off tasks and custom date ranges

From the menu select Import / Export > Export Tasks and find the task. Click the task's and from the pop-up menu select Run task.
Select the date range of interest and click Next
Select the usage points. By default, all points are selected but you can individually select the ones you need. Click Next.
The file generated by the export task is always archived and made available in Netstream. You may opt to have the same file delivered to any recipients configured for the export task. Click Run. If the request to run the export was generated successfully a green message will appear briefly and the window will be closed.
To see the result of the export task's execution click at the grid's bottom right corner. The grid's details will be updated. A flashing green icon in the Status column indicates the export task is running. When completed, clicking will replace the flashing icon with either a green square (success) or a red square (failure). The export file can be downloaded by clicking on the link in the File Name column.

How to download an archived file

The result of each export task's latest execution is summarised by the details shown under Last Run. If successful, this includes a link to the export file in the File Name column. Any export file generated by Netstream is available for download from the Archive screen.

How to change the recipients of an export job

Click to edit the export task. A step form is displayed.
Click on step 5 - Delivery.
If you require delivery by email ensure the box is selected
Click in the To box and choose the recipients' email addresses
If you require delivery by FTP ensure the box is selected
Click the Add button to add new FTP server credentials. Enter the FTP server's DNS name or IP address, user name and password.
To change existing FTP settings click to edit
To remove an FTP end point click .

File formats

Load Profile NEM12

NEM12 is a Meter Data File Format (MDFF) specification defined by the Australian Energy Market Operator (AEMO) for the exchange of interval data between market participants.

The specification is available from the AEMO website here.

Load Profile SBSLPv2

SBSLPv2 is a simple comma-separated values (CSV) file format suitable for meter interval data. A file consists of one or more records and the format of a record is detailed in the table below.

Column No.	Column Name	Description
1	Usage Point ID	This serves to uniquely identify a usage point. Once assigned, these IDs never change. If this is a market metered point the ID is a National Metering Identifier (NMI) as assigned by AEMO the Australian Electricity Market Operator. For sub-metered points, Netstream assigns its own unique identifiers.
2	Meter S/N	The manufacturer's serial number as stamped on the meter
3	Period end	The date and time at the end of the interval in which the reading was taken
4	Reading type	The type of measurement taken, e.g. 'export energy (kWh)' or 'maximum demand (kVA)' etc
5	Reading	The quantity measured in the interval. Absence of a value indicates a null reading.
6	Unit of measure	The unit of measure, e.g. kWh, kVArh, m3, etc.
7	Reading Quality	Normally this field is absent indicating an actual reading, otherwise, the presence of a flag indicates a power failure during the measurement interval. Quality codes are separated by a vertical bar character '\|' if there is more than one. The most common ones are: 1.4.2 = power failure for part of the interval, and, 1.2.32 = power failure for entire interval

Load Profile SBS Tabular CSV v1

SBS Tabular CSV v1 is a comma-separated values (CSV) file format suitable for meter interval data. A file consists of a two dimensional table. The dimensions are:

Date and time appearing in the first column and being sorted in ascending order from top to bottom

Usage point reading type appearing in the first three rows of the remaining columns. The format of each column heading is as follows.

Row No.	Row Content	Description
1	Usage Point ID	This serves to uniquely identify a usage point. Once assigned, these IDs never change. If this is a market metered point the ID is a National Metering Identifier (NMI) as assigned by AEMO the Australian Electricity Market Operator. For sub-metered points, Netstream assigns its own unique identifiers.
2	Meter S/N	The manufacturer's serial number as stamped on the meter
3	Reading type	The type of measurement taken, e.g. 'export energy (kWh)' or 'maximum demand (kVA)' etc. All reading types must have the same measuring period. For example, they must all be 15 minute interval types or 30 minute interval types

Columns are sorted by Usage Point ID and Reading type in ascending order from left to right.

To find the reading for a particular usage point and reading type at a given date and time

Search the first three rows for the column corresponding to the required usage point and reading type
Search the first column for the row with the desired date and time
The reading appears at the intersection of the column found in step 1 and the row found in step 2

Load Profile Envizi LP

Envizi LP is a comma-separated values (CSV) file format suitable for integrating Netstream with Envizi.

Time of Use NEM13

NEM13 is a Meter Data File Format (MDFF) specification defined by the Australian Energy Market Operator (AEMO) for the exchange of meter readings between market participants.

The specification is available from the AEMO website here.

Time of Use SBSTOUv2

SBSTOUv2 is a simple comma-separated values (CSV) file format suitable for meter billing data. The file format is the same as a Billing Summary report. There is one header row followed by a number of records. The format of a record is detailed below:

Column No.	Column Name	Description
1	Service Location	Property address where the usage point is located.
2	Usage Point Name	A description of the usage point.
3	Usage Point ID	This serves to uniquely identify a usage point. Once assigned, these IDs never change. If this is a market metered point the ID is a National Metering Identifier (NMI) as assigned by AEMO the Australian Electricity Market Operator. For sub-metered points, Netstream assigns its own unique identifiers.
4	Reading Type	The type of measurement taken, e.g. 'export energy (kWh)' or 'maximum demand (kVA)' etc
5	Meter S/N	The manufacturer's serial number as stamped on the meter
6	Readings	The meter readings (see below) for the billing period. These are the total consumption over the period.
7	Rate A	(Optional) Readings (see below) for the billing period for the first time of use rate band (typically called Peak).
8	Rate B	(Optional) Readings (see below) for the billing period for the first time of use rate band (typically called Shoulder).
9	Rate C	(Optional) Readings (see below) for the billing period for the first time of use rate band (typically called Off-Peak).

The rate bands A, B and C are included if the Include Rate Bands option is set. As many rate bands are included as are set up in the meter. For example, if the meter is set up for a Peak/Off-Peak tariff then rate bands A and B will be displayed.

The format of each set of Readings is:

Column No.	Column Name	Description
1	Opening reading	The cumulative meter reading at the start of the billing period in units defined by the Reading Type.
2	Closing reading	The cumulative meter reading at the end of the billing period in units defined by the Reading Type.
3	Consumption	The difference between the closing and opening readings.
4	Max Demand	(Optional) The maximum rate of consumption during the billing period.
5	Time of Max Demand	(Optional) The time at which the maximum demand was achieved.

Maximum Demand is included if the Include Max Demand option is set.