Overview

Endpoint Time Series service (EPTS) is a Kaa service that receives endpoint data samples and transforms them into time series. EPTS broadcasts the new data points through the time series transmission interface and provides API for historical time series retrieval. EPTS also acts as a time series receiver, so it can ingest and save time series from other transmitters.

Endpoint data sample is a piece of endpoint-related data of an arbitrary structure.

Data point is a data structure consisting of:

  • a timestamp
  • a value
  • optional key-value tags

Data point value and tags can be of an arbitrary primitive or a composite data type.

Endpoint time series (time series) is a uniquely named series of endpoint-related data points.

Data processing flow

Data processing flow

Ingestion

EPTS receives endpoint data samples through the data sample transmission interface. For more information on how you can configure the service instance name of the data transmitter, see Data transmitter configuration.

Extraction

EPTS extracts data samples received on the ingestion phase and represents them as internal raw data points using the extraction configuration specific to the application version.

Time series matching

EPTS matches the raw data points obtained during the extraction phase to the configured time series.

Persistence

EPTS stores time series data in the Cassandra database.

Broadcasting

As a result of time series matching phase, EPTS broadcasts the endpoint time series events using the time series transmission interface.

Retrieval (optional)

Historical time series interface allows querying EPTS for historical time series data points.

Interfaces

EPTS supports a number of interfaces to perform its functional role. The key supported interfaces are summarized in the following diagram.

EPTS interfaces diagram

For inter-service communication, Kaa services mainly use REST APIs and messaging protocols that run over NATS messaging system.

Data sample transmission

EPTS supports 13/DSTP and acts as a data sample receiver service by subscribing to data transmitters. See the configuration page for information on how to configure this interface.

Time series transmission

EPTS supports 14/TSTP and acts as a time series receiver by subscribing to data transmitters as well as a time series transmitter to subscribers. See the configuration page for information on how to configure this interfaces.

Historical time series

EPTS exposes REST API for retrieving historical time series data.