Configuration
The ADX loads configuration data from a file (typically backed by a Kubernetes config map). The location of the configuration file is sourced from an environment variable. If the service is unable to retrieve the configuration data, it will not start. Refer to the configuration for details.
Service configuration structure
The recommended configuration format is YAML. The below sections describe the officially supported configuration options that influence various aspects of the service functionality. The service may support options other than the ones listed below, but those are not a part of the public API and may be changed or deleted at any time.
General
ADX uses its service instance name and replica ID for communication with other services and load balancing across replicas (for example, see 3/ISM). You can control the values with the following configuration options:
service:
instance:
name: <string> # Service instance name, should be unique cluster-wide. "adx" by default.
replica.id: <string> # Service instance replica ID, should be unique cluster-wide. Random string by default.
graceful-shutdown: <uint> # Allowed service graceful shutdown period in seconds. 30 seconds by default.
Response format
By default, the service responds with the attribute JSON value verbatim as found in ADX configuration by the query path. But you can also configure ADX to wrap the response as a JSON record with the query path used as the key:
service:
wrap-response: <boolean> # Enables wrapping response, false by default
Let’s take a look at an example.
Assume that the we have the following request:
{
"q": "attributeA"
}
Let us also assume that the configuration is as follows:
{
"attributeA": "valueA",
"attributeB": "valueB"
}
If you enable the service.wrap-response
option, the response of the service will be as follows:
{"attributeA":"valueA"}
Tekton
ADX requires application and appversion configuration data from Kaa Tekton. The below configuration options set up the integration interface.
kaa:
tekton:
enabled: <boolean> # Enables Tekton integration. False by default. Also can be set with the KAA_TEKTON_ENABLED environment variable.
url: <string> # URL of the Tekton service. "http://tekton" by default. Also can be set with the KAA_TEKTON_URL environment variable.
scmp.consumer:
provider.service-instance-name: <string> # Service instance name of the Tekton service. "tekton" by default.
queue-length: <uint> # Maximum queue length for 17/SCMP messages from Tekton. 256 by default.
For the Tekton integration to function, there must be no
kaa.applications
key in the configuration file. Such configuration, when present, takes precedence over the Tekton-supplied application-specific configs.
NATS
The below parameters configure ADX’s connection to NATS broker, as well as the NATS message adapters used by ADX. Note that for security reasons NATS username and password are sourced from the environment variables.
nats:
urls: <comma separated list of URL> # NATS connection URLs
kaa:
esp.server:
concurrency: <uint> # Number of concurrent workers to read messages from communication service. 16 by default.
queue-length: <uint> # The maximum amount of messages in the ESP server queue. When the queue is full, new messages will be dropped. 64 * `kaa.esp.server.concurrency` by default.
dstp.transmitter:
concurrency: <uint> # Number of concurrent workers to read messages from data receivers. 16 by default.
queue-length: <uint> # The maximum amount of messages in the DSTP transmitter queue. When the queue is full, new messages will be dropped. 64 * `kaa.dstp.transmitter.concurrency` by default.
Consider configuring concurrency options to at least match the number of CPUs available on your infrastructure.
Authentication, authorization, and multi-tenancy
ADX supports two integrations for security:
- OAuth2 protocol with a UMA profile. Enabled when
kaa.security.enabled
istrue
andkaa.security.iamcore.enabled
isfalse
. - iamcore. Enabled when both
kaa.security.enabled
andkaa.security.iamcore.enabled
aretrue
.
OAuth2 with UMA profile
Authentication and authorization is handled within the scope of a given Kaa tenant. Each tenant has a separate OAuth 2.0 issuer, managed by the Kaa Tenant Manager. When multi-tenancy is disabled, all authentication and authorization is conducted in the default system tenant (“kaa”).
ADX OAuth2 with UMA profile security is controlled with the following configuration options (for security reasons it is advised to set these via environment variables).
kaa:
security:
enabled: <boolean> # Enables authentication and authorization. False by default.
issuer:
public-url: <string> # OAuth 2.0 issuer public URL for the system tenant ("kaa").
private-url: <string> # OAuth 2.0 issuer private URL for the system tenant ("kaa").
client-id: <string> # Client ID for making requests in the system tenant scope.
client-secret: <string> # Client secret for making requests in the system tenant scope.
multitenancy:
enabled: <boolean> # Enables multitenancy via integration with the Kaa Tenant Manager. Only effective when kaa.security.enabled is set to true. False by default.
tenant-manager:
url: <string> # URL of the Kaa Tenant Manager that provides security configurations for tenants. "http://tenant-manager" by default.
iamcore
Authentication and authorization is handled by iamcore.
ADX iamcore security is controlled with the following configuration options (for security reasons it is advised to set these via environment variables).
kaa:
security:
enabled: <boolean> # Enables authentication and authorization. False by default.
iamcore:
enabled: <boolean> # Enables iamcore integration. False by default.
api-key: <string> # iamcore API KEY
url: <string> # iamcore server URL. "https://cloud.iamcore.io" by default.
application: <string> # iamcore application. "kaa" by default
Monitoring
To control the ADX management interface, use the following configuration options.
service.monitoring:
disabled: <boolean> # Disables the monitoring interface entirely. False by default.
port: <uint> # TCP port to expose the monitoring server on. 8080 by default.
Logging
ADX writes logs to stdout
.
By default, the service only produces logs at startup, shutdown, or in case of errors.
To enable debug level logging, use the following option:
service:
debug: <boolean> # Enables debug level logging, false by default
Keep in mind that enabling debug level logging will produce significantly more log output and degrade the service performance.
Default configuration
Summarizing the above, the default ADX configuration is as follows. Note that no Kaa applications are defined by default—you have to configure those for any specific Kaa-based solution.
service:
instance:
name: "adx"
replica.id: "<random string generated on boot>"
monitoring:
disabled: false
port: 8080
graceful-shutdown: 30 # seconds
kaa:
esp.server:
concurrency: 16
queue-length: 1024
applications: # none
nats:
urls: nats://nats:4222