Contents

Overview

In Helidon 4 all observability features were moved to one logical module: observe. The observability support groups all observe endpoints together under a single context root (the default behavior) /observe.

Maven Coordinates

To enable Helidon Observability, add the following dependency to your project’s pom.xml (see Managing Dependencies).

<dependency>
    <groupId>io.helidon.webserver.observe</groupId>
    <artifactId>helidon-webserver-observe</artifactId>
</dependency>
Copied

For Health Observability features:

<dependency>
    <groupId>io.helidon.webserver.observe</groupId>
    <artifactId>helidon-webserver-observe-health</artifactId>
</dependency>
Copied

For Metrics Observability features:

<dependency>
    <groupId>io.helidon.webserver.observe</groupId>
    <artifactId>helidon-webserver-observe-metrics</artifactId>
</dependency>
Copied

For Info Observability features:

<dependency>
    <groupId>io.helidon.webserver.observe</groupId>
    <artifactId>helidon-webserver-observe-info</artifactId>
</dependency>
Copied

For Logging Observability features:

<dependency>
    <groupId>io.helidon.webserver.observe</groupId>
    <artifactId>helidon-webserver-observe-log</artifactId>
</dependency>
Copied

For Configuration Observability features:

<dependency>
    <groupId>io.helidon.webserver.observe</groupId>
    <artifactId>helidon-webserver-observe-config</artifactId>
</dependency>
Copied

Usage

Each provider usually adds a new endpoint (such as health, metrics). This is to have a single easily configurable path for security, proxy etc. purposes, rather than expose multiple "root" endpoints that may collide with the business code.

Discovery

ObserveProvider instances are discovered using ServiceLoader. In case an explicit Observer is registered with the same type as a provider, the provider will not be used (so we do not duplicate services).

Feature Weight and Endpoint Conflicts

In some ways Helidon treats all types of observers as a single observability feature. In particular, you can use configuration to control the weight of the various Helidon features, and the weight prescribes the order in which Helidon handles routing for those features.

The Helidon-provided feature for processing your application endpoints has weight 100 by default, and the observability feature has default weight 80. This means that Helidon normally prioritizes routing for your application endpoints over the endpoints for the observers such as metrics and health.

This can have unexpected results if your application declares a resource path /{name}. Because Helidon normally prioritizes the routing of your endpoints, Helidon routes requests for /metrics and /health to your /{name} endpoint instead of to the actual metrics and health endpoints.

One way to avoid this is to assign a weight from 101 to 200 to the observe feature in your configuration. Then Helidon prioritizes the routing of the observe feature ahead of routing your application endpoints.

Configuration in application.yaml Assigning Feature Weight to Control Routing
server:
  features:
    observe:
      weight: 120
Copied

Helidon does not enforce the weight range 101-200 for observability, but you should use a value in this range for the observe weight to avoid problems with other features such as security, CORS, and others; their relative ordering is important.

Endpoints

The "Observe" service endpoint can be modified on the ObserveFeature that is registered with routing. The feature endpoint defaults to /observe, and all observers are prefixed with it (see further)

Each observer has customizable endpoints as well, and the result is decided as follows: 1. If the custom endpoint is relative, the result would be under observe endpoint (e.g. for health/observe/health) 2. If the custom endpoint is absolute, the result would be absolute as well (e.g. for /health/health)

Configuration Observability

Configuration observability allows reading the current application configuration values. Configuration observability defines the following endpoints:

EndpointMethodAction
/config/profileGETReturns the current configuration profile
/config/valuesGETReturns the current configuration values
/config/values/{name}GETReturns specified by name configuration value

All secrets and passwords are obfuscated with "*" characters.

Health Observability

Health observability allows reading application readiness to serve requests, whether the services are alive. Health observability defines the following endpoints:

EndpointMethodAction
/health/readyGETReturns Service Readiness
/health/liveGETReturns whether the service is alive
/health/startedGETReturns whether the service is started
/health/ready/{name}GETReturns Service name Readiness
/health/live/{name}GETReturns whether the service name is alive
/health/started/{name}GETReturns whether the service name is started
/health/check/{name}GETReturns all checks for service name
/health/readyHEADReturns Service Readiness without details
/health/liveHEADReturns whether the service is alive without details
/health/startedHEADReturns whether the service is started without details
/health/ready/{name}HEADReturns Service name Readiness without details
/health/live/{name}HEADReturns whether the service name is alive without details
/health/started/{name}HEADReturns whether the service name is started without details
/health/check/{name}HEADReturns all checks for service name without details

For more information, please, check Health documentation.

Information Observability

Info observability allows configuration of custom properties to be available to users. Information observability defines the following endpoints:

EndpointMethodAction
/infoGETReturns the Application information
/info/{name}GETReturns the Application information for the specified name

Logger Observability

Log observability allows reading and configuring of log levels of various loggers and reading log messages. Logger Observability defines the following endpoints:

EndpointMethodAction
/logGETStream logs (if enabled)
/log/loggersGETReturns all logger handlers
/log/log/loggers/{logger}GETReturns the Logger by name logger
/log/loggers/{logger}POSTSet Logger level by name logger
/log/loggers/{logger}DELETEUnset the specified logger logger

Metrics Observability

Helidon distinguishes among three general types, or scopes, of metrics.

Types (scopes) of metrics
Type/scopeTypical Usage
baseOS or Java runtime measurements (available heap, disk space, etc.).
vendorImplemented by vendors, including the REST.request metrics and other key performance indicator measurements.
applicationDeclared via annotations or programmatically registered by your service code.

When you add the metrics dependency to your project, Helidon automatically provides a built-in REST endpoint /observe/metrics which responds with a report of the registered metrics and their values.

Clients can request a particular output format.

Formats for /observe/metrics output
FormatRequested by
OpenMetrics (Prometheus)default (text/plain)
JSONHeader Accept: application/json

Clients can also limit the report by appending the metric type to the path:

  • /observe/metrics/base

  • /observe/metrics/vendor

  • /observe/metrics/application

For more information see Metrics documentation.

Configuration

To customize the endpoint of an observer:

  1. Configure a custom endpoint through configuration to modify the ObserveProvider setup (such as server.features.observe.health.endpoint)
  2. Configure a custom endpoint through a builder on the specific Observer (HealthObserver.builder().endpoint("myhealth"))

To control the observability features as a whole, add config settings under server.features.observe.

Configuration options

KeyKindTypeDefault ValueDescription
enabledVALUEBooleantrueWhether the observe support is enabled
endpointVALUEString/observeRoot endpoint to use for observe providers
observersLISTi.h.w.o.s.Observer Observers to use with this observe features
observers-discover-servicesVALUEBooleantrueWhether to enable automatic service discovery for observers
socketsLISTString Sockets the observability endpoint should be exposed on
weightVALUEDouble80.0Change the weight of this feature

Deprecated Options

KeyKindTypeDescription
corsVALUEi.h.c.CrossOriginConfigCors support inherited by each observe provider, unless explicitly configured

Additional Information

The Observability features are now implemented with HttpFeature and can be registered with HttpRouting.Builder#addFeature(java.util.function.Supplier). Such a feature encapsulates a set of endpoints, services and/or filters.

Feature is similar to HttpService but gives more freedom in setup. Main difference is that a feature can add Filter filters and it cannot be registered on a path (that is left to the discretion of the feature developer).

  • Features are not registered immediately - each feature can define a Weight or implement Weighted to order features according to their weight. Higher weighted features are registered first.

  • This is to allow ordering of features in a meaningful way (e.g. Context should be first, Tracing second, Security third etc).

Reference