Link Search Menu Expand Document Documentation Menu
Documentation

otel_trace_group

The otel_trace_group processor completes missing trace-group-related fields in the collection of span records by looking up the OpenSearch backend. The otel_trace_group processor identifies the missing trace group information for a spanId by looking up the relevant fields in its root span stored in OpenSearch.

OpenSearch

When you connect to an OpenSearch cluster using your username and password, use the following example pipeline.yaml file to configure the otel_trace_group processor:

pipeline:
  ...
  processor:
    - otel_trace_group:
        hosts: ["https://localhost:9200"]
        cert: path/to/cert
        username: YOUR_USERNAME_HERE
        password: YOUR_PASSWORD_HERE

See OpenSearch security for a more detailed explanation of which OpenSearch credentials and permissions are required and how to configure those credentials for the OTel trace group processor.

Amazon OpenSearch Service

When you use Amazon OpenSearch Service, use the following example pipeline.yaml file to configure the otel_trace_group processor:

pipeline:
  ...
  processor:
    - otel_trace_group:
        hosts: ["https://your-amazon-opensearch-service-endpoint"]
        aws_sigv4: true
        cert: path/to/cert
        insecure: false

Configuration

You can configure the otel_trace_group processor with the following options.

Name Description Default value
hosts A list of IP addresses of OpenSearch nodes. Required. No default value.
cert A certificate authority (CA) certificate that is PEM encoded. Accepts both .pem or .crt. This enables the client to trust the CA that has signed the certificate that OpenSearch is using. null
aws_sigv4 A Boolean flag used to sign the HTTP request with AWS credentials. Only applies to Amazon OpenSearch Service. See OpenSearch security for details. false.
aws_region A string that represents the AWS Region of the Amazon OpenSearch Service domain, for example, us-west-2. Only applies to Amazon OpenSearch Service. us-east-1
aws_sts_role_arn An AWS Identity and Access Management (IAM) role that the sink plugin assumes to sign the request to Amazon OpenSearch Service. If not provided, the plugin uses the default credentials. null
aws_sts_header_overrides A map of header overrides that the IAM role assumes for the sink plugin. null
insecure A Boolean flag used to turn off SSL certificate verification. If set to true, CA certificate verification is turned off and insecure HTTP requests are sent. false
username A string that contains the username and is used in the internal users YAML configuration file of your OpenSearch cluster. null
password A string that contains the password and is used in the internal users YAML configuration file of your OpenSearch cluster. null

Configuration option examples

You can define the configuration option values in the aws_sts_header_overrides option. See the following example:

aws_sts_header_overrides:
  x-my-custom-header-1: my-custom-value-1
  x-my-custom-header-2: my-custom-value-2

Metrics

The following table describes custom metrics specific to the otel_trace_group processor.

Metric name Type Description
recordsInMissingTraceGroup Counter The number of ingress records missing trace group fields.
recordsOutFixedTraceGroup Counter The number of egress records with successfully completed trace group fields.
recordsOutMissingTraceGroup Counter The number of egress records missing trace group fields.
350 characters left

Have a question? .

Want to contribute? or .