Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[containerd] Enable TSDB #8954

Merged
merged 3 commits into from
Jan 24, 2024
Merged

[containerd] Enable TSDB #8954

merged 3 commits into from
Jan 24, 2024

Conversation

gpop63
Copy link
Contributor

@gpop63 gpop63 commented Jan 23, 2024

Proposed commit message

Enables TSDB for metrics data streams.

TSDB tests:

memory

Testing data stream metrics-containerd.memory-default.
Index being used for the documents is .ds-metrics-containerd.memory-default-2024.01.23-000001.
Index being used for the settings and mappings is .ds-metrics-containerd.memory-default-2024.01.23-000001.

The time series fields for the TSDB index are: 
        - dimension (10 fields):
                - agent.id
                - cloud.account.id
                - cloud.availability_zone
                - cloud.instance.id
                - cloud.provider
                - cloud.region
                - container.id
                - containerd.namespace
                - host.name
                - service.address
        - counter (3 fields):
                - containerd.memory.kernel.fail.count
                - containerd.memory.swap.fail.count
                - containerd.memory.usage.fail.count
        - gauge (16 fields):
                - container.memory.usage
                - containerd.memory.activeFiles
                - containerd.memory.cache
                - containerd.memory.inactiveFiles
                - containerd.memory.kernel.limit
                - containerd.memory.kernel.max
                - containerd.memory.kernel.total
                - containerd.memory.rss
                - containerd.memory.swap.limit
                - containerd.memory.swap.max
                - containerd.memory.swap.total
                - containerd.memory.usage.limit
                - containerd.memory.usage.max
                - containerd.memory.usage.pct
                - containerd.memory.usage.total
                - containerd.memory.workingset.pct
        - routing_path (10 fields):
                - agent.id
                - cloud.account.id
                - cloud.availability_zone
                - cloud.instance.id
                - cloud.provider
                - cloud.region
                - container.id
                - containerd.namespace
                - host.name
                - service.address

Index tsdb-index-enabled successfully created.

Copying documents from .ds-metrics-containerd.memory-default-2024.01.23-000001 to tsdb-index-enabled...
All 284 documents taken from index .ds-metrics-containerd.memory-default-2024.01.23-000001 were successfully placed to index tsdb-index-enabled.

cpu

Testing data stream metrics-containerd.cpu-default.
Index being used for the documents is .ds-metrics-containerd.cpu-default-2024.01.23-000001.
Index being used for the settings and mappings is .ds-metrics-containerd.cpu-default-2024.01.23-000001.

The time series fields for the TSDB index are: 
        - dimension (10 fields):
                - agent.id
                - cloud.account.id
                - cloud.availability_zone
                - cloud.instance.id
                - cloud.provider
                - cloud.region
                - container.id
                - containerd.namespace
                - host.name
                - service.address
        - gauge (8 fields):
                - container.cpu.usage
                - containerd.cpu.system.total
                - containerd.cpu.usage.kernel.ns
                - containerd.cpu.usage.kernel.pct
                - containerd.cpu.usage.total.ns
                - containerd.cpu.usage.total.pct
                - containerd.cpu.usage.user.ns
                - containerd.cpu.usage.user.pct
        - routing_path (10 fields):
                - agent.id
                - cloud.account.id
                - cloud.availability_zone
                - cloud.instance.id
                - cloud.provider
                - cloud.region
                - container.id
                - containerd.namespace
                - host.name
                - service.address

Index tsdb-index-enabled successfully created.

Copying documents from .ds-metrics-containerd.cpu-default-2024.01.23-000001 to tsdb-index-enabled...
All 435 documents taken from index .ds-metrics-containerd.cpu-default-2024.01.23-000001 were successfully placed to index tsdb-index-enabled.

blkio

Testing data stream metrics-containerd.blkio-default.
Index being used for the documents is .ds-metrics-containerd.blkio-default-2024.01.23-000001.
Index being used for the settings and mappings is .ds-metrics-containerd.blkio-default-2024.01.23-000001.

The time series fields for the TSDB index are: 
        - dimension (11 fields):
                - agent.id
                - cloud.account.id
                - cloud.availability_zone
                - cloud.instance.id
                - cloud.provider
                - cloud.region
                - container.id
                - containerd.blkio.device
                - containerd.namespace
                - host.name
                - service.address
        - counter (2 fields):
                - container.disk.read.bytes
                - container.disk.write.bytes
        - gauge (6 fields):
                - containerd.blkio.read.bytes
                - containerd.blkio.read.ops
                - containerd.blkio.summary.bytes
                - containerd.blkio.summary.ops
                - containerd.blkio.write.bytes
                - containerd.blkio.write.ops
        - routing_path (11 fields):
                - agent.id
                - cloud.account.id
                - cloud.availability_zone
                - cloud.instance.id
                - cloud.provider
                - cloud.region
                - container.id
                - containerd.blkio.device
                - containerd.namespace
                - host.name
                - service.address

Index tsdb-index-enabled successfully created.

Copying documents from .ds-metrics-containerd.blkio-default-2024.01.23-000001 to tsdb-index-enabled...
All 296 documents taken from index .ds-metrics-containerd.blkio-default-2024.01.23-000001 were successfully placed to index tsdb-index-enabled.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

image

@gpop63 gpop63 mentioned this pull request Jan 23, 2024
8 tasks
@gpop63 gpop63 marked this pull request as ready for review January 23, 2024 22:39
@gpop63 gpop63 requested a review from a team as a code owner January 23, 2024 22:39
Co-authored-by: Andrew Gizas <andreas.gkizas@elastic.co>
@elasticmachine
Copy link

💚 Build Succeeded

History

@gpop63 gpop63 merged commit 6719bd9 into elastic:main Jan 24, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[containerd] TSDB Enablement
5 participants