You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This release contains 371 contributions from 38 contributors. We also have 14 new contributors. Thank you all for the contributions!
Some notable changes in this release are:
Prometheus Remote Write 2.0 Support: Experimental support for Prometheus Remote Write 2.0 protocol.
Parquet Format Support: Experimental Parquet based block storage. A new parquet converter service to convert TSDB blocks to parquet and querier to query parquet files.
Query Federation with Regex Tenant Resolver: Introduce experimental regex tenant resolver allowing regex patterns in X-Scope-OrgID header via -tenant-federation.regex-matcher-enabled flag
gRPC Stream Push between Distributor and Ingester: Experimental feature to use gRPC stream connections for push requests.
More Native Histogram Support: Out-of-order native histogram ingestion support, per-tenant native histogram ingestion config, native histogram active series metrics and limits
Resource-Based Monitor and Limiter: ResourceMonitor to collect CPU and Heap usage for Cortex and ResourceBasedLimiter in Ingesters and StoreGateways to protect the service from incoming requests when hitting limits
UTF-8 Name: UTF-8 name support via -name-validation-scheme flag
[FEATURE] Distributor: Add an experimental -distributor.otlp.enable-type-and-unit-labels flag to add __type__ and __unit__ labels for OTLP metrics. Add enable type and unit labels flag #6969
[FEATURE] Query Frontend: Add dynamic interval size for query splitting. This is enabled by configuring experimental flags querier.max-shards-per-query and/or querier.max-fetched-data-duration-per-query. The split interval size is dynamically increased to maintain a number of shards and total duration fetched below the configured values. Dynamic splitting by interval for range queries #6458
[FEATURE] Querier/Ruler: Add query_partial_data and rules_partial_data limits to allow queries/rules to be evaluated with data from a single zone, if other zones are not available. Query Partial Data #6526
Add an experimental tenant-federation.regex-matcher-enabled flag. If it enabled, user can input regex to X-Scope-OrgId, the matched tenantIDs are automatically involved. The user discovery is based on scanning block storage, so new users can get queries after uploading a block (generally 2h).
Add an experimental tenant-federation.user-sync-interval flag, it specifies how frequently to scan users. The scanned users are used to calculate matched tenantIDs.
[FEATURE] Distributor/Ingester: Implemented experimental feature to use gRPC stream connection for push requests. This can be enabled by setting -distributor.use-stream-push=true. Implement stream connection for remote write #6580
[FEATURE] Query Frontend: Add support for /api/v1/parse_query API (experimental) to parse a PromQL expression and return it as a JSON-formatted AST (abstract syntax tree). Parse query #6978
[ENHANCEMENT] Distributor: Emit an error with a 400 status code when empty labels are found before the relabelling or label dropping process. Validate empty labels in push #7052
[ENHANCEMENT] Overrides Exporter: Expose all fields that can be converted to float64. Also, the label value max_local_series_per_metric got renamed to max_series_per_metric, and max_local_series_per_user got renamed to max_series_per_user. Override exporter: expose all fields that can be converted to float64 #6979
[ENHANCEMENT] Querier: Support query parameters to metadata api (/api/v1/metadata) to allow user to limit metadata to return. Add a -ingester.return-all-metadata flag to make the metadata API run when the deployment. Please set this flag to false to use the metadata API with the limits later. Implement metadata api query params #6681Add ingester.skip-metadata-limits flag #6744
[ENHANCEMENT] Alertmanager: Add new limits -alertmanager.max-silences-count and -alertmanager.max-silences-size-bytes for limiting silences per tenant. Add for tenant silences limit #6605
[ENHANCEMENT] Query Frontend: Add a -frontend.enabled-ruler-query-stats flag to configure whether to report the query stats log for queries coming from the Ruler. Add -frontend.enabled-ruler-query-stats flag #6504
[ENHANCEMENT] Compactor: Support metadata caching bucket for Cleaner. Can be enabled via -compactor.cleaner-caching-bucket-enabled flag. Support caching bucket for cleaner #6778
[ENHANCEMENT] Ingester: Add new metric cortex_ingester_push_errors_total to track reasons for ingester request failures. New metric for ingester errors #6901
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Cortex 1.20.0 Release Notes
This release contains 371 contributions from 38 contributors. We also have 14 new contributors. Thank you all for the contributions!
Some notable changes in this release are:
X-Scope-OrgIDheader via-tenant-federation.regex-matcher-enabledflagResourceMonitorto collect CPU and Heap usage for Cortex andResourceBasedLimiterin Ingesters and StoreGateways to protect the service from incoming requests when hitting limits-name-validation-schemeflagWhat's Changed
-distributor.otlp.enable-type-and-unit-labelsflag to add__type__and__unit__labels for OTLP metrics. Add enable type and unit labels flag #6969-distributor.otlp.allow-delta-temporalityflag to ingest delta temporality otlp metrics. OTLP: Add a AllowDeltaTemporality flag to ingest delta temporality me… #6934querier.max-shards-per-queryand/orquerier.max-fetched-data-duration-per-query. The split interval size is dynamically increased to maintain a number of shards and total duration fetched below the configured values. Dynamic splitting by interval for range queries #6458query_partial_dataandrules_partial_datalimits to allow queries/rules to be evaluated with data from a single zone, if other zones are not available. Query Partial Data #6526ResourceMonitormodule in Cortex, and addResourceBasedLimiterin Ingesters and StoreGateways. AddResourceMonitormodule in Cortex, and addResourceBasedLimiterin Ingesters and StoreGateways #6674-ingester.out-of-order-time-window > 0and-blocks-storage.tsdb.enable-native-histograms=true. Add ooo native histogram ingestion #6626 Make ooo native histograms ingestion automatically enabled #6663X-Scope-OrgIDvalue. Introduce a regex tenant resolver #6713tenant-federation.regex-matcher-enabledflag. If it enabled, user can input regex toX-Scope-OrgId, the matched tenantIDs are automatically involved. The user discovery is based on scanning block storage, so new users can get queries after uploading a block (generally 2h).tenant-federation.user-sync-intervalflag, it specifies how frequently to scan users. The scanned users are used to calculate matched tenantIDs.-distributor.use-stream-push=true. Implement stream connection for remote write #6580X-PromQL-EngineType. Querier: Allow switching between engines via header #6777-name-validation-schemeflag to support UTF-8. Upgrade prometheus to v3.6.0 #7040 Support UTF-8 name #7056max_local_series_per_metricgot renamed tomax_series_per_metric, andmax_local_series_per_usergot renamed tomax_series_per_user. Override exporter: expose all fields that can be converted to float64 #6979cortex_ingester_tsdb_wal_replay_unknown_refs_totalandcortex_ingester_tsdb_wbl_replay_unknown_refs_totalmetrics to track unknown series references during wal/wbl replaying. Add tsdb metrics to track unknown series references during wal/wbl re… #6945-querier.response-compressionflag. add zstd and snappy compression for query api #6848-tenant-federation.regex-matcher-enabledis enabled. Add a query result limit to regex matcher #6845cortex_slow_queries_totalmetric to track # of slow queries per user. Add a cortex_slow_queries_total to track # of slow queries #6859-ingester.return-all-metadataflag to make the metadata API run when the deployment. Please set this flag tofalseto use the metadata API with the limits later. Implement metadata api query params #6681 Add ingester.skip-metadata-limits flag #6744cortex_ingester_active_native_histogram_seriesmetric to track # of active NH series. Add cortex_ingester_active_native_histogram_series metric to track ac… #6695-frontend.max-query-response-sizefor total query response size after decompression in query frontend. Enforce query response size limit after decompression in query-frontend #6607startparam is not specified. Query ingesters only for GetLabelNames and GetLabelValues if start time parameter is not specified #6618-alertmanager.max-silences-countand-alertmanager.max-silences-size-bytesfor limiting silences per tenant. Add for tenant silences limit #6605compactor.auto-forget-delayfor compactor to auto forget compactors after X minutes without heartbeat. Compactor becomes unhealthy in the ring when stopped during startup #6533cortex_querier_storegateway_refetches_per_querymetric. Emit more histogram buckets for cortex-querier_storegateway_refetches… #6570too_many_tenantsreason label value tocortex_rejected_queries_totalmetric to track the rejected query count due to the # of tenant limits. Add a too_many_tenants label to cortex_rejected_queries_total metric #6569-frontend.enabled-ruler-query-statsflag to configure whether to report the query stats log for queries coming from the Ruler. Add -frontend.enabled-ruler-query-stats flag #6504keep_instance_in_the_ring_on_shutdownandtokens_file_pathconfigs for alertmanager ring. Add tokenFile and persisit on ring features for AM ring #6628querier.ingester-query-max-attemptsto retry on partial data. Add querier.ingester-query-max-attempts to retry on partial data. #6714-compactor.cleaner-caching-bucket-enabledflag. Support caching bucket for cleaner #6778ignore_blocks_before. Allow store gateway to ignore syncing blocks older than certain time #6830cortex_ingester_push_errors_totalto track reasons for ingester request failures. New metric for ingester errors #6901detailed_metrics_enabledfor all rings. Default true. Expose DetailedMetricsEnabled for all ring configs #6926format_queryandparse_querylabels value to theoplabel atcortex_query_frontend_queries_totalmetric. Add a format query label value to queries total metric #6925 Add parse query op label to queries total metric #6990cortex_discarded_seriesandcortex_discarded_series_per_labelsetto track number of series that have a discarded sample. Metric for number of series with discarded samples #6995cortex_ingester_tsdb_head_stale_seriesmetric to keep track of number of stale series on head. Ingester: Add head stale series metric #7071usermetrics clean up. fix query frontend per tenant metrics leak when cleaning up user labels #6698__markers__tenant ID validation. Add __markers__ tenantID validation #6761blocks_metafrom the metadata fetcher metrics. Delete prefix blocks_meta for meta fetcher metrics #6832all,distributor,querier, andrulertargets. change to check tenant limit validation only for some targets #6880/distributor/all_user_statsapi to work during rolling updates on ingesters. fix AllUserStats during rolling updates on ingester #7026null. fix panic when the runtime config is null #7062New Contributors
max_series_per_queryfrom docs #6889Full Changelog: v1.19.1...v1.20.0
This discussion was created from the release v1.20.0.
All reactions