-
Notifications
You must be signed in to change notification settings - Fork 4.9k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
The Elasticsearch made a behavioral change to the grok processor (PR elastic/elasticsearch#92586), where in case a field matches more than once, the processor will return a list of values. This change was introduced in 8.7. Some of the filebeats pipelines were built over the assumption that only the first match would be returned. In the case of IIS, the `source.address` is repeated in the second part, by which only the first match will be used, so, it's safe to remove the second `source.address` In the case of MySQL, according to their documentation: - the Schema is defined always at the beginning of the log, right after the "Thread_id:", so it's safe to remove the second `mysql.schema` - `thread_id` is more tricky, because it can be matched from different places, in this case, the potential matches are stored in 3 temporary fields, and then a new `script` processor does the job of using the correct temporary field and then removing it.
- Loading branch information
Showing
2 changed files
with
16 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters