Skip to content

chore: update example for doc2 #1932

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 10, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions docs/user-guide/logs/pipeline-config.md
Original file line number Diff line number Diff line change
Expand Up @@ -1024,15 +1024,16 @@ processors:

transform:
- field: input_str, ts
type: time
type: time, ms
index: timestamp
```

Simply add a `version: 2` line at the top of the config file, and the pipeline engine will run the transform in combined mode:
1. Process all written transform rules sequentially.
2. Write all fields of the pipeline context to the final table.

Note:
- If the transform section is explicitly written, it must contain a time index field. Otherwise the time-index field will be inferred by the pipeline engine just like the auto-transform mode.
- If the transform section is explicitly written, **it must contain a time index field**. Otherwise the time-index field will be inferred by the pipeline engine just like the auto-transform mode.
- The transform process in the version 2 will consume the original field in the pipeline context, so you can't transform the same field twice.

## Dispatcher
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1042,15 +1042,16 @@ processors:

transform:
- field: input_str, ts
type: time
type: time, ms
index: timestamp
```

只需要在配置文件的开头加上 `version: 2`,pipeline 引擎就会以新的 transform 模式来处理数据:
1. 顺序执行所有配置的 transform 规则。
2. 将 pipeline 上下文中的所有字段保存到最终的结果表中

注意:
- 如果明确配置了 transform 规则,那么它必须要包含时间索引列。否则时间索引列会由 pipeline 引擎进行推导,该行为和 auto-transform 模式一致
- 如果明确配置了 transform 规则,**那么它必须要包含时间索引列**。否则时间索引列会由 pipeline 引擎进行推导,该行为和 auto-transform 模式一致
- 版本 2 中的 transform 规则执行会将原始字段从 pipeline 上下文中移除,故你无法在 transform 规则对同一个字段引用多次

## Dispatcher
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1038,15 +1038,16 @@ processors:

transform:
- field: input_str, ts
type: time
type: time, ms
index: timestamp
```

只需要在配置文件的开头加上 `version: 2`,pipeline 引擎就会以新的 transform 模式来处理数据:
1. 顺序执行所有配置的 transform 规则。
2. 将 pipeline 上下文中的所有字段保存到最终的结果表中

注意:
- 如果明确配置了 transform 规则,那么它必须要包含时间索引列。否则时间索引列会由 pipeline 引擎进行推导,该行为和 auto-transform 模式一致
- 如果明确配置了 transform 规则,**那么它必须要包含时间索引列**。否则时间索引列会由 pipeline 引擎进行推导,该行为和 auto-transform 模式一致
- 版本 2 中的 transform 规则执行会将原始字段从 pipeline 上下文中移除,故你无法在 transform 规则对同一个字段引用多次

## Dispatcher
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1020,15 +1020,16 @@ processors:

transform:
- field: input_str, ts
type: time
type: time, ms
index: timestamp
```

Simply add a `version: 2` line at the top of the config file, and the pipeline engine will run the transform in combined mode:
1. Process all written transform rules sequentially.
2. Write all fields of the pipeline context to the final table.

Note:
- If the transform section is explicitly written, it must contain a time index field. Otherwise the time-index field will be inferred by the pipeline engine just like the auto-transform mode.
- If the transform section is explicitly written, **it must contain a time index field**. Otherwise the time-index field will be inferred by the pipeline engine just like the auto-transform mode.
- The transform process in the version 2 will consume the original field in the pipeline context, so you can't transform the same field twice.

## Dispatcher
Expand Down