[Feature] Query SQL Audit

[create-co]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

I activated the privilege system.
In our business scenario, I want to collect all executed sql queries of paimon from authorized users for security audit. Does paimon currently support collecting executed sql records? Or is there a solution?

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!

[davedwwang]

Do audit logs need to have a central service that can centralize the audit logs? Paimon is a tabular format and does not have a central service. Can we consider solving this at the computing engine layer, such as Hive? If not, then Paimon needs to support uploading audit logs to a central storage like ElasticSearch.

[create-co]

I just need to collect the execution log of paimon. Now I don't know how to configure it. I can collect the execution log of paimon. For example, colleague A executed SELECT * FROM A ; where can I collect this execution sql and know that someone accessed Table A?

…

------------------ 原始邮件 ------------------ 发件人: "apache/paimon" ***@***.***>; 发送时间: 2024年9月23日(星期一) 晚上7:43 ***@***.***>; ***@***.******@***.***>; 主题: Re: [apache/paimon] [Feature] Query SQL Audit (Issue #4174) Do audit logs need to have a central service that can centralize the audit logs? Paimon is a tabular format and does not have a central service. Can we consider solving this at the computing engine layer, such as Hive? If not, then Paimon needs to support uploading audit logs to a central storage like ElasticSearch. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[coolderli]

@create-co Maybe you can try apache gravitino. It support the audit log for paimon.