[Merged by Bors] - feat: add support to string interpolation

[morenol]

Solves #3127

With this change we could use something like:

http:
  headers:
   - "Authorization: JWT ${{ secrets.JWT_TOKEN }}"

And that should be resolved as

• "Authorization: JWT MYSECRET_TOKEN"

[galibey]

This implementation only covers string interpolation for SecretString type, right? But we need it for other types as well. At minimum other String as well.

We need to come up with a such abstraction that it will be easier later to add other sources of data, not only secrets but envs, for example.

[morenol]

This implementation only covers string interpolation for SecretString type, right?

Yes, only for SecretString

[morenol]

@galibey regarding the String case, I added a new method to the SecretStore trait. The method is resolve_str where you can pass any String and it will resolve it.

[morenol]

We need to come up with a such abstraction that it will be easier later to add other sources of data, not only secrets but envs, for example.

Maybe creating a new Wrapper type for String, were we could call SecretStore::resolve, EnvStore::resolve, and any other resolvers as needed?

[galibey]

@galibey regarding the String case, I added a new method to the SecretStore trait. The method is resolve_str where you can pass any String and it will resolve it.

I meant it works with yaml string only if its Rust counterpart is SecretString, not String.
And other yaml data types is not covered, but according to the linked issue, they should.

Upd. My bad, only string type is required

[morenol]

I meant it works with yaml string only if its Rust counterpart is SecretString, not String. And other yaml data types is not covered, but according to the linked issue, they should.

The find_secrets function will work as expected (We will be able to detect which are the secret names), but yes, we don't automatically resolve them on connector config. Do you think that we should do an automatic resolve() for every string in the input?

[galibey]

Maybe creating a new Wrapper type for String, were we could call SecretStore::resolve, EnvStore::resolve, and any other resolvers as needed?

Yes, this is a possible approach. The other one could be is to parse the config data into string, replace variables and then parse the resulting string into config type.

[galibey]

The find_secrets function will work as expected (We will be able to detect which are the secret names), but yes, we don't automatically resolve them on connector config. Do you think that we should do an automatic resolve() for every string in the input?

Could be so, yes.

[morenol]

Maybe creating a new Wrapper type for String, were we could call SecretStore::resolve, EnvStore::resolve, and any other resolvers as needed?

Yes, this is a possible approach. The other one could be is to parse the config data into string, replace variables and then parse the resulting string into config type.

Implemented that behavior in f6331950a1a834b32bb9bb9db0e3425c55b99a29

[galibey]

LGTM!. Just a minor comment.

[sehz]

avoid lazy_static. should use once_cell

[morenol]

updated

[morenol]

@sehz could you take another look?

[morenol]

@sehz please take another look

[sehz]

Overall looks good to me. One minor ask

[sehz]

LGTM

[morenol]

bors r+

[bors]

Pull request successfully merged into master.

Build succeeded:

• Done