Compile pg_tiktoken extension

[vadim2404]

Describe your changes

postgres=# create extension pg_tiktoken;
CREATE EXTENSION
postgres=# select tiktoken_count('p50k_edit', 'A long time ago in a galaxy far, far away');
 tiktoken_count
----------------
             11
(1 row)

postgres=# select tiktoken_encode('cl100k_base', 'A long time ago in a galaxy far, far away');
                  tiktoken_encode
----------------------------------------------------
 {32,1317,892,4227,304,264,34261,3117,11,3117,3201}
(1 row)

Issue ticket number and link

Checklist before requesting a review

• I have performed a self-review of my code.
• If it is a core feature, I have added thorough tests.
• Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
• If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

[kelvich]

LGTM, thanks. I'm now playing with unforking all of that and using "unsafe-postgres" thing from the last version. Works for jsonschema and tiktoken, but some problems with pgx-contrib-spiext. Will poke at it for some more time and most likely leave everything as it is until next pgx-contrib-spiext release

[vadim2404]

LGTM, thanks. I'm now playing with unforking all of that and using "unsafe-postgres" thing from the last version. Works for jsonschema and tiktoken, but some problems with pgx-contrib-spiext. Will poke at it for some more time and most likely leave everything as it is until next pgx-contrib-spiext release

There is a PR that removes the dependency to pgx-contrib-spiext for pg_graphql extension: