v0.9.5

What's Changed

• fix: excel data type handling by @talagluck in #3051
• chore(deps): upgrade main batch 2024-06-28 by @tychoish in #3061
• chore(deps): upgrade to v3.0 of the mongodb driver by @tychoish in #3062
• fix: polars equality function rename in tests by @tychoish in #3065
• fix: release artifact naming fixes by @tychoish in #3064
• fix: fallback for date formats in sqlite parsing by @tychoish in #3066
• chore(deps): bump dependencies in batch for 2024-07-08 by @tychoish in #3075
• chore(deps-dev): bump zipp from 3.18.1 to 3.19.1 in /tests by @dependabot in #3076
• core(deps): batch upgrade rust dependencies by @tychoish in #3090
• feat: add jaq_select() and jaq_matches() functions for manipulating json by @tychoish in #3091
• feat: jaq filter for input to json tables by @tychoish in #3099
• chore(deps): rust dependency batch by @tychoish in #3100
• feat: nested bson constructs (array and document) should always be structures by @tychoish in #3102
• chore: bson stream cleanup by @tychoish in #3101
• chore: cleanup some timestamp handling, mostly in bson by @tychoish in #3103
• feat: bson2json and json2bson scalar converters by @tychoish in #3104
• chore: clean up boilerplate on scalar functions by @tychoish in #3105
• chore(deps): rust dependency update by @tychoish in #3119
• fix: pgsrv should initialize its own crypto provider by @tychoish in #3121
• fix: clearer error handling around nested arrays by @tychoish in #3122
• fix: clarify lazy API in bindings by @tychoish in #3131
• chore(deps): upgrade batch by @tychoish in #3132
• fix: clarify evaluation semantics for DDL operations in bindings by @tychoish in #3133
• feat: sdk should export its dependency by @tychoish in #3135
• chore(deps): upgrade batch by @tychoish in #3147
• chore: Release 0.9.5 by @scsmithr in #3148

Full Changelog: v0.9.4...v0.9.5

v0.9.4

What's Changed

• feat(bindings/python): expose the prql function by @eitsupi in #2999
• fix: metastore argument validation by @tychoish in #3013
• feat: use fat arrows for options by @tychoish in #3012
• feat: insert into support for external delta tables by @tychoish in #3025
• fix: excel table function should read data more consistently from remote sources by @tychoish in #3043
• feat: COPY TO support for delta by @tychoish in #3037

New Contributors

• @eitsupi made their first contribution in #2999

Full Changelog: v0.9.3...v0.9.4

v0.9.3

What's Changed

• chore: organize output for mino test results by @tychoish in #2812
• fix: properly satisfy enforcesorting rules by @universalmind303 in #2814
• fix: Support null credentials for object store access. by @vrongmeal in #2798
• chore: isolate bigquery task in CI by @tychoish in #2813
• chore: dependency updates 2024-03-25 by @tychoish in #2822
• refactor: move slt clients into own module by @universalmind303 in #2824
• refactor: table options by @universalmind303 in #2767
• chore: dependency upgrades by @tychoish in #2849
• chore: rename glaredb -> cli crate by @tychoish in #2830
• chore: remove accidentally commited file by @universalmind303 in #2855
• fix: non-deterministic http test by @tychoish in #2869
• chore: deps upgrade 2024-04-07 by @tychoish in #2868
• chore: df 36 upgrade by @universalmind303 in #2853
• chore: update docs links by @greyscaled in #2852
• chore(deps): bump pymongo from 4.6.2 to 4.6.3 in /tests by @dependabot in #2870
• fix: nix agpl spec by @tychoish in #2833
• feat: Support cloud uploads for Excel/BSON by @vrongmeal in #2851
• fix(pytest): remove pysqlite3-binary dependency by @tychoish in #2872
• chore: engine constructor cleanup by @tychoish in #2831
• fix: in memory db should not be global by @tychoish in #2873
• fix: case sensitive with cast for delta by @universalmind303 in #2876
• fix: Iceberg fixes for reading table metadata by @vrongmeal in #2810
• feat: glaredb driver implementation by @tychoish in #2832
• feat: documentation for Rust SDK crate by @tychoish in #2871
• chore: remove metastore client cruft by @tychoish in #2878
• chore: bson/json comparison benchmarks by @tychoish in #2799
• fix: Ignore HTTP store client errors trying to get content length by @vrongmeal in #2874
• chore(deps): Bump deps by @scsmithr in #2898
• fix: lazy sdk implementation by @tychoish in #2897
• chore: hoist node.js bindings on top of rust sdk by @tychoish in #2879
• fix: inserts clean up on failure by @universalmind303 in #2875
• feat: read_blob by @universalmind303 in #2902
• fix: skip insert when creating table that exists by @tychoish in #2901
• chore: integrate new rust sdk into python bindings by @tychoish in #2850
• refactor: remove datafusion dependency from 'parser' crate by @universalmind303 in #2904
• feat(sdk): row-based access to results in sdk by @tychoish in #2903
• chore: ignore .DS_Store by @universalmind303 in #2922
• chore(deps): update dependencies by @tychoish in #2927
• feat: read_text table function by @universalmind303 in #2924
• chore: update dbt dependencies for testing by @talagluck in #2934
• fix: track data for more operations by @tychoish in #2931
• fix: insert metrics tracking by @tychoish in #2935
• chore(deps): upgrade dependencies by @tychoish in #2947
• chore(deps): upgrade rustls packages, and associated dependencies by @tychoish in #2933
• fix: Don't preprocess database name when setting session catalog alias by @scsmithr in #2959
• build: Make sure docker image has cmake during build by @scsmithr in #2960
• chore(deps): regular dependency upgrades by @tychoish in #2961
• fix: avoid unittest link oom by @tychoish in #2962
• chore(deps): upgrade batch 2024-05-10 by @tychoish in #2979
• fix: release toolchain by @tychoish in #2982
• chore(deps): Update aws-lc-rs & aws-lc-sys by @scsmithr in #2981
• chore(deps): upgrade dependencies 2024-05-17 by @tychoish in #2989
• release: v0.9.3 by @greyscaled in #2930

Full Changelog: v0.9.2...v0.9.3

v0.9.2

v0.9.2 is a point release of mostly fixes and chores.

Installing or Updating

CLI

To install or update just run the following command in the directory you want
the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb

Node.js

npm install @glaredb/glaredb

What's Changed

• chore: add dbt read_csv test by @talagluck in #2732
• feat: insert into sqlite tables by @tychoish in #2745
• refactor: move parser into own crate by @universalmind303 in #2747
• feat: Initial globbing ranges support by @vrongmeal in #2654
• feat: initial external table schema by @tychoish in #2333
• feat: multi-line json streaming by @tychoish in #2729
• chore: add relative path regression test by @tychoish in #2749
• chore: cleanup in python bindings tests by @tychoish in #2750
• fix: kdl support in hybrid by @tychoish in #2751
• chore: add note to python init.py files by @tychoish in #2753
• fix: error string clarifying quotes by @tychoish in #2755
• feat: add some table aliases for lance,iceberg and delta by @universalmind303 in #2752
• chore: upgrade dependencies by @tychoish in #2769
• fix: Retry writing lease when error code 429 (too many requests). by @vrongmeal in #2773
• chore: add explicit schema support for json streaming by @tychoish in #2766
• Update profiles.yml by @talagluck in #2780
• chore: change lance ref by @tychoish in #2781
• chore: update cargo lock by @tychoish in #2782
• fix: Remove incorrect temp table check during resolve by @scsmithr in #2783
• chore: deps upgrade 2024-03-15 by @tychoish in #2792
• chore: Create a new temp object when writing lease all the time. by @vrongmeal in #2776
• fix: respect bigquery limit by @tychoish in #2754
• fix: resolve aliased catalogs by @universalmind303 in #2793
• feat: access sqlite dbs from object storage by @tychoish in #2772
• fix: Allow HTTP object store for json/bson etc. by @vrongmeal in #2784
• chore: benchmark read_json functions by @tychoish in #2794
• feat: change default 'json' extension handler by @tychoish in #2797
• feat: add nix derivation by @cmoog in #2727
• chore: add better regclass and oid cast support by @universalmind303 in #2795
• chore: update readme table and style by @tychoish in #2800
• fix: properly alias all sessions by @universalmind303 in #2802
• release: v0.9.2 by @greyscaled in #2801
• chore(deps): bump black from 23.3.0 to 24.3.0 by @tychoish in #2807
• chore(npm): fix napi argument by @greyscaled in #2808

Full Changelog: v0.9.1...v0.9.2

v0.9.1

v0.9.1 is a point release of mostly fixes and chores.

Notable Improvements

• cloud_upload can now be used in hybrid and remote contexts, such as with the CLI or Python and Node.js language bindings
• You can now create tables from excel

CREATE EXTERNAL TABLE t FROM excel OPTIONS (
    location = '<location>',     -- required
    has_header = 'true',         -- optional, 'true' or 'false'
    sheet_name = '<sheet_name>'  -- optional, defaults to first sheet in the workbook
);

Installing or Updating

CLI

To install or update just run the following command in the directory you want
the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb

Node.js

npm install @glaredb/glaredb

What's Changed

• chore: make bson copy to options more consistent by @tychoish in #2704
• chore: add postgres dbt model to dbt tests by @talagluck in #2703
• perf: improve bson iteration performance by @tychoish in #2707
• feat: support for create external table excel <options> by @hailelagi in #2684
• fix(rpc): set is_cloud_instance remote session var by @greyscaled in #2715
• refactor: extensible function registry by @universalmind303 in #2699
• chore: add SQLite to list of supported Databases by @judahrand in #2717
• chore: dependency upgrade by @tychoish in #2726
• fix: python dependency specification by @tychoish in #2483
• chore(deps): bump mio from 0.8.9 to 0.8.11 by @dependabot in #2733
• fix: Iceberg for format v1 by @vrongmeal in #2718
• chore: pytest path cleanup and port management by @tychoish in #2734
• fix: Generic object store access implementation by @vrongmeal in #2709
• fix: Allow a process to acquire a lease its already acquired by @scsmithr in #2735
• release: v0.9.1 by @greyscaled in #2736
• hotfix(py v0.9.1): omit version specification by @tychoish in #2741

New Contributors

• @hailelagi made their first contribution in #2684
• @judahrand made their first contribution in #2717

Full Changelog: v0.9.0...v0.9.1

v0.9.0

Highlights

For highlights and details since 0.8, check out our full announcement: https://glaredb.com/blog/announcing-v0.9.0 🎉 !

Installing or Updating

CLI

To install or update just run the following command in the directory you want the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb

Node.js

npm install @glaredb/glaredb

What's Changed

• fix(virtual_listing): signatures by @greyscaled in #2648
• chore(ci): build images from 'main' by @greyscaled in #2653
• chore(args): refactor imports by @greyscaled in #2656
• fix: infer excel files by extension by @tychoish in #2655
• chore(ci): move postgres tests and simplify tunnels testing by @tychoish in #2647
• chore: dependency upgrade for 2024-02-16 by @tychoish in #2669
• Feat: Create External Table support for Excel by @hemanth94 in #2652
• feat: SQLite data source by @vrongmeal in #2568
• fix: excel files should default to having a header like csv files by @tychoish in #2672
• fix: move supervisor into metastore by @universalmind303 in #2674
• chore: parametrize dbt test, add test case by @talagluck in #2673
• feat(read_ file funcs): infer from compressed formats by @hemanth94 in #2639
• chore(infer_func_for_file): remove dead code by @greyscaled in #2677
• feat: cloud_upload(<filename>) table func by @greyscaled in #2670
• feat: const aliases and read_xlsx alias by @tychoish in #2657
• fix: Alter table renames view successfully by @vrongmeal in #2678
• fix: report time display for DDL commands by @hemanth94 in #2681
• feat: cosine_similarity function by @universalmind303 in #2680
• feat: add object store table support for bson format data by @tychoish in #2600
• chore: reduce caching overhead for build steps by @tychoish in #2686
• feat: add support for reading local parquet metadata by @universalmind303 in #2685
• chore: upgrade dependencies by @tychoish in #2698
• chore(cloud_upload): improve err msg by @greyscaled in #2705
• chore: pytest hacking by @tychoish in #2606
• release: v0.9.0 by @greyscaled in #2711

Full Changelog: v0.8.5...v0.9.0

v0.8.5

v0.8.5 is a point release of mostly fixes and chores

Installing or Updating

CLI

To install or update just run the following command in the directory you want the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb

Node.js

npm install @glaredb/glaredb

What's Changed

• fix: fixedsizelist in delta by @universalmind303 in #2607
• fix: add pg_rewrite and pg_depend tables by @talagluck in #2612
• chore(publish nodejs): set working-dir by @greyscaled in #2611
• fix(deps): remove dynamic linking to 'lzma' by @universalmind303 in #2631
• feat: support inserts into mongodb by @tychoish in #2605
• feat: lance insert_into support by @tychoish in #2613
• fix(information_schema): identity_cycle, is_updatable by @greyscaled in #2616
• chore: upgrade dependencies by @tychoish in #2632
• fix: create view nested query by @universalmind303 in #2637
• chore(deps): bump libgit2-sys from 0.16.1+1.7.1 to 0.16.2+1.7.2 by @dependabot in #2638
• fix(metastore): make builtin schemas readonly by @greyscaled in #2617
• fix: Unsigned integer types being cast to integers by @hemanth94 in #2640
• fix: make insert plan schema correct and clear by @tychoish in #2642
• release: v0.8.5 by @greyscaled in #2646

Full Changelog: v0.8.4...v0.8.5

v0.8.4

v0.8.4 is a point release of mainly fixes and chores, notably with some performance improvements (see: #2584, #2601). Refer to the commits below for more detail.

Installing or Updating

CLI

To install or update just run the following command in the directory you want the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb --upgrade

What's Changed

• feat: add openai_embed function by @universalmind303 in #2538
• fix: options keyword is required before options block by @tychoish in #2445
• fix: ci cleanup cache command by @tychoish in #2552
• chore: disable regular benchmark runs by @tychoish in #2553
• ci: python build names by @greyscaled in #2559
• ci: fix pypi release by @universalmind303 in #2557
• fix: parquet over http by @universalmind303 in #2565
• chore(cloudauth): remove unused fields by @greyscaled in #2567
• chore(deps): Bump rust deps by @scsmithr in #2582
• chore(deps): bump slackapi/slack-github-action from 1.24.0 to 1.25.0 by @dependabot in #2577
• fix: predicate pushdowns for supported filetypes by @universalmind303 in #2584
• fix: bson timestamp type casting by @tychoish in #2593
• chore(release): atomic build and push jobs by @tychoish in #2564
• chore: df 35 upgrade by @universalmind303 in #2599
• fix: local file path resolution for json and bson by @tychoish in #2594
• fix: optimize ddl subqueries by @universalmind303 in #2601
• chore: add dbt test and fixtures by @talagluck in #2580
• chore: increase the history length for cli by @universalmind303 in #2608
• release: v0.8.4 by @greyscaled in #2595

New Contributors

• @talagluck made their first contribution in #2580

Full Changelog: v0.8.3...v0.8.4

v0.8.3

v0.8.3 is a point release of mainly fixes and chores. Refer to the commits below for more detail.

Notable fixes

• Postgres: Fixed an issue reading 0 timestamps (0001-01-01 00:00:00)

Installing or Updating

CLI

To install or update just run the following command in the directory you want the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb

Node.js

npm install @glaredb/glaredb

What's Changed

• chore(binary build): slack alert by @greyscaled in #2537
• chore: ci reorganize dag by @tychoish in #2529
• feat: streaming json document/array data by @tychoish in #2494
• fix: normalize cache keys by @tychoish in #2539
• fix: Use actual precision for clickhouse data types by @vrongmeal in #2528
• fix: Use microsecond precision for postgres datasource by @vrongmeal in #2530
• chore: improve cache utility by @tychoish in #2540
• chore: populate shareable cache on main by @tychoish in #2541
• chore: ci clean up caches after a PR merges by @tychoish in #2542
• fix: add ci cache cleanup credential by @tychoish in #2544
• fix: update release macos runners by @tychoish in #2543
• fix: pr cleanup action jq operation by @tychoish in #2546
• release: v0.8.3 by @greyscaled in #2548

Full Changelog: v0.8.2...v0.8.3

v0.8.2

v0.8.2 is a point release of fixes and chores. Refer to the commits below for more detail.

Cassandra Update

We now support Cassandra data sources with PasswordAuthenticator.

-- Add an external table
CREATE EXTERNAL TABLE my_cassandra_table FROM cassandra OPTIONS (
    host = '<host>',
    keyspace = '<keyspace>',
    table = '<table>',
    username = '[username]',
    password = '[password]'
);

-- Add an external database
CREATE EXTERNAL DATABASE my_cassandra_db FROM cassandra OPTIONS (
    host = '<hostname>:<port>',
    username = '[username]',
    password = '[passowrd]'
);

-- Table function
SELECT count(*) FROM read_cassandra('<host>', '<keyspace>', '<table>', '[username]', '[password]');

Installing or Updating

CLI

To install or update just run the following command in the directory you want the binary:

curl https://glaredb.com/install.sh | sh

Python

pip install glaredb

Node.js

npm install @glaredb/glaredb

What's Changed

• feat: Notices on transactions by @scsmithr in #2443
• chore(ci): pin just version by @tychoish in #2442
• feat: copy to support for lance by @tychoish in #2342
• feat: pg_catalog.version(), standard_conforming_strings session var by @scsmithr in #2448
• chore(deps): Bump rust deps by @scsmithr in #2459
• chore(deps): bump actions/cache from 3 to 4 by @dependabot in #2449
• fix: $(find . -name "*.rs" | xargs chmod 0644) by @tychoish in #2463
• chore: Remove timeouts from CLI tests that don't need them by @scsmithr in #2469
• chore: Split out term width function into its own crate by @scsmithr in #2471
• chore: Get most of the rpc tests working by @scsmithr in #2472
• chore: Remove unneeded create credential message by @scsmithr in #2474
• fix: psql tab completion by @universalmind303 in #2464
• chore(deps): bump shlex from 1.2.0 to 1.3.0 by @dependabot in #2477
• fix: actually drop delta tables by @universalmind303 in #2415
• fix: rename "pg_table" to "pg_tables" by @universalmind303 in #2480
• chore: update contributing with pytest info by @tychoish in #2479
• ci: fix timings.csv by @universalmind303 in #2460
• fix: Execute clickhouse query in stream (during execution) by @vrongmeal in #2482
• chore: Upgrade arrow/datafusion/deltalake/lance by @vrongmeal in #2429
• test(python): create table from pandas df by @greyscaled in #2488
• fix: add auth for cassandra by @tychoish in #2478
• fix: download protoc without just during the release by @tychoish in #2476
• chore: forbid wildcard imports + additional rustfmt by @tychoish in #2466
• fix: ci task names by @tychoish in #2497
• chore: Move distexec into a different crate by @vrongmeal in #2489
• chore(deps): Bump rust deps by @scsmithr in #2513
• chore(deps): bump actions/cache from 3 to 4 by @dependabot in #2498
• chore: Add npm badge to readme by @scsmithr in #2515
• chore: downsize some ci builders by @tychoish in #2514
• chore: Run more prql integration tests by @scsmithr in #2516
• fix: add pg_matview table by @universalmind303 in #2523
• ci: explicit caching and even smaller runners by @tychoish in #2518
• fix: bson should handle nulls by @tychoish in #2485
• chore: skip sqlserver+flight combination. by @tychoish in #2526
• release: v0.8.2 by @greyscaled in #2532

Full Changelog: v0.8.1...v0.8.2