Release 2.0.0 #2753

k-rus · 2020-12-17T09:33:14Z

With this release, we are officially moving TimescaleDB 2.0 to GA,
concluding several release candidates.

TimescaleDB 2.0 adds the much-anticipated support for distributed
hypertables (multi-node TimescaleDB), as well as new features and
enhancements to core functionality to give users better clarity and
more control and flexibility over their data.

Multi-node architecture: In particular, with TimescaleDB 2.0, users
can now create distributed hypertables across multiple instances of
TimescaleDB, configured so that one instance serves as an access node
and multiple others as data nodes. All queries for a distributed
hypertable are issued to the access node, but inserted data and queries
are pushed down across data nodes for greater scale and performance.

Multi-node TimescaleDB can be self managed or, for easier operation,
launched within Timescale's fully-managed cloud services.

This release also adds:

Support for user-defined actions, allowing users to define,
customize, and schedule automated tasks, which can be run by the
built-in jobs scheduling framework now exposed to users.
Significant changes to continuous aggregates, which now separate the
view creation from the policy. Users can now refresh individual
regions of the continuous aggregate materialized view, or schedule
automated refreshing via policy.
Redesigned informational views, including new (and more general)
views for information about hypertable's dimensions and chunks,
policies and user-defined actions, as well as support for multi-node
TimescaleDB.
Moving all formerly enterprise features into our Community Edition,
and updating Timescale License, which now provides additional (more
permissive) rights to users and developers.

Some of the changes above (e.g., continuous aggregates, updated
informational views) do introduce breaking changes to APIs and are not
backwards compatible. While the update scripts in TimescaleDB 2.0 will
upgrade databases running TimescaleDB 1.x automatically, some of these
API and feature changes may require changes to clients and/or upstream
scripts that rely on the previous APIs. Before upgrading, we recommend
reviewing upgrade documentation at docs.timescale.com for more details.

Major Features

TimescaleDB 2.0 moves the following major features to GA:

Add support for distributed hypertables #1923 Add support for distributed hypertables
Add support for custom background worker jobs #2006 Add support for user-defined actions
Add refresh function for continuous aggregates #2125 Add support for refresh policy #2221 Improve Continuous Aggregate API
Utility function and hypertables view #2084 Add compression settings view #2089 Add chunks and dimensions view #2098 Add timescaledb_information.jobs view #2417 Redesign informational views
Move enterprise features to community #2435 Move enterprise features to community
Update Timescale License #2437 Update Timescale License

Previous Release Candidates

Release 2.0.0-rc4 #2702 Release Candidate 4 (December 2, 2020)
Release 2.0.0-rc3 #2637 Release Candidate 3 (November 12, 2020)
Release 2.0.0-rc2 #2554 Release Candidate 2 (October 20, 2020)
Release 2.0.0-rc1 #2478 Release Candidate 1 (October 1, 2020)

Minor Features

Since the last release candidate 4, it includes several minor
improvements:

Optimize locking for create chunk API #2746 Optimize locking for create chunk API
Block tableoid access on distributed hypertable #2705 Block tableoid access on distributed hypertable
Do not allow unique index on compressed hypertables. #2730 Do not allow unique index on compressed hypertables

Bugfixes

Since the last release candidate 4, it includes several bugfixes:

Support disabling compression on distributed hypertables #2719 Support disabling compression on distributed hypertables
Fix compression status in chunks view for distributed chunks #2742 Fix compression status in chunks view for distributed chunks
Fix crash and cancel when adding data node #2751 Fix crash and cancel when adding data node

Thanks

Thanks to all contributors for the TimescaleDB 2.0 release:

@airton-neto for reporting a bug in executing some queries with UNION
@nshah14285 for reporting an issue with propagating privileges
@kalman5 for reporting an issue with renaming constraints
@LbaNeXte for reporting a bug in decompression for queries with
subqueries
@semtexzv for reporting an issue with continuous aggregates on
int-based hypertables
@mr-ns for reporting an issue with privileges for creating chunks
@cloud-rocket for reporting an issue with setting an owner on
continuous aggregate
@jocrau for reporting a bug during creating an index with transaction
per chunk
@fvannee for reporting an issue with custom time types
@ArtificialPB for reporting a bug in executing queries with
conditional ordering on compressed hypertable
@dutchgecko for reporting an issue with continuous aggregate datatype
handling
@lambdaq for suggesting to improve error message in continuous
aggregate creation
@francesco11112 for reporting memory issue on COPY
@Netskeh for reporting bug on time_bucket problem in continuous
aggregates
@mr-ns for reporting the issue with CTEs on distributed hypertables
@akamensky for reporting an issue with recursive cache invalidation
@ryanbooz for reporting slow queries with real-time aggregation on
continuous aggregates
@cevian for reporting an issue with disabling compression on
distributed hypertables

codecov · 2020-12-17T09:54:18Z

Codecov Report

Merging #2753 (e3a0cf3) into master (d13afc7) will increase coverage by 0.11%.
The diff coverage is 90.00%.

@@            Coverage Diff             @@
##           master    #2753      +/-   ##
==========================================
+ Coverage   90.12%   90.24%   +0.11%     
==========================================
  Files         212      212              
  Lines       34640    34614      -26     
==========================================
+ Hits        31218    31236      +18     
+ Misses       3422     3378      -44

Impacted Files	Coverage Δ
tsl/src/dist_util.c	`93.28% <ø> (ø)`
tsl/src/remote/connection.c	`91.57% <88.57%> (-0.56%)`	⬇️
tsl/src/data_node.c	`96.25% <100.00%> (+0.02%)`	⬆️
tsl/src/data_node_dispatch.c	`97.02% <0.00%> (-0.25%)`	⬇️
src/loader/bgw_message_queue.c	`87.09% <0.00%> (ø)`
src/import/planner.c	`70.30% <0.00%> (+11.12%)`	⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a2275c7...e3a0cf3. Read the comment docs.

CHANGELOG.md

mfreed · 2020-12-17T15:52:35Z

Let me leave comments later today. I think we want to really flesh out the release notes here a bit more, and possibly link back to the 4 RCs:

RC2: Release 2.0.0-rc2 #2554
RC1: Release 2.0.0-rc1 #2478

etc

CHANGELOG.md

erimatnor · 2020-12-17T16:55:54Z

I think the PR is also missing an update to version.config

mfreed · 2020-12-17T17:24:01Z

How about something like:

With this release, we’re officially moving TimescaleDB 2.0 to GA, concluding
several release candidates.

TimescaleDB 2.0 adds the much-anticipated support for distributed hypertables
(multi-node TimescaleDB), as well as new features and enhancements to core
functionality to give users more control and flexibility over their data.

Multi-node architecture: In particular, with TimescaleDB 2.0, users can now
create distributed hypertables across multiple instances of TimescaleDB,
configured so that one instance serves as an access node and multiple others
as data nodes. All queries for a distributed hypertable are issued to the access
node, but inserted data and queries are pushed down across data nodes for
greater scale and performance.

This release also adds:

Support for user-defined actions, allowing users to define, customize, and
schedule automated tasks, which can be run by the built-in jobs scheduling
framework now exposed to users.
Significant changes to continuous aggregates, which now separate view
creation from policy. Users can now refresh individual regions of the continuous
aggregate materialized view, or schedule automated refreshing via policy.
Redesigned informational views, including new (and more general) views for
information about policies and user-defined actions, as well as support for
multi-node TimescaleDB.
Moving all formerly enterprise features into our Community Edition, and
our updated Timescale License which provides additional (more permissive)
rights to users and developers.

Some of the changes above (e.g., continuous aggregates, updated informational
views) do introduce breaking changes to APIs and are not backwards compatible.
While the update scripts in TimescaleDB 2.0 should upgrade databases running
TimescaleDB 1.x automatically, some of these API and feature changes may require
changes to clients and/or upstream scripts that rely on the previous APIs. Before
upgrading, we recommend reviewing upgrade documentation at docs.timescale.com
for more details.

Major Features

TimescaleDB 2.0 moves the following major features to GA:

Add support for distributed hypertables #1923 Add support for distributed hypertables
Add support for custom background worker jobs #2006 Add support for user-defined actions
Continuous Aggregates
Move enterprise features to community #2435 Move enterprise features to community
Update Timescale License #2437 Update Timescale License

Previous Release Candidates

Release 2.0.0-rc4 #2702 Release Candidate 4 (December 2, 2020)
Release 2.0.0-rc3 #2637 Release Candidate 3 (November 12, 2020)
Release 2.0.0-rc2 #2554 Release Candidate 2 (October 20, 2020)
Release 2.0.0-rc1 #2478 Release Candidate 1 (October 1, 2020)

Minor Features

Since the last release candidate 4, it includes several minor improvements:

Properly block more unsupported functionalities on multinode
Improve and fix bugs in communication to data nodes
Optimize locking for create chunk API
Fix compression status in chunks view for distributed chunks

Bugfixes

Since the last release candidate 4, it includes several bugfixes:
*
*

Thanks

Thanks to all contributors for the TimescaleDB 2.0 release:

@francesco11112 for reporting memory issue on COPY
@Netskeh for reporting bug on time_bucket problem in continuous aggregates
@mr-ns for reporting the issue with CTEs on distributed hypertables
@akamensky for reporting an issue with recursive cache invalidation
@ryanbooz for reporting slow queries with real-time aggregation on continuous aggregates

mfreed · 2020-12-17T21:48:30Z

CHANGELOG.md

+* Improve Continuous Aggregate API
+* Redesign informational views


Possible to link more than one github issues to these features?

CHANGELOG.md

erimatnor

Approving, but assuming merge wont happen until prerelease tests pass and tagging will happen.

feikesteenbergen · 2020-12-18T14:35:38Z

If I build from this commit, I end up with a version 2.1.0-dev, is that supposed to happen (My expectation is that this commit would point to 2.0.0)

k-rus · 2020-12-18T14:53:19Z

If I build from this commit, I end up with a version 2.1.0-dev, is that supposed to happen (My expectation is that this commit would point to 2.0.0)

@feikesteenbergen That's correct, since we are continuing to develop in master branch. The release branch will have version 2.0.0.

pmwkaa

Looks great!

@airton-neto

With this release, we are officially moving TimescaleDB 2.0 to GA, concluding several release candidates. TimescaleDB 2.0 adds the much-anticipated support for distributed hypertables (multi-node TimescaleDB), as well as new features and enhancements to core functionality to give users better clarity and more control and flexibility over their data. Multi-node architecture: In particular, with TimescaleDB 2.0, users can now create distributed hypertables across multiple instances of TimescaleDB, configured so that one instance serves as an access node and multiple others as data nodes. All queries for a distributed hypertable are issued to the access node, but inserted data and queries are pushed down across data nodes for greater scale and performance. Multi-node TimescaleDB can be self managed or, for easier operation, launched within Timescale's fully-managed cloud services. This release also adds: * Support for user-defined actions, allowing users to define, customize, and schedule automated tasks, which can be run by the built-in jobs scheduling framework now exposed to users. * Significant changes to continuous aggregates, which now separate the view creation from the policy. Users can now refresh individual regions of the continuous aggregate materialized view, or schedule automated refreshing via policy. * Redesigned informational views, including new (and more general) views for information about hypertable's dimensions and chunks, policies and user-defined actions, as well as support for multi-node TimescaleDB. * Moving all formerly enterprise features into our Community Edition, and updating Timescale License, which now provides additional (more permissive) rights to users and developers. Some of the changes above (e.g., continuous aggregates, updated informational views) do introduce breaking changes to APIs and are not backwards compatible. While the update scripts in TimescaleDB 2.0 will upgrade databases running TimescaleDB 1.x automatically, some of these API and feature changes may require changes to clients and/or upstream scripts that rely on the previous APIs. Before upgrading, we recommend reviewing upgrade documentation at docs.timescale.com for more details. **Major Features** TimescaleDB 2.0 moves the following major features to GA: * timescale#1923 Add support for distributed hypertables * timescale#2006 Add support for user-defined actions * timescale#2125 timescale#2221 Improve Continuous Aggregate API * timescale#2084 timescale#2089 timescale#2098 timescale#2417 Redesign informational views * timescale#2435 Move enterprise features to community * timescale#2437 Update Timescale License **Previous Release Candidates** * timescale#2702 Release Candidate 4 (December 2, 2020) * timescale#2637 Release Candidate 3 (November 12, 2020) * timescale#2554 Release Candidate 2 (October 20, 2020) * timescale#2478 Release Candidate 1 (October 1, 2020) **Minor Features** Since the last release candidate 4, it includes several minor improvements: * timescale#2746 Optimize locking for create chunk API * timescale#2705 Block tableoid access on distributed hypertable * timescale#2730 Do not allow unique index on compressed hypertables **Bugfixes** Since the last release candidate 4, it includes several bugfixes: * timescale#2719 Support disabling compression on distributed hypertables * timescale#2742 Fix compression status in chunks view for distributed chunks * timescale#2751 Fix crash and cancel when adding data node **Thanks** Thanks to all contributors for the TimescaleDB 2.0 release: * @airton-neto for reporting a bug in executing some queries with UNION * @nshah14285 for reporting an issue with propagating privileges * @kalman5 for reporting an issue with renaming constraints * @LbaNeXte for reporting a bug in decompression for queries with subqueries * @semtexzv for reporting an issue with continuous aggregates on int-based hypertables * @mr-ns for reporting an issue with privileges for creating chunks * @cloud-rocket for reporting an issue with setting an owner on continuous aggregate * @jocrau for reporting a bug during creating an index with transaction per chunk * @fvannee for reporting an issue with custom time types * @ArtificialPB for reporting a bug in executing queries with conditional ordering on compressed hypertable * @dutchgecko for reporting an issue with continuous aggregate datatype handling * @lambdaq for suggesting to improve error message in continuous aggregate creation * @francesco11112 for reporting memory issue on COPY * @Netskeh for reporting bug on time_bucket problem in continuous aggregates * @mr-ns for reporting the issue with CTEs on distributed hypertables * @akamensky for reporting an issue with recursive cache invalidation * @ryanbooz for reporting slow queries with real-time aggregation on continuous aggregates * @cevian for reporting an issue with disabling compression on distributed hypertables

k-rus requested review from erimatnor, mfreed and mkindahl December 17, 2020 09:33

mkindahl reviewed Dec 17, 2020

View reviewed changes

CHANGELOG.md Outdated Show resolved Hide resolved

k-rus force-pushed the 2.0.0-release branch from 0e41d6a to 73d79f3 Compare December 17, 2020 10:50

erimatnor reviewed Dec 17, 2020

View reviewed changes

CHANGELOG.md Outdated Show resolved Hide resolved

CHANGELOG.md Show resolved Hide resolved

erimatnor added the release label Dec 17, 2020

k-rus force-pushed the 2.0.0-release branch from 73d79f3 to ea96afa Compare December 17, 2020 20:39

k-rus requested review from erimatnor, mkindahl and NunoFilipeSantos December 17, 2020 20:39

k-rus force-pushed the 2.0.0-release branch from ea96afa to 6d3c078 Compare December 17, 2020 20:45

mfreed approved these changes Dec 17, 2020

View reviewed changes

k-rus force-pushed the 2.0.0-release branch from 6d3c078 to 81a01bb Compare December 18, 2020 08:00

erimatnor approved these changes Dec 18, 2020

View reviewed changes

k-rus force-pushed the 2.0.0-release branch from 81a01bb to ef64477 Compare December 18, 2020 13:37

k-rus force-pushed the 2.0.0-release branch from ef64477 to 4ed4a39 Compare December 18, 2020 15:59

k-rus marked this pull request as ready for review December 18, 2020 16:24

k-rus requested a review from a team as a code owner December 18, 2020 16:24

k-rus requested review from svenklemm and removed request for a team December 18, 2020 16:24

pmwkaa approved these changes Dec 18, 2020

View reviewed changes

k-rus force-pushed the 2.0.0-release branch from 4ed4a39 to e3a0cf3 Compare December 18, 2020 19:50

k-rus requested review from erimatnor and mfreed December 18, 2020 19:50

mfreed approved these changes Dec 18, 2020

View reviewed changes

k-rus merged commit 07175eb into timescale:master Dec 18, 2020

k-rus deleted the 2.0.0-release branch December 18, 2020 20:15

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release 2.0.0 #2753

Release 2.0.0 #2753

k-rus commented Dec 17, 2020 •

edited

Loading

codecov bot commented Dec 17, 2020 •

edited

Loading

mfreed commented Dec 17, 2020

erimatnor commented Dec 17, 2020

mfreed commented Dec 17, 2020

mfreed Dec 17, 2020

erimatnor left a comment

feikesteenbergen commented Dec 18, 2020

k-rus commented Dec 18, 2020

pmwkaa left a comment

		* Improve Continuous Aggregate API
		* Redesign informational views

Release 2.0.0 #2753

Release 2.0.0 #2753

Conversation

k-rus commented Dec 17, 2020 • edited Loading

codecov bot commented Dec 17, 2020 • edited Loading

Codecov Report

mfreed commented Dec 17, 2020

erimatnor commented Dec 17, 2020

mfreed commented Dec 17, 2020

mfreed Dec 17, 2020

Choose a reason for hiding this comment

erimatnor left a comment

Choose a reason for hiding this comment

feikesteenbergen commented Dec 18, 2020

k-rus commented Dec 18, 2020

pmwkaa left a comment

Choose a reason for hiding this comment

k-rus commented Dec 17, 2020 •

edited

Loading

codecov bot commented Dec 17, 2020 •

edited

Loading