From d2397b5dffb920aff5d4e1abd2b1228428382abb Mon Sep 17 00:00:00 2001 From: dl239 Date: Mon, 26 Jun 2023 17:46:40 +0800 Subject: [PATCH 1/6] docs: upgrade 0.8.1 --- demo/java_quickstart/demo/pom.xml | 2 +- demo/jd-recommendation/README.md | 2 +- demo/predict-taxi-trip-duration/README.md | 4 +- .../README.md | 2 +- docs/en/deploy/compile.md | 8 +-- docs/en/deploy/install_deploy.md | 50 +++++++------- docs/en/quickstart/java_sdk.md | 10 +-- docs/en/quickstart/openmldb_quickstart.md | 2 +- docs/en/reference/ip_tips.md | 6 +- docs/en/use_case/JD_recommendation_en.md | 2 +- docs/en/use_case/airflow_provider_demo.md | 2 +- .../en/use_case/dolphinscheduler_task_demo.md | 2 +- docs/en/use_case/kafka_connector_demo.md | 2 +- docs/en/use_case/lightgbm_demo.md | 2 +- docs/en/use_case/pulsar_connector_demo.md | 2 +- docs/en/use_case/talkingdata_demo.md | 2 +- docs/zh/deploy/compile.md | 8 +-- docs/zh/deploy/install_deploy.md | 68 +++++++++---------- .../deploy_integration/OpenMLDB_Byzer_taxi.md | 2 +- .../airflow_provider_demo.md | 2 +- .../dolphinscheduler_task_demo.md | 2 +- .../kafka_connector_demo.md | 2 +- .../pulsar_connector_demo.md | 2 +- docs/zh/quickstart/openmldb_quickstart.md | 2 +- docs/zh/quickstart/sdk/java_sdk.md | 10 +-- docs/zh/reference/ip_tips.md | 12 ++-- docs/zh/tutorial/standalone_use.md | 2 +- docs/zh/use_case/JD_recommendation.md | 2 +- docs/zh/use_case/talkingdata_demo.md | 2 +- .../use_case/taxi_tour_duration_prediction.md | 2 +- release/conf/openmldb-env.sh | 2 +- 31 files changed, 110 insertions(+), 110 deletions(-) diff --git a/demo/java_quickstart/demo/pom.xml b/demo/java_quickstart/demo/pom.xml index 77d456f2931..0d22f4f841b 100644 --- a/demo/java_quickstart/demo/pom.xml +++ b/demo/java_quickstart/demo/pom.xml @@ -29,7 +29,7 @@ com.4paradigm.openmldb openmldb-jdbc - 0.8.0 + 0.8.1 org.testng diff --git a/demo/jd-recommendation/README.md b/demo/jd-recommendation/README.md index c7d97e21a5b..4780b03e347 100644 --- a/demo/jd-recommendation/README.md +++ b/demo/jd-recommendation/README.md @@ -11,7 +11,7 @@ For full instructions, please refer to [website page](http://openmldb.ai/docs/zh ## OpenMLDB Feature Extraction ``` -docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.0 bash +docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.1 bash docker exec -it openmldb bash ``` diff --git a/demo/predict-taxi-trip-duration/README.md b/demo/predict-taxi-trip-duration/README.md index 1a4de10c6a4..c057382d00c 100644 --- a/demo/predict-taxi-trip-duration/README.md +++ b/demo/predict-taxi-trip-duration/README.md @@ -28,7 +28,7 @@ w2 as (PARTITION BY passenger_count ORDER BY pickup_datetime ROWS_RANGE BETWEEN **Start docker** ``` -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` **Initialize environment** ```bash @@ -138,7 +138,7 @@ python3 predict.py **Start docker** ```bash -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` **Initialize environment** diff --git a/demo/talkingdata-adtracking-fraud-detection/README.md b/demo/talkingdata-adtracking-fraud-detection/README.md index 094dec84a27..89a02eeee1e 100644 --- a/demo/talkingdata-adtracking-fraud-detection/README.md +++ b/demo/talkingdata-adtracking-fraud-detection/README.md @@ -15,7 +15,7 @@ We recommend you to use docker to run the demo. OpenMLDB and dependencies have b **Start docker** ``` -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` #### Run locally diff --git a/docs/en/deploy/compile.md b/docs/en/deploy/compile.md index 2cb05b964e7..f27fac053a3 100644 --- a/docs/en/deploy/compile.md +++ b/docs/en/deploy/compile.md @@ -7,7 +7,7 @@ This section describes the steps to compile and use OpenMLDB inside its official docker image [hybridsql](https://hub.docker.com/r/4pdosc/hybridsql). The docker image has packed required tools and dependencies, so there is no need to set them up separately. To compile without the official docker image, refer to the section [Detailed Instructions for Build](#detailed-instructions-for-build) below. -Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.0) under `hybridsql:0.8.0` ，If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead. +Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.1](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.1) under `hybridsql:0.8.1` ，If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead. 1. Pull the docker image @@ -21,11 +21,11 @@ Keep in mind that you should always use the same version of both compile image a docker run -it 4pdosc/hybridsql:0.8 bash ``` -3. Download the OpenMLDB source code inside the docker container, and setting the branch into v0.8.0 +3. Download the OpenMLDB source code inside the docker container, and setting the branch into v0.8.1 ```bash cd ~ - git clone -b v0.8.0 https://github.com/4paradigm/OpenMLDB.git + git clone -b v0.8.1 https://github.com/4paradigm/OpenMLDB.git ``` 4. Compile OpenMLDB @@ -151,7 +151,7 @@ The built jar packages are in the `target` path of each submodule. If you want t 1. Downloading the pre-built OpenMLDB Spark distribution: ```bash -wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.0/spark-3.2.1-bin-openmldbspark.tgz +wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.1/spark-3.2.1-bin-openmldbspark.tgz ``` Alternatively, you can also download the source code and compile from scratch: diff --git a/docs/en/deploy/install_deploy.md b/docs/en/deploy/install_deploy.md index 0c85f473dd9..491a7b94483 100644 --- a/docs/en/deploy/install_deploy.md +++ b/docs/en/deploy/install_deploy.md @@ -9,7 +9,7 @@ * The number of cores is recommended to be no less than 4 cores. If the CPU does not support the AVX2 instruction set in the Linux environment, the deployment package needs to be recompiled from the source code. ## Deployment Package -The precompiled OpenMLDB deployment package is used by default in this documentation ([Linux](https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz) , [macOS](https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-darwin.tar.gz)), the supported operating system requirements are: CentOS 7, Ubuntu 20.04, macOS >= 10.15. If the user wishes to compile by himself (for example, for OpenMLDB source code development, the operating system or CPU architecture is not in the support list of the precompiled deployment package, etc.), the user can choose to compile and use in the docker container or compile from the source code. For details, please refer to our [compile documentation](compile.md). +The precompiled OpenMLDB deployment package is used by default in this documentation ([Linux](https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz) , [macOS](https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-darwin.tar.gz)), the supported operating system requirements are: CentOS 7, Ubuntu 20.04, macOS >= 10.15. If the user wishes to compile by himself (for example, for OpenMLDB source code development, the operating system or CPU architecture is not in the support list of the precompiled deployment package, etc.), the user can choose to compile and use in the docker container or compile from the source code. For details, please refer to our [compile documentation](compile.md). ## Configure Environment (Linux) @@ -91,9 +91,9 @@ OpenMLDB standalone version needs to deploy a nameserver and a tablet. The names ### Download the OpenMLDB Release Package ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -cd openmldb-0.8.0-linux +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +cd openmldb-0.8.1-linux ``` ### Configuration @@ -163,9 +163,9 @@ Environment Requirements: ### Download the OpenMLDB Deployment Package ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -cd openmldb-0.8.0-linux +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +cd openmldb-0.8.1-linux ``` ### Configuration @@ -175,7 +175,7 @@ which are listed below. | Environment Variables | Default Values | Definitons | |-----------------------------------|---------------------------------------------------------|-------------------------------------------------------------------------------------------------------| -| OPENMLDB_VERSION | 0.8.0 | OpenMLDB version | +| OPENMLDB_VERSION | 0.8.1 | OpenMLDB version | | OPENMLDB_MODE | standalone | standalone or cluster mode | | OPENMLDB_HOME | root directory of the release folder | openmldb root path | | SPARK_HOME | $OPENMLDB_HOME/spark | the root path of openmldb spark release. if not exists, download from online | @@ -311,10 +311,10 @@ Deploy the Zookeeper cluster [refer to here](https://zookeeper.apache.org/doc/r3 #### 1. Download the OpenMLDB Deployment Package ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-tablet-0.8.0 -cd openmldb-tablet-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-tablet-0.8.1 +cd openmldb-tablet-0.8.1 ``` #### 2. Modify the Configuration File: conf/tablet.flags @@ -361,10 +361,10 @@ Repeat the above steps to deploy multiple tablets. #### 1. Download the OpenMLDB Deployment Package ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-ns-0.8.0 -cd openmldb-ns-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-ns-0.8.1 +cd openmldb-ns-0.8.1 ``` #### 2. Modify the Configuration File: conf/nameserver.flags @@ -411,10 +411,10 @@ Before running, make sure that the OpenMLDB cluster has been started, otherwise #### 1. Download the OpenMLDB Deployment Package ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-apiserver-0.8.0 -cd openmldb-apiserver-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-apiserver-0.8.1 +cd openmldb-apiserver-0.8.1 ``` #### 2. Modify the Configuration File: conf/apiserver.flags @@ -454,12 +454,12 @@ TaskManager can be deployed in single server. You can deploy multiple instances #### 1. Download the OpenMLDB Spark Distribution that is Optimized for Feature Engineering ``` -wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.0/spark-3.2.1-bin-openmldbspark.tgz +wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.1/spark-3.2.1-bin-openmldbspark.tgz tar -zxvf spark-3.2.1-bin-openmldbspark.tgz -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-taskmanager-0.8.0 -cd openmldb-taskmanager-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-taskmanager-0.8.1 +cd openmldb-taskmanager-0.8.1 ``` #### 2. Modify the Configuration File conf/taskmanager.properties diff --git a/docs/en/quickstart/java_sdk.md b/docs/en/quickstart/java_sdk.md index df87fb6960a..15971477574 100644 --- a/docs/en/quickstart/java_sdk.md +++ b/docs/en/quickstart/java_sdk.md @@ -9,12 +9,12 @@ Configure maven pom com.4paradigm.openmldb openmldb-jdbc - 0.8.0 + 0.8.1 com.4paradigm.openmldb openmldb-native - 0.8.0 + 0.8.1 ``` ### Package Installation on Mac @@ -24,15 +24,15 @@ Configure maven pom com.4paradigm.openmldb openmldb-jdbc - 0.8.0 + 0.8.1 com.4paradigm.openmldb openmldb-native - 0.8.0-macos + 0.8.1-macos ``` -Note that since `openmldb-native` contains the C++ static library compiled by OpenMLDB, by default it is a Linux's static library. On macOS, the version of the above openmldb-native needs to be changed to `0.8.0-macos`, and the version of openmldb-jdbc remains unchanged. +Note that since `openmldb-native` contains the C++ static library compiled by OpenMLDB, by default it is a Linux's static library. On macOS, the version of the above openmldb-native needs to be changed to `0.8.1-macos`, and the version of openmldb-jdbc remains unchanged. The macOS native relase only supports macos-12. If you want use in macos-11 or macos 10.15, you should build openmldb-native from source in macos-11/macos-10.15, see [Build Java SDK](../deploy/compile.md#build-java-sdk-with-multi-processes) for details. diff --git a/docs/en/quickstart/openmldb_quickstart.md b/docs/en/quickstart/openmldb_quickstart.md index 0fe29102310..84e9e8d99e1 100644 --- a/docs/en/quickstart/openmldb_quickstart.md +++ b/docs/en/quickstart/openmldb_quickstart.md @@ -17,7 +17,7 @@ If you wan to compile and install it by yourself, you can refer to our [installa Pull the image (image download size is about 1GB, after decompression is about 1.7 GB) and start the docker container: ```bash -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` ```{important} diff --git a/docs/en/reference/ip_tips.md b/docs/en/reference/ip_tips.md index dad9ae01c55..826555ac630 100644 --- a/docs/en/reference/ip_tips.md +++ b/docs/en/reference/ip_tips.md @@ -38,12 +38,12 @@ Expose the port through `-p` when starting the container, and the client can acc The stand-alone version needs to expose the ports of three components (nameserver, tabletserver, apiserver): ``` -docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.0 bash +docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.1 bash ``` The cluster version needs to expose the zk port and the ports of all components: ``` -docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.0 bash +docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.1 bash ``` ```{tip} @@ -57,7 +57,7 @@ If the OpenMLDB service process is distributed, the "port number is occupied" ap #### Host Network Or more conveniently, use host networking without port isolation, for example: ``` -docker run --network host -it 4pdosc/openmldb:0.8.0 bash +docker run --network host -it 4pdosc/openmldb:0.8.1 bash ``` But in this case, it is easy to find that the port is occupied by other processes in the host. If occupancy occurs, change the port number carefully. diff --git a/docs/en/use_case/JD_recommendation_en.md b/docs/en/use_case/JD_recommendation_en.md index e605fa35be6..df0cdc68399 100644 --- a/docs/en/use_case/JD_recommendation_en.md +++ b/docs/en/use_case/JD_recommendation_en.md @@ -52,7 +52,7 @@ Oneflow-serving：https://github.com/Oneflow-Inc/serving/tree/ce5d667468b6b3ba66 Pull the OpenMLDB docker image and run. ```bash -docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.0 bash +docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.1 bash docker exec -it openmldb bash ``` diff --git a/docs/en/use_case/airflow_provider_demo.md b/docs/en/use_case/airflow_provider_demo.md index 4702656d8be..d5b39888b38 100644 --- a/docs/en/use_case/airflow_provider_demo.md +++ b/docs/en/use_case/airflow_provider_demo.md @@ -34,7 +34,7 @@ For the newest version, please visit [GitHub example_dags](https://github.com/4p - Please project the previously downloaded files to the path `/work/airflow/dags`, where Airflow will access for the DAG. ``` -docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow/dags -it 4pdosc/openmldb:0.8.0 bash +docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow/dags -it 4pdosc/openmldb:0.8.1 bash ``` #### 0.3 Download and Install the Airflow and the Airflow OpenMLDB Provider diff --git a/docs/en/use_case/dolphinscheduler_task_demo.md b/docs/en/use_case/dolphinscheduler_task_demo.md index 929bc642df4..a5880a868ee 100644 --- a/docs/en/use_case/dolphinscheduler_task_demo.md +++ b/docs/en/use_case/dolphinscheduler_task_demo.md @@ -33,7 +33,7 @@ In addition to the feature engineering done by OpenMLDB, the prediction also req The demo can run on MacOS or Linux, the OpenMLDB docker image is recommended. We'll start OpenMLDB and DolphinScheduler in the same container, expose the DolphinScheduler web port: ``` -docker run -it -p 12345:12345 4pdosc/openmldb:0.8.0 bash +docker run -it -p 12345:12345 4pdosc/openmldb:0.8.1 bash ``` ```{attention} diff --git a/docs/en/use_case/kafka_connector_demo.md b/docs/en/use_case/kafka_connector_demo.md index 093356cd66d..f5168668480 100644 --- a/docs/en/use_case/kafka_connector_demo.md +++ b/docs/en/use_case/kafka_connector_demo.md @@ -22,7 +22,7 @@ For OpenMLDB Kafka Connector implementation, please refer to [extensions/kafka-c This article will start the OpenMLDB in docker container, so there is no need to download the OpenMLDB separately. Moreover, Kafka and connector can be started in the same container. We recommend that you save the three downloaded packages to the same directory. Let's assume that the packages are in the `/work/kafka` directory. ``` -docker run -it -v `pwd`:/work/kafka --name openmldb 4pdosc/openmldb:0.8.0 bash +docker run -it -v `pwd`:/work/kafka --name openmldb 4pdosc/openmldb:0.8.1 bash ``` ### Steps diff --git a/docs/en/use_case/lightgbm_demo.md b/docs/en/use_case/lightgbm_demo.md index 6fb92b049b6..010c9fe27b0 100644 --- a/docs/en/use_case/lightgbm_demo.md +++ b/docs/en/use_case/lightgbm_demo.md @@ -13,7 +13,7 @@ Note that: (1) this case is based on the OpenMLDB cluster version for tutorial d - Pull the OpenMLDB docker image and run the corresponding container: ```bash -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` The image is preinstalled with OpenMLDB and preset with all scripts, third-party libraries, open-source tools and training data required for this case. diff --git a/docs/en/use_case/pulsar_connector_demo.md b/docs/en/use_case/pulsar_connector_demo.md index 3caaa8324c1..5c8f18fcfa6 100644 --- a/docs/en/use_case/pulsar_connector_demo.md +++ b/docs/en/use_case/pulsar_connector_demo.md @@ -29,7 +29,7 @@ Only OpenMLDB cluster mode can be the sink dist, and only write to online storag We recommend that you use ‘host network’ to run docker. And bind volume ‘files’ too. The sql scripts are in it. ``` -docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.0 bash +docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.1 bash docker exec -it openmldb bash ``` ```{note} diff --git a/docs/en/use_case/talkingdata_demo.md b/docs/en/use_case/talkingdata_demo.md index 962660f8e27..959b382b4c5 100644 --- a/docs/en/use_case/talkingdata_demo.md +++ b/docs/en/use_case/talkingdata_demo.md @@ -13,7 +13,7 @@ It is recommended to run this demo in Docker. Please make sure that OpenMLDB and **Start the OpenMLDB Docker Image** ``` -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` #### 1.1.2 Run Locally diff --git a/docs/zh/deploy/compile.md b/docs/zh/deploy/compile.md index 24c7da01ff3..02ff8fab883 100644 --- a/docs/zh/deploy/compile.md +++ b/docs/zh/deploy/compile.md @@ -4,7 +4,7 @@ 此节介绍在官方编译镜像 [hybridsql](https://hub.docker.com/r/4pdosc/hybridsql) 中编译 OpenMLDB，主要可以用于在容器内试用和开发目的。镜像内置了编译所需要的工具和依赖，因此不需要额外的步骤单独配置它们。关于基于非 docker 的编译使用方式，请参照下面的 [从源码全量编译](#从源码全量编译) 章节。 -对于编译镜像的版本，需要注意拉取的镜像版本和 [OpenMLDB 发布版本](https://github.com/4paradigm/OpenMLDB/releases)保持一致。以下例子演示了在 `hybridsql:0.8.0` 镜像版本上编译 [OpenMLDB v0.8.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.0) 的代码，如果要编译最新 `main` 分支的代码，则需要拉取 `hybridsql:latest` 版本镜像。 +对于编译镜像的版本，需要注意拉取的镜像版本和 [OpenMLDB 发布版本](https://github.com/4paradigm/OpenMLDB/releases)保持一致。以下例子演示了在 `hybridsql:0.8.1` 镜像版本上编译 [OpenMLDB v0.8.1](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.1) 的代码，如果要编译最新 `main` 分支的代码，则需要拉取 `hybridsql:latest` 版本镜像。 1. 下载 docker 镜像 ```bash @@ -16,10 +16,10 @@ docker run -it 4pdosc/hybridsql:0.8 bash ``` -3. 在 docker 容器内, 克隆 OpenMLDB, 并切换分支到 v0.8.0 +3. 在 docker 容器内, 克隆 OpenMLDB, 并切换分支到 v0.8.1 ```bash cd ~ - git clone -b v0.8.0 https://github.com/4paradigm/OpenMLDB.git + git clone -b v0.8.1 https://github.com/4paradigm/OpenMLDB.git ``` 4. 在 docker 容器内编译 OpenMLDB @@ -141,7 +141,7 @@ make SQL_JAVASDK_ENABLE=ON NPROC=4 1. 下载预编译的OpenMLDB Spark发行版。 ```bash -wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.0/spark-3.2.1-bin-openmldbspark.tgz +wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.1/spark-3.2.1-bin-openmldbspark.tgz ``` 或者下载源代码并从头开始编译。 diff --git a/docs/zh/deploy/install_deploy.md b/docs/zh/deploy/install_deploy.md index 73d83892e9b..afd06c0b3bf 100644 --- a/docs/zh/deploy/install_deploy.md +++ b/docs/zh/deploy/install_deploy.md @@ -36,17 +36,17 @@ ### Linux 平台预测试 -由于 Linux 平台的多样性，发布包可能在你的机器上不兼容，请先通过简单的运行测试。比如，下载预编译包 `openmldb-0.8.0-linux.tar.gz` 以后，运行： +由于 Linux 平台的多样性，发布包可能在你的机器上不兼容，请先通过简单的运行测试。比如，下载预编译包 `openmldb-0.8.1-linux.tar.gz` 以后，运行： ``` -tar -zxvf openmldb-0.8.0-linux.tar.gz -./openmldb-0.8.0-linux/bin/openmldb --version +tar -zxvf openmldb-0.8.1-linux.tar.gz +./openmldb-0.8.1-linux/bin/openmldb --version ``` 结果应显示该程序的版本号，类似 ``` -openmldb version 0.8.0-xxxx +openmldb version 0.8.1-xxxx Debug build (NDEBUG not #defined) ``` @@ -159,9 +159,9 @@ OpenMLDB集群版需要部署ZooKeeper、NameServer、TabletServer、TaskManager ### 下载OpenMLDB发行版 ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -cd openmldb-0.8.0-linux +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +cd openmldb-0.8.1-linux ``` ### 环境配置 @@ -169,7 +169,7 @@ cd openmldb-0.8.0-linux | 环境变量 | 默认值 | 定义 | |-----------------------------------|------------------------------------|-------------------------------------------------------------------------| -| OPENMLDB_VERSION | 0.8.0 | OpenMLDB版本 | +| OPENMLDB_VERSION | 0.8.1 | OpenMLDB版本 | | OPENMLDB_MODE | standalone | standalone或者cluster | | OPENMLDB_HOME | 当前发行版的根目录 | openmldb发行版根目录 | | SPARK_HOME | $OPENMLDB_HOME/spark | openmldb spark发行版根目录，如果该目录不存在，自动从网上下载 | @@ -334,10 +334,10 @@ bash bin/zkCli.sh -server 172.27.128.33:7181 **1. 下载OpenMLDB部署包** ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-tablet-0.8.0 -cd openmldb-tablet-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-tablet-0.8.1 +cd openmldb-tablet-0.8.1 ``` **2. 修改配置文件`conf/tablet.flags`** ```bash @@ -388,12 +388,12 @@ Start tablet success 在另一台机器启动下一个TabletServer只需在该机器上重复以上步骤。如果是在同一个机器上启动下一个TabletServer，请保证是在另一个目录中，不要重复使用已经启动过TabletServer的目录。 -比如，可以再次解压压缩包（不要cp已经启动过TabletServer的目录，启动后的生成文件会造成影响），并命名目录为`openmldb-tablet-0.8.0-2`。 +比如，可以再次解压压缩包（不要cp已经启动过TabletServer的目录，启动后的生成文件会造成影响），并命名目录为`openmldb-tablet-0.8.1-2`。 ``` -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-tablet-0.8.0-2 -cd openmldb-tablet-0.8.0-2 +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-tablet-0.8.1-2 +cd openmldb-tablet-0.8.1-2 ``` 再修改配置并启动。注意，TabletServer如果都在同一台机器上，请使用不同端口号，否则日志(logs/tablet.WARNING)中将会有"Fail to listen"信息。 @@ -407,10 +407,10 @@ cd openmldb-tablet-0.8.0-2 ``` **1. 下载OpenMLDB部署包** ```` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-ns-0.8.0 -cd openmldb-ns-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-ns-0.8.1 +cd openmldb-ns-0.8.1 ```` **2. 修改配置文件conf/nameserver.flags** ```bash @@ -448,12 +448,12 @@ NameServer 可以只存在一台，如果你需要高可用性，可以部署多 在另一台机器启动下一个 NameServer 只需在该机器上重复以上步骤。如果是在同一个机器上启动下一个 NameServer，请保证是在另一个目录中，不要重复使用已经启动过 namserver 的目录。 -比如，可以再次解压压缩包（不要cp已经启动过 namserver 的目录，启动后的生成文件会造成影响），并命名目录为`openmldb-ns-0.8.0-2`。 +比如，可以再次解压压缩包（不要cp已经启动过 namserver 的目录，启动后的生成文件会造成影响），并命名目录为`openmldb-ns-0.8.1-2`。 ``` -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-ns-0.8.0-2 -cd openmldb-ns-0.8.0-2 +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-ns-0.8.1-2 +cd openmldb-ns-0.8.1-2 ``` 然后再修改配置并启动。 @@ -491,10 +491,10 @@ APIServer负责接收http请求，转发给OpenMLDB集群并返回结果。它 **1. 下载OpenMLDB部署包** ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-apiserver-0.8.0 -cd openmldb-apiserver-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-apiserver-0.8.1 +cd openmldb-apiserver-0.8.1 ``` **2. 修改配置文件conf/apiserver.flags** @@ -549,18 +549,18 @@ TaskManager 可以只存在一台，如果你需要高可用性，可以部署 Spark发行版： ```shell -wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.0/spark-3.2.1-bin-openmldbspark.tgz -# 中国镜像地址：http://43.138.115.238/download/v0.8.0/spark-3.2.1-bin-openmldbspark.tgz +wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.1/spark-3.2.1-bin-openmldbspark.tgz +# 中国镜像地址：http://43.138.115.238/download/v0.8.1/spark-3.2.1-bin-openmldbspark.tgz tar -zxvf spark-3.2.1-bin-openmldbspark.tgz export SPARK_HOME=`pwd`/spark-3.2.1-bin-openmldbspark/ ``` OpenMLDB部署包： ``` -wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz -tar -zxvf openmldb-0.8.0-linux.tar.gz -mv openmldb-0.8.0-linux openmldb-taskmanager-0.8.0 -cd openmldb-taskmanager-0.8.0 +wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.1/openmldb-0.8.1-linux.tar.gz +tar -zxvf openmldb-0.8.1-linux.tar.gz +mv openmldb-0.8.1-linux openmldb-taskmanager-0.8.1 +cd openmldb-taskmanager-0.8.1 ``` **2. 修改配置文件conf/taskmanager.properties** diff --git a/docs/zh/integration/deploy_integration/OpenMLDB_Byzer_taxi.md b/docs/zh/integration/deploy_integration/OpenMLDB_Byzer_taxi.md index 1ae2e7ea1fa..24afdcc4b79 100644 --- a/docs/zh/integration/deploy_integration/OpenMLDB_Byzer_taxi.md +++ b/docs/zh/integration/deploy_integration/OpenMLDB_Byzer_taxi.md @@ -13,7 +13,7 @@ 执行命令如下： ``` -docker run --network host -dit --name openmldb -v /mlsql/admin/:/byzermnt 4pdosc/openmldb:0.8.0 bash +docker run --network host -dit --name openmldb -v /mlsql/admin/:/byzermnt 4pdosc/openmldb:0.8.1 bash docker exec -it openmldb bash /work/init.sh echo "create database db1;" | /work/openmldb/bin/openmldb --zk_cluster=127.0.0.1:2181 --zk_root_path=/openmldb --role=sql_client diff --git a/docs/zh/integration/deploy_integration/airflow_provider_demo.md b/docs/zh/integration/deploy_integration/airflow_provider_demo.md index 6226f6c4ebc..481d27f0960 100644 --- a/docs/zh/integration/deploy_integration/airflow_provider_demo.md +++ b/docs/zh/integration/deploy_integration/airflow_provider_demo.md @@ -35,7 +35,7 @@ ls airflow_demo_files 登录Airflow Web需要对外端口，所以此处暴露容器的端口。并且直接将上一步下载的文件映射到`/work/airflow/dags`，接下来Airflow将加载此文件夹的DAG。 ``` -docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow_demo_files -it 4pdosc/openmldb:0.8.0 bash +docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow_demo_files -it 4pdosc/openmldb:0.8.1 bash ``` #### 0.3 下载安装Airflow与Airflow OpenMLDB Provider diff --git a/docs/zh/integration/deploy_integration/dolphinscheduler_task_demo.md b/docs/zh/integration/deploy_integration/dolphinscheduler_task_demo.md index 2d03d097d8d..05cbf896ba0 100644 --- a/docs/zh/integration/deploy_integration/dolphinscheduler_task_demo.md +++ b/docs/zh/integration/deploy_integration/dolphinscheduler_task_demo.md @@ -31,7 +31,7 @@ OpenMLDB 希望能达成开发即上线的目标，让开发回归本质，而 测试可以在macOS或Linux上运行，推荐在我们提供的 OpenMLDB 镜像内进行演示测试。我们将在这个容器中启动OpenMLDB和DolphinScheduler，暴露DolphinScheduler的web端口： ``` -docker run -it -p 12345:12345 4pdosc/openmldb:0.8.0 bash +docker run -it -p 12345:12345 4pdosc/openmldb:0.8.1 bash ``` ```{attention} DolphinScheduler 需要配置租户，是操作系统的用户，并且该用户需要有 sudo 权限。所以推荐在 OpenMLDB 容器内下载并启动 DolphinScheduler。否则，请准备有sudo权限的操作系统用户。 diff --git a/docs/zh/integration/online_datasources/kafka_connector_demo.md b/docs/zh/integration/online_datasources/kafka_connector_demo.md index 8ababc4597d..34a165df028 100644 --- a/docs/zh/integration/online_datasources/kafka_connector_demo.md +++ b/docs/zh/integration/online_datasources/kafka_connector_demo.md @@ -21,7 +21,7 @@ OpenMLDB Kafka Connector实现见[extensions/kafka-connect-jdbc](https://github. 我们推荐你将下载的三个文件包都绑定到文件目录`kafka`。当然，也可以在启动容器后，再进行文件包的下载。我们假设文件包都在`/work/kafka`目录中。 ``` -docker run -it -v `pwd`:/work/kafka 4pdosc/openmldb:0.8.0 bash +docker run -it -v `pwd`:/work/kafka 4pdosc/openmldb:0.8.1 bash ``` ### 流程 diff --git a/docs/zh/integration/online_datasources/pulsar_connector_demo.md b/docs/zh/integration/online_datasources/pulsar_connector_demo.md index 9014fd2c3c6..5764078c225 100644 --- a/docs/zh/integration/online_datasources/pulsar_connector_demo.md +++ b/docs/zh/integration/online_datasources/pulsar_connector_demo.md @@ -35,7 +35,7 @@ Apache Pulsar是一个云原生的，分布式消息流平台。它可以作为O ``` 我们更推荐你使用‘host network’模式运行docker，以及绑定文件目录‘files’，sql脚本在该目录中。 ``` -docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.0 bash +docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.1 bash docker exec -it openmldb bash ``` diff --git a/docs/zh/quickstart/openmldb_quickstart.md b/docs/zh/quickstart/openmldb_quickstart.md index bf00660cf1f..373c057f7a0 100644 --- a/docs/zh/quickstart/openmldb_quickstart.md +++ b/docs/zh/quickstart/openmldb_quickstart.md @@ -19,7 +19,7 @@ OpenMLDB 的主要使用场景为作为机器学习的实时特征平台。其 在命令行执行以下命令拉取 OpenMLDB 镜像，并启动 Docker 容器： ```bash -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` ```{note} diff --git a/docs/zh/quickstart/sdk/java_sdk.md b/docs/zh/quickstart/sdk/java_sdk.md index acc5cd49fdf..446330c2782 100644 --- a/docs/zh/quickstart/sdk/java_sdk.md +++ b/docs/zh/quickstart/sdk/java_sdk.md @@ -10,12 +10,12 @@ com.4paradigm.openmldb openmldb-jdbc - 0.8.0 + 0.8.1 com.4paradigm.openmldb openmldb-native - 0.8.0 + 0.8.1 ``` @@ -27,16 +27,16 @@ com.4paradigm.openmldb openmldb-jdbc - 0.8.0 + 0.8.1 com.4paradigm.openmldb openmldb-native - 0.8.0-macos + 0.8.1-macos ``` -注意：由于 openmldb-native 中包含了 OpenMLDB 编译的 C++ 静态库，默认是 Linux 静态库，macOS 上需将上述 openmldb-native 的 version 改成 `0.8.0-macos`，openmldb-jdbc 的版本保持不变。 +注意：由于 openmldb-native 中包含了 OpenMLDB 编译的 C++ 静态库，默认是 Linux 静态库，macOS 上需将上述 openmldb-native 的 version 改成 `0.8.1-macos`，openmldb-jdbc 的版本保持不变。 openmldb-native 的 macOS 版本只支持 macOS 12，如需在 macOS 11 或 macOS 10.15上运行，需在相应 OS 上源码编译 openmldb-native 包，详细编译方法见[并发编译 Java SDK](https://openmldb.ai/docs/zh/main/deploy/compile.html#java-sdk)。使用自编译的 openmldb-native 包，推荐使用`mvn install`安装到本地仓库，然后在 pom 中引用本地仓库的 openmldb-native 包，不建议用`scope=system`的方式引用。 diff --git a/docs/zh/reference/ip_tips.md b/docs/zh/reference/ip_tips.md index e60c01d41ba..ebe0285c895 100644 --- a/docs/zh/reference/ip_tips.md +++ b/docs/zh/reference/ip_tips.md @@ -52,15 +52,15 @@ curl http:///dbs/foo -X POST -d'{"mode":"online", "sql":"show component - 暴露端口，也需要修改apiserver的endpoint改为`0.0.0.0`。这样可以使用127.0.0.1或是公网ip访问到 APIServer。 单机版： ``` - docker run -p 8080:8080 -it 4pdosc/openmldb:0.8.0 bash + docker run -p 8080:8080 -it 4pdosc/openmldb:0.8.1 bash ``` 集群版： ``` - docker run -p 9080:9080 -it 4pdosc/openmldb:0.8.0 bash + docker run -p 9080:9080 -it 4pdosc/openmldb:0.8.1 bash ``` - 使用host网络，可以不用修改endpoint配置。缺点是容易引起端口冲突。 ``` - docker run --network host -it 4pdosc/openmldb:0.8.0 bash + docker run --network host -it 4pdosc/openmldb:0.8.1 bash ``` 如果是跨主机访问容器 onebox 中的 APIServer，可以**任选一种**下面的方式： @@ -126,17 +126,17 @@ cd /work/openmldb/conf/ && ls | grep -v _ | xargs sed -i s/0.0.0.0//g && cd 单机版需要暴露三个组件（nameserver，tabletserver，APIServer）的端口： ``` -docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.0 bash +docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.1 bash ``` 集群版需要暴露zk端口与所有组件的端口： ``` -docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.0 bash +docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.1 bash ``` - 使用host网络，可以不用修改 endpoint 配置。如果有端口冲突，请修改 server 的端口配置。 ``` -docker run --network host -it 4pdosc/openmldb:0.8.0 bash +docker run --network host -it 4pdosc/openmldb:0.8.1 bash ``` 如果是跨主机使用 CLI/SDK 访问问容器onebox，只能通过`--network host`，并更改所有endpoint为公网IP，才能顺利访问。 diff --git a/docs/zh/tutorial/standalone_use.md b/docs/zh/tutorial/standalone_use.md index dbdc8396c8b..7d391f10b01 100644 --- a/docs/zh/tutorial/standalone_use.md +++ b/docs/zh/tutorial/standalone_use.md @@ -11,7 +11,7 @@ 执行以下命令拉取 OpenMLDB 镜像，并启动 Docker 容器： ```bash -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` 成功启动容器以后，本教程中的后续命令默认均在容器内执行。 diff --git a/docs/zh/use_case/JD_recommendation.md b/docs/zh/use_case/JD_recommendation.md index 164e31fe198..ca150cede2c 100644 --- a/docs/zh/use_case/JD_recommendation.md +++ b/docs/zh/use_case/JD_recommendation.md @@ -56,7 +56,7 @@ Oneflow-serving：https://github.com/Oneflow-Inc/serving/tree/ce5d667468b6b3ba66 为了快速运行OpenMLDB集群，我们推荐使用镜像启动的方式。由于OpenMLDB集群需要和其他组件网络通信，我们直接使用host网络。并且，我们将在容器中使用已下载的脚本，所以请将数据脚本所在目录`demodir`映射为容器中的目录： ```bash -docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.0 bash +docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.1 bash docker exec -it openmldb bash ``` diff --git a/docs/zh/use_case/talkingdata_demo.md b/docs/zh/use_case/talkingdata_demo.md index 25db3bd97ed..e24a030552d 100755 --- a/docs/zh/use_case/talkingdata_demo.md +++ b/docs/zh/use_case/talkingdata_demo.md @@ -16,7 +16,7 @@ **启动 Docker** ``` -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` #### 1.1.2 在本地运行 diff --git a/docs/zh/use_case/taxi_tour_duration_prediction.md b/docs/zh/use_case/taxi_tour_duration_prediction.md index 8e59fd821b6..7b597631400 100644 --- a/docs/zh/use_case/taxi_tour_duration_prediction.md +++ b/docs/zh/use_case/taxi_tour_duration_prediction.md @@ -15,7 +15,7 @@ 在命令行执行以下命令拉取 OpenMLDB 镜像，并启动 Docker 容器： ```bash -docker run -it 4pdosc/openmldb:0.8.0 bash +docker run -it 4pdosc/openmldb:0.8.1 bash ``` 该镜像预装了OpenMLDB，并预置了本案例所需要的所有脚本、三方库、开源工具以及训练数据。 diff --git a/release/conf/openmldb-env.sh b/release/conf/openmldb-env.sh index 07b4735fdfc..d4ef703c8d2 100644 --- a/release/conf/openmldb-env.sh +++ b/release/conf/openmldb-env.sh @@ -1,5 +1,5 @@ #! /usr/bin/env bash -export OPENMLDB_VERSION=0.8.0 +export OPENMLDB_VERSION=0.8.1 # openmldb mode: standalone / cluster export OPENMLDB_MODE=${OPENMLDB_MODE:=standalone} # tablet port From e7707b4135d808774fa84112f7e35a014f43083d Mon Sep 17 00:00:00 2001 From: dl239 Date: Mon, 26 Jun 2023 19:18:45 +0800 Subject: [PATCH 2/6] docs: update changelog --- CHANGELOG.md | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index cfae89be696..424dc2a4ec4 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,5 +1,26 @@ # Changelog +## [0.8.1] - 2023-06-28 + +### Features +- Support the new SQL statement `ALTER TABLE ... ADD/DROP OFFLINE_PATH ...` (#3286 @aceforeverd, #3323 @tobegit3hub) +- Support deploying SQLs that does not contain long windows if there is data in the related tables (#3288 @dl239) +- Add a new interface to merge multiple SQLs (#3297 @vagetablechicken) +- Support mapping topic tables in Kafka connector (#3282 @vagetablechicken) +- Support deploying Kafka connector in Docker and Kubernetes (#3276 @tobegit3hub) +- Support getting jobs from NameServer (#3293 @dl239) +- Enhance the diagnostic tool (#3224 #3208 #3285 #3258 #3303 @zhangziheng01233) +- Enhance the `SELECT INTO ...` statement (#2529 @vagetablechicken) +- Improve the documents (#3308 @aceforeverd) +- Other minor features (#3312 #3314 @vagetablechicken, #3298 @aceforeverd) + +### Bug Fixes +- Deploying fails in some cases (#3328 @vagetablechicken) +- Other minor bug fixes (#3281 #3284 @vagetablechicken) + +### Code Refactoring +#3226 @dl239, #3294 @aceforeverd + ## [0.8.0] - 2023-05-12 ### Features @@ -576,6 +597,7 @@ Removed - openmldb-0.2.0-linux.tar.gz targets on x86_64 - aarch64 artifacts consider experimental +[0.8.1]: https://github.com/4paradigm/OpenMLDB/compare/v0.8.0...v0.8.1 [0.8.0]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.3...v0.8.0 [0.7.3]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.2...v0.7.3 [0.7.2]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.1...v0.7.2 From a351baab0f5958d66f67f816a81352bdae298237 Mon Sep 17 00:00:00 2001 From: dl239 Date: Tue, 27 Jun 2023 16:52:22 +0800 Subject: [PATCH 3/6] docs: update changelog --- CHANGELOG.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 424dc2a4ec4..6c9c8c68395 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -3,8 +3,9 @@ ## [0.8.1] - 2023-06-28 ### Features -- Support the new SQL statement `ALTER TABLE ... ADD/DROP OFFLINE_PATH ...` (#3286 @aceforeverd, #3323 @tobegit3hub) +- Support a new SQL statement `ALTER TABLE ... ADD/DROP OFFLINE_PATH ...` (#3286 @aceforeverd, #3323 @tobegit3hub) - Support deploying SQLs that does not contain long windows if there is data in the related tables (#3288 @dl239) +- Support new built-in functions `top_n_value_ratio_cate`, `top_n_key_ratio_cate`, `list_except_by_key` and `list_except_by_value` (#3329 @aceforeverd) - Add a new interface to merge multiple SQLs (#3297 @vagetablechicken) - Support mapping topic tables in Kafka connector (#3282 @vagetablechicken) - Support deploying Kafka connector in Docker and Kubernetes (#3276 @tobegit3hub) @@ -16,6 +17,7 @@ ### Bug Fixes - Deploying fails in some cases (#3328 @vagetablechicken) +- Creating udf/udaf function may fails as `udf` directory does not exist at startup. (#3326 @vagetablechicken) - Other minor bug fixes (#3281 #3284 @vagetablechicken) ### Code Refactoring From 0370de501c41befe205c5e9fa06bc3d9c5b37c30 Mon Sep 17 00:00:00 2001 From: LU MIAN Date: Wed, 28 Jun 2023 13:54:08 +0800 Subject: [PATCH 4/6] Update CHANGELOG.md --- CHANGELOG.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 6c9c8c68395..e3ccb4da04f 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -4,20 +4,20 @@ ### Features - Support a new SQL statement `ALTER TABLE ... ADD/DROP OFFLINE_PATH ...` (#3286 @aceforeverd, #3323 @tobegit3hub) -- Support deploying SQLs that does not contain long windows if there is data in the related tables (#3288 @dl239) +- Support deploying SQLs in which the involved tables have data but without pre-aggregation defined (#3288 @dl239) - Support new built-in functions `top_n_value_ratio_cate`, `top_n_key_ratio_cate`, `list_except_by_key` and `list_except_by_value` (#3329 @aceforeverd) -- Add a new interface to merge multiple SQLs (#3297 @vagetablechicken) -- Support mapping topic tables in Kafka connector (#3282 @vagetablechicken) -- Support deploying Kafka connector in Docker and Kubernetes (#3276 @tobegit3hub) -- Support getting jobs from NameServer (#3293 @dl239) +- Add a new SDK API to merge multiple SQLs for deployment (#3297 @vagetablechicken) +- Support mapping topic tables in the Kafka connector (#3282 @vagetablechicken) +- Support deploying the Kafka connector in Docker and Kubernetes (#3276 @tobegit3hub) +- Support fetching jobs from NameServer (#3293 @dl239) - Enhance the diagnostic tool (#3224 #3208 #3285 #3258 #3303 @zhangziheng01233) - Enhance the `SELECT INTO ...` statement (#2529 @vagetablechicken) - Improve the documents (#3308 @aceforeverd) - Other minor features (#3312 #3314 @vagetablechicken, #3298 @aceforeverd) ### Bug Fixes -- Deploying fails in some cases (#3328 @vagetablechicken) -- Creating udf/udaf function may fails as `udf` directory does not exist at startup. (#3326 @vagetablechicken) +- SQL Deployment fails in some cases (#3328 @vagetablechicken) +- Creating UDFs/UDAFs may fail as the `udf` directory does not exist by default. (#3326 @vagetablechicken) - Other minor bug fixes (#3281 #3284 @vagetablechicken) ### Code Refactoring From 25a670acadc8b8f88e1c99ab6dbd04da8185ee62 Mon Sep 17 00:00:00 2001 From: LU MIAN Date: Wed, 28 Jun 2023 13:55:11 +0800 Subject: [PATCH 5/6] Update CHANGELOG.md --- CHANGELOG.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index e3ccb4da04f..44b1ce4c8ee 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -16,7 +16,7 @@ - Other minor features (#3312 #3314 @vagetablechicken, #3298 @aceforeverd) ### Bug Fixes -- SQL Deployment fails in some cases (#3328 @vagetablechicken) +- SQL deployment fails in some cases (#3328 @vagetablechicken) - Creating UDFs/UDAFs may fail as the `udf` directory does not exist by default. (#3326 @vagetablechicken) - Other minor bug fixes (#3281 #3284 @vagetablechicken) From d9f512f8bffaa754da87081dc942874d17565120 Mon Sep 17 00:00:00 2001 From: dl239 Date: Wed, 28 Jun 2023 16:13:40 +0800 Subject: [PATCH 6/6] docs: update readme --- README.md | 2 +- README_cn.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index ab0d745da71..c4c71ad9bcc 100644 --- a/README.md +++ b/README.md @@ -158,7 +158,7 @@ We really appreciate the contribution from our community. ## 12. Publications - [Scalable Online Interval Join on Modern Multicore Processors in OpenMLDB](docs/paper/scale_oij_icde2023.pdf). Hao Zhang, Xianzhi Zeng, Shuhao Zhang, Xinyi Liu, Mian Lu, and Zhao Zheng. In 2023 IEEE 39rd International Conference on Data Engineering (ICDE) 2023. [[code]](https://github.com/4paradigm/OpenMLDB/tree/stream) -- [FEBench: A Benchmark for Real-Time Relational Data Feature Extraction](https://github.com/decis-bench/febench/blob/main/report/febench.pdf). Xuanhe Zhou, Cheng Chen, Kunyi Li, Bingsheng He, Mian Lu, Qiaosheng Liu, Wei Huang, Guoliang Li, Zhao Zheng, Yuqiang Chen. In submission. [[code]](https://github.com/decis-bench/febench). +- [FEBench: A Benchmark for Real-Time Relational Data Feature Extraction](https://github.com/decis-bench/febench/blob/main/report/febench.pdf). Xuanhe Zhou, Cheng Chen, Kunyi Li, Bingsheng He, Mian Lu, Qiaosheng Liu, Wei Huang, Guoliang Li, Zhao Zheng, Yuqiang Chen. International Conference on Very Large Data Bases (VLDB) 2023. [[code]](https://github.com/decis-bench/febench). - [A System for Time Series Feature Extraction in Federated Learning](https://dl.acm.org/doi/pdf/10.1145/3511808.3557176). Siqi Wang, Jiashu Li, Mian Lu, Zhao Zheng, Yuqiang Chen, and Bingsheng He. 2022. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (CIKM) 2022. [[code]](https://github.com/4paradigm/tsfe). - [Optimizing in-memory database engine for AI-powered on-line decision augmentation using persistent memory](http://vldb.org/pvldb/vol14/p799-chen.pdf). Cheng Chen, Jun Yang, Mian Lu, Taize Wang, Zhao Zheng, Yuqiang Chen, Wenyuan Dai, Bingsheng He, Weng-Fai Wong, Guoan Wu, Yuping Zhao, and Andy Rudoff. International Conference on Very Large Data Bases (VLDB) 2021. diff --git a/README_cn.md b/README_cn.md index 11b8912bbbe..11527ee530d 100644 --- a/README_cn.md +++ b/README_cn.md @@ -147,7 +147,7 @@ OpenMLDB 的整体架构设计是为了达到特征平台从开发到部署的 ## 12. 学术论文 - [Scalable Online Interval Join on Modern Multicore Processors in OpenMLDB](docs/paper/scale_oij_icde2023.pdf). Hao Zhang, Xianzhi Zeng, Shuhao Zhang, Xinyi Liu, Mian Lu, and Zhao Zheng. In 2023 IEEE 39rd International Conference on Data Engineering (ICDE) 2023. [[code]](https://github.com/4paradigm/OpenMLDB/tree/stream) -- [FEBench: A Benchmark for Real-Time Relational Data Feature Extraction](https://github.com/decis-bench/febench/blob/main/report/febench.pdf). Xuanhe Zhou, Cheng Chen, Kunyi Li, Bingsheng He, Mian Lu, Qiaosheng Liu, Wei Huang, Guoliang Li, Zhao Zheng, Yuqiang Chen. In submission. [[code]](https://github.com/decis-bench/febench). +- [FEBench: A Benchmark for Real-Time Relational Data Feature Extraction](https://github.com/decis-bench/febench/blob/main/report/febench.pdf). Xuanhe Zhou, Cheng Chen, Kunyi Li, Bingsheng He, Mian Lu, Qiaosheng Liu, Wei Huang, Guoliang Li, Zhao Zheng, Yuqiang Chen. International Conference on Very Large Data Bases (VLDB) 2023. [[code]](https://github.com/decis-bench/febench). - [A System for Time Series Feature Extraction in Federated Learning](https://dl.acm.org/doi/pdf/10.1145/3511808.3557176). Siqi Wang, Jiashu Li, Mian Lu, Zhao Zheng, Yuqiang Chen, and Bingsheng He. 2022. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (CIKM) 2022. [[code]](https://github.com/4paradigm/tsfe). - [Optimizing in-memory database engine for AI-powered on-line decision augmentation using persistent memory](http://vldb.org/pvldb/vol14/p799-chen.pdf). Cheng Chen, Jun Yang, Mian Lu, Taize Wang, Zhao Zheng, Yuqiang Chen, Wenyuan Dai, Bingsheng He, Weng-Fai Wong, Guoan Wu, Yuping Zhao, and Andy Rudoff. International Conference on Very Large Data Bases (VLDB) 2021.