Skip to content

HuaweiCloudDeveloper/flink-image

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 

Repository files navigation

Flink Stream Data Analysis Tool

简体中文 | English

Table of Contents

Repository Introduction

Apache Flink is an open-source distributed processing engine primarily designed for stateful computations over unbounded and bounded data streams. It enables high-speed in-memory data processing with elastic scalability.

Core Features:

  1. Batch & Stream Processing Unification: Flink supports both batch and stream processing, allowing developers to handle different computation tasks with a single system. Batch processing works for bounded datasets while stream processing handles unbounded data streams.
  2. State Management: Provides rich state management APIs including ValueState, ListState, and MapState to simplify complex state management.
  3. Event Time Processing: Supports event-time based data processing, tolerating data delays and disorder to ensure accuracy.
  4. High Availability & Fault Tolerance: The checkpoint mechanism ensures data consistency and state recovery during failures.

Architecture Design:

This project offers pre-configured Flink Stream Analysis Tool images with Flink and its runtime environment pre-installed, along with deployment templates. Follow the guide to enjoy an "out-of-the-box" experience.

System Requirements:

  • CPU: 2GHz or higher
  • RAM: 4GB or more
  • Disk: At least 40GB

Prerequisites

Register a Huawei account and activate Huawei Cloud

Image Specifications

Image Version Description Notes
Flink-1.13.0-kunpeng Deployed on Kunpeng servers with Huawei Cloud EulerOS 2.0 64bit
Flink-1.17.0-kunpeng Deployed on Kunpeng servers with Huawei Cloud EulerOS 2.0 64bit, added real-time writing and real-time collection of GaussDB

Getting Help

  • Submit an issue
  • Contact Huawei Cloud Marketplace product support

How to Contribute

  • Fork this repository and submit a merge request.
  • Update README.md synchronously based on your open-source mirror information.

About

Ready-to-use images for Flink on Huawei Cloud with built-in service connectors.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •