Skip to content

This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessary infrastructure components, including Apache Flink, Elasticsearch, MySQL, and Postgres

Notifications You must be signed in to change notification settings

hung2xt/streaming-with-apache-flink

 
 

Repository files navigation

Streaming with Apache Flink

This a forked repository that contains examples and tutorials for streaming data processing using Apache Flink.

Introduction

Apache Flink is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. This repository provides practical examples to help you understand and explore the capabilities of Apache Flink.

Prerequisites

Before you start, ensure you have the following installed:

  • Apache Flink
  • Apache Kafka (for Kafka examples)
  • PostgreSQL, Elasticsearch, and MySQL (for sink examples)
  • Python 3.x (for PyFlink examples)

Getting Started

To get started with these examples:

  1. Clone the repository:
    git clone https://github.com/hung2xt/streaming-with-apache-flink.git
  2. Navigate to the desired example directory:
    cd streaming-with-apache-flink/<example-directory>
  3. Follow the specific instructions provided in each example's folder.

Repository Structure

  • src/main/java: Examples integrating Flink with Kafka and Java.
  • python-examples/: Demonstrations of using Pyflink to write to MySQL.
  • Additional directories and examples as per your repository's content.

Running the Examples

Each example directory contains specific instructions on how to run the example. Typically, this involves building the project and executing the Flink job.

Contributing

Contributions to this repository are welcome. Please refer to the CONTRIBUTING.md for contribution guidelines.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Resources

Contact

For any queries or contributions, please open an issue in the GitHub repository.

About

This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessary infrastructure components, including Apache Flink, Elasticsearch, MySQL, and Postgres

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 54.4%
  • Python 43.0%
  • Shell 2.6%