Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

offline batch ingestion API actions and data ingesters #2844

Merged
merged 8 commits into from
Sep 4, 2024
Merged

offline batch ingestion API actions and data ingesters #2844

merged 8 commits into from
Sep 4, 2024

Commits on Sep 3, 2024

  1. batch ingest API rest and transport actions 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    157e8c7 View commit details
    Browse the repository at this point in the history

  2. add openAI ingester 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    81a7bff View commit details
    Browse the repository at this point in the history

  3. update batch ingestion field mapping interphase and address comments 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    46a0893 View commit details
    Browse the repository at this point in the history

  4. support multiple data sources as ingestion inputs 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    137bec9 View commit details
    Browse the repository at this point in the history

  5. add more UTs 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    dbc7ed6 View commit details
    Browse the repository at this point in the history

  6. more UTs in plugin repo 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    8f11243 View commit details
    Browse the repository at this point in the history

  7. address more comments 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    a2dabaa View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. use dedicated thread pool for ingestion 

    Signed-off-by: Xun Zhang <xunzh@amazon.com>
    @Zhangxunmt
    Zhangxunmt committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    993023b View commit details
    Browse the repository at this point in the history