Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

调用xinference url时只能解析ip+por #4947

Open
tyzhong opened this issue Sep 13, 2024 · 0 comments
Open

调用xinference url时只能解析ip+por #4947

tyzhong opened this issue Sep 13, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@tyzhong
Copy link

tyzhong commented Sep 13, 2024

问题描述 / Problem Description
我在服务器上部署了xinference,url类似127.0.0.1:9997/xinference/v1这种,但是在配置文件中配置这个url,在数据库初始化中无法正确解析。我的url是:http://192.168.24.137:30123/open-api/glm4/v1

复现问题的步骤 / Steps to Reproduce

  1. 正常配置,需要一个带有路由的xinference
  2. 配置model_config.yaml 在xinference配置如下:
    MODEL_PLATFORMS:
  1. 进行数据库初始化,运行命令 python chatchat/cli.py kb --recreate-vs
  2. 问题出现
    error when connect to xinference server(http://192.168.24.137:30123): Failed to list model, detail: 404 Client Error: Not Found for url: http://192.168.24.137:30123/v1/models

[代码中应该对于url只解析到端口之后,后面的url并没有进行处理]([url](langchain3 0url报错))
实际结果 / Actual Result
描述实际发生的结果 / Describe the actual result.

环境信息 / Environment Information
python版本3.10,其他包信息与poetry中一致

@tyzhong tyzhong added the bug Something isn't working label Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant