Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

change hugging-face hub module with hotfix issue #4

Merged
merged 1 commit into from
Apr 2, 2024

Conversation

beamaia
Copy link

@beamaia beamaia commented Apr 2, 2024

Problem: huggingface-hub is with an error on their client-side. Issue opened on huggingface here.
Solution: use hoitfix created, obtained from this stackoverflow

Log

2024-04-02T16:14:14.804483160Z INFO 04-02 16:14:14 selector.py:21] Using XFormers backend.
2024-04-02T16:14:17.168214411Z Traceback (most recent call last):
2024-04-02T16:14:17.168251874Z   File "//handler.py", line 56, in <module>
2024-04-02T16:14:17.168498024Z     llm = AsyncLLMEngine.from_engine_args(engine_args)
2024-04-02T16:14:17.168518894Z   File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 348, in from_engine_args
2024-04-02T16:14:17.168524739Z     engine = cls(
2024-04-02T16:14:17.168529699Z   File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 311, in __init__
2024-04-02T16:14:17.168534758Z     self.engine = self._init_engine(*args, **kwargs)
2024-04-02T16:14:17.168539861Z   File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 422, in _init_engine
2024-04-02T16:14:17.168544211Z     return engine_class(*args, **kwargs)
2024-04-02T16:14:17.168549874Z   File "/usr/local/lib/python3.10/dist-packages/vllm/engine/llm_engine.py", line 111, in __init__
2024-04-02T16:14:17.168554338Z     self.model_executor = executor_class(model_config, cache_config,
2024-04-02T16:14:17.168558927Z   File "/usr/local/lib/python3.10/dist-packages/vllm/executor/gpu_executor.py", line 37, in __init__
2024-04-02T16:14:17.168580184Z     self._init_worker()
2024-04-02T16:14:17.168585204Z   File "/usr/local/lib/python3.10/dist-packages/vllm/executor/gpu_executor.py", line 66, in _init_worker
2024-04-02T16:14:17.168589988Z     self.driver_worker.load_model()
2024-04-02T16:14:17.168594224Z   File "/usr/local/lib/python3.10/dist-packages/vllm/worker/worker.py", line 107, in load_model
2024-04-02T16:14:17.168831339Z     self.model_runner.load_model()
2024-04-02T16:14:17.168857119Z   File "/usr/local/lib/python3.10/dist-packages/vllm/worker/model_runner.py", line 95, in load_model
2024-04-02T16:14:17.168860827Z     self.model = get_model(
2024-04-02T16:14:17.168863703Z   File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader.py", line 101, in get_model
2024-04-02T16:14:17.168866968Z     model.load_weights(model_config.model, model_config.download_dir,
2024-04-02T16:14:17.168870527Z   File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/mixtral_quant.py", line 383, in load_weights
2024-04-02T16:14:17.168890558Z     for name, loaded_weight in hf_model_weights_iterator(
2024-04-02T16:14:17.168893643Z   File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/weight_utils.py", line 224, in hf_model_weights_iterator
2024-04-02T16:14:17.168896421Z     hf_folder, hf_weights_files, use_safetensors = prepare_hf_model_weights(
2024-04-02T16:14:17.168899471Z   File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/weight_utils.py", line 168, in prepare_hf_model_weights
2024-04-02T16:14:17.168911180Z     file_list = fs.ls(model_name_or_path, detail=False, revision=revision)
2024-04-02T16:14:17.168913892Z   File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/hf_file_system.py", line 283, in ls
2024-04-02T16:14:17.169000660Z     resolved_path = self.resolve_path(path, revision=revision)
2024-04-02T16:14:17.169003576Z   File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/hf_file_system.py", line 189, in resolve_path
2024-04-02T16:14:17.169006435Z     repo_and_revision_exist, err = self._repo_and_revision_exist(repo_type, repo_id, revision)
2024-04-02T16:14:17.169010985Z   File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/hf_file_system.py", line 126, in _repo_and_revision_exist
2024-04-02T16:14:17.169013732Z     self._api.repo_info(repo_id, revision=revision, repo_type=repo_type)
2024-04-02T16:14:17.169016427Z   File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
2024-04-02T16:14:17.169307792Z     return fn(*args, **kwargs)

@beamaia beamaia added the bug Something isn't working label Apr 2, 2024
@beamaia beamaia self-assigned this Apr 2, 2024
@beamaia beamaia merged commit 10efab5 into main Apr 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant