We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug When mock model is deployed from tt-studio . The following exception occurs.
To Reproduce Steps to reproduce the behavior: 1.Click on Mock model in model selection 2. Hit default weights 3. Hit deploy
Expected behavior The mock model should be deployed.
Screenshots
tt_studio_backend_api | 2025-02-25 14:49:55,771 - /api/docker_control/docker_utils.py:257 - INFO - con['networks']={'tt_studio_network': {'DNSNames': ['mock.vllm.openai.api_p8001', '5cafea419355']}} tt_studio_backend_api | 2025-02-25 14:49:55,780 - /api/docker_control/docker_utils.py:152 - INFO - used_host_agent_ports=[] tt_studio_chroma | INFO: [25-02-2025 14:49:55] 127.0.0.1:42068 - "GET /api/v1/heartbeat HTTP/1.1" 200 tt_studio_backend_api | Internal Server Error: /docker/deploy/ tt_studio_backend_api | Traceback (most recent call last): tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 265, in _raise_for_status tt_studio_backend_api | response.raise_for_status() tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status tt_studio_frontend | Received Response from the Target: 500 /docker/deploy/ tt_studio_backend_api | raise HTTPError(http_error_msg, response=self) tt_studio_backend_api | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.47/containers/create?name=ai_agent_container_p8001 tt_studio_backend_api | tt_studio_backend_api | The above exception was the direct cause of the following exception: tt_studio_backend_api | tt_studio_backend_api | Traceback (most recent call last): tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/models/containers.py", line 873, in run tt_studio_backend_api | container = self.create(image=image, command=command, tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/models/containers.py", line 932, in create tt_studio_backend_api | resp = self.client.api.create_container(**create_kwargs) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/container.py", line 439, in create_container tt_studio_backend_api | return self.create_container_from_config(config, name, platform) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/container.py", line 456, in create_container_from_config tt_studio_backend_api | return self._result(res, True) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 271, in _result tt_studio_backend_api | self._raise_for_status(response) tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 267, in _raise_for_status tt_studio_backend_api | raise create_api_error_from_http_exception(e) from e tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/errors.py", line 39, in create_api_error_from_http_exception tt_studio_backend_api | raise cls(e, response=response, explanation=explanation) from e tt_studio_backend_api | docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.47/containers/create?name=ai_agent_container_p8001: Not Found ("No such image: agent_image:v1") tt_studio_backend_api | tt_studio_backend_api | During handling of the above exception, another exception occurred: tt_studio_backend_api | tt_studio_backend_api | Traceback (most recent call last): tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 265, in _raise_for_status tt_studio_backend_api | response.raise_for_status() tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status tt_studio_backend_api | raise HTTPError(http_error_msg, response=self) tt_studio_backend_api | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.47/images/create?tag=v1&fromImage=agent_image tt_studio_backend_api | tt_studio_backend_api | The above exception was the direct cause of the following exception: tt_studio_backend_api | tt_studio_backend_api | Traceback (most recent call last): tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/django/core/handlers/exception.py", line 55, in inner tt_studio_backend_api | response = get_response(request) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/django/core/handlers/base.py", line 197, in _get_response tt_studio_backend_api | response = wrapped_callback(request, *callback_args, **callback_kwargs) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/django/views/decorators/csrf.py", line 65, in _view_wrapper tt_studio_backend_api | return view_func(request, *args, **kwargs) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/django/views/generic/base.py", line 104, in view tt_studio_backend_api | return self.dispatch(request, *args, **kwargs) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 509, in dispatch tt_studio_backend_api | response = self.handle_exception(exc) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 469, in handle_exception tt_studio_backend_api | self.raise_uncaught_exception(exc) tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception tt_studio_backend_api | raise exc tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 506, in dispatch tt_studio_backend_api | response = handler(request, *args, **kwargs) tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/api/docker_control/views.py", line 117, in post tt_studio_backend_api | run_agent_container(response["container_name"], response["port_bindings"], impl) # run agent container that maps to appropriate LLM container tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/api/docker_control/docker_utils.py", line 86, in run_agent_container tt_studio_backend_api | container = client.containers.run( tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/models/containers.py", line 876, in run tt_studio_backend_api | self.client.images.pull(image, platform=platform) tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/models/images.py", line 464, in pull tt_studio_backend_api | pull_log = self.client.api.pull( tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/image.py", line 429, in pull tt_studio_backend_api | self._raise_for_status(response) tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 267, in _raise_for_status tt_studio_backend_api | raise create_api_error_from_http_exception(e) from e tt_studio_backend_api | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ tt_studio_backend_api | File "/usr/local/lib/python3.12/site-packages/docker/errors.py", line 39, in create_api_error_from_http_exception tt_studio_backend_api | raise cls(e, response=response, explanation=explanation) from e tt_studio_backend_api | docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.47/images/create?tag=v1&fromImage=agent_image: Not Found ("pull access denied for agent_image, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the bug
When mock model is deployed from tt-studio . The following exception occurs.
To Reproduce
Steps to reproduce the behavior:
1.Click on Mock model in model selection
2. Hit default weights
3. Hit deploy
Expected behavior
The mock model should be deployed.
Screenshots
The text was updated successfully, but these errors were encountered: