Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot Deploy Mock Model #197

Open
anirudTT opened this issue Feb 25, 2025 · 0 comments
Open

Cannot Deploy Mock Model #197

anirudTT opened this issue Feb 25, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@anirudTT
Copy link
Contributor

Describe the bug
When mock model is deployed from tt-studio . The following exception occurs.

To Reproduce
Steps to reproduce the behavior:
1.Click on Mock model in model selection
2. Hit default weights
3. Hit deploy

Expected behavior
The mock model should be deployed.

Screenshots

tt_studio_backend_api  | 2025-02-25 14:49:55,771 - /api/docker_control/docker_utils.py:257 - INFO - con['networks']={'tt_studio_network': {'DNSNames': ['mock.vllm.openai.api_p8001', '5cafea419355']}}
tt_studio_backend_api  | 2025-02-25 14:49:55,780 - /api/docker_control/docker_utils.py:152 - INFO - used_host_agent_ports=[]
tt_studio_chroma       | INFO:     [25-02-2025 14:49:55] 127.0.0.1:42068 - "GET /api/v1/heartbeat HTTP/1.1" 200
tt_studio_backend_api  | Internal Server Error: /docker/deploy/
tt_studio_backend_api  | Traceback (most recent call last):
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 265, in _raise_for_status
tt_studio_backend_api  |     response.raise_for_status()
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status
tt_studio_frontend     | Received Response from the Target: 500 /docker/deploy/
tt_studio_backend_api  |     raise HTTPError(http_error_msg, response=self)
tt_studio_backend_api  | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.47/containers/create?name=ai_agent_container_p8001
tt_studio_backend_api  | 
tt_studio_backend_api  | The above exception was the direct cause of the following exception:
tt_studio_backend_api  | 
tt_studio_backend_api  | Traceback (most recent call last):
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/models/containers.py", line 873, in run
tt_studio_backend_api  |     container = self.create(image=image, command=command,
tt_studio_backend_api  |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/models/containers.py", line 932, in create
tt_studio_backend_api  |     resp = self.client.api.create_container(**create_kwargs)
tt_studio_backend_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/container.py", line 439, in create_container
tt_studio_backend_api  |     return self.create_container_from_config(config, name, platform)
tt_studio_backend_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/container.py", line 456, in create_container_from_config
tt_studio_backend_api  |     return self._result(res, True)
tt_studio_backend_api  |            ^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 271, in _result
tt_studio_backend_api  |     self._raise_for_status(response)
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 267, in _raise_for_status
tt_studio_backend_api  |     raise create_api_error_from_http_exception(e) from e
tt_studio_backend_api  |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
tt_studio_backend_api  |     raise cls(e, response=response, explanation=explanation) from e
tt_studio_backend_api  | docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.47/containers/create?name=ai_agent_container_p8001: Not Found ("No such image: agent_image:v1")
tt_studio_backend_api  | 
tt_studio_backend_api  | During handling of the above exception, another exception occurred:
tt_studio_backend_api  | 
tt_studio_backend_api  | Traceback (most recent call last):
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 265, in _raise_for_status
tt_studio_backend_api  |     response.raise_for_status()
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status
tt_studio_backend_api  |     raise HTTPError(http_error_msg, response=self)
tt_studio_backend_api  | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.47/images/create?tag=v1&fromImage=agent_image
tt_studio_backend_api  | 
tt_studio_backend_api  | The above exception was the direct cause of the following exception:
tt_studio_backend_api  | 
tt_studio_backend_api  | Traceback (most recent call last):
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/django/core/handlers/exception.py", line 55, in inner
tt_studio_backend_api  |     response = get_response(request)
tt_studio_backend_api  |                ^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/django/core/handlers/base.py", line 197, in _get_response
tt_studio_backend_api  |     response = wrapped_callback(request, *callback_args, **callback_kwargs)
tt_studio_backend_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/django/views/decorators/csrf.py", line 65, in _view_wrapper
tt_studio_backend_api  |     return view_func(request, *args, **kwargs)
tt_studio_backend_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/django/views/generic/base.py", line 104, in view
tt_studio_backend_api  |     return self.dispatch(request, *args, **kwargs)
tt_studio_backend_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 509, in dispatch
tt_studio_backend_api  |     response = self.handle_exception(exc)
tt_studio_backend_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 469, in handle_exception
tt_studio_backend_api  |     self.raise_uncaught_exception(exc)
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
tt_studio_backend_api  |     raise exc
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/rest_framework/views.py", line 506, in dispatch
tt_studio_backend_api  |     response = handler(request, *args, **kwargs)
tt_studio_backend_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/api/docker_control/views.py", line 117, in post
tt_studio_backend_api  |     run_agent_container(response["container_name"], response["port_bindings"], impl) # run agent container that maps to appropriate LLM container
tt_studio_backend_api  |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/api/docker_control/docker_utils.py", line 86, in run_agent_container
tt_studio_backend_api  |     container = client.containers.run(
tt_studio_backend_api  |                 ^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/models/containers.py", line 876, in run
tt_studio_backend_api  |     self.client.images.pull(image, platform=platform)
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/models/images.py", line 464, in pull
tt_studio_backend_api  |     pull_log = self.client.api.pull(
tt_studio_backend_api  |                ^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/image.py", line 429, in pull
tt_studio_backend_api  |     self._raise_for_status(response)
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/api/client.py", line 267, in _raise_for_status
tt_studio_backend_api  |     raise create_api_error_from_http_exception(e) from e
tt_studio_backend_api  |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tt_studio_backend_api  |   File "/usr/local/lib/python3.12/site-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
tt_studio_backend_api  |     raise cls(e, response=response, explanation=explanation) from e
tt_studio_backend_api  | docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.47/images/create?tag=v1&fromImage=agent_image: Not Found ("pull access denied for agent_image, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
@anirudTT anirudTT added the bug Something isn't working label Feb 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant