[Bug]: Timeout without client error message

[sam-herman]

Describe the bug

I am testing with a modified lucene-index.json workload. The job fails without showing any error message except a timeout.

Traceback (most recent call last):
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/opensearchpy/_async/http_aiohttp.py", line 294, in perform_request
    async with self.session.request(
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
                           ^^^^^^^^^^^^^^^^
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client.py", line 730, in _request
    await resp.start(conn)
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 1054, in start
    with self._timer:
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/helpers.py", line 671, in __exit__
    raise asyncio.TimeoutError from exc_val
TimeoutError
2025-02-25 01:55:32,558 -not-actor-/PID:270176 opensearch WARNING POST http://localhost:9200/_bulk [status:N/A request:60.992s]
Traceback (most recent call last):
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 1059, in start
    message, payload = await protocol.read()  # type: ignore[union-attr]
                       ^^^^^^^^^^^^^^^^^^^^^
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/streams.py", line 672, in read
    await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/opensearchpy/_async/http_aiohttp.py", line 294, in perform_request
    async with self.session.request(
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
                           ^^^^^^^^^^^^^^^^
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client.py", line 730, in _request
    await resp.start(conn)
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 1054, in start
    with self._timer:
  File "/home/sam.herman/projects/benchmark_python_envrionment/venv/lib/python3.11/site-packages/aiohttp/helpers.py", line 671, in __exit__
    raise asyncio.TimeoutError from exc_val

To reproduce

For vector search workload create a new modified lucene_index.json refer to it in new params.json file.

Expected behavior

No response

Screenshots

If applicable, add screenshots to help explain your problem.

Host / Environment

No response

Additional context

No response

Relevant log output

[IanHoang]

@VijayanB Have you experienced this with vectorsearch workload?

[sam-herman]

@IanHoang I think the issue is that if using a modified file that might refer to different files this is where things break.
When I pointed it to my local benchmarks workspace using the flag --workspace-path it was passing.