Tool use added

[CivilEngineerUK]

Changelog

New Features

• Added tools/functions support to the SimpleRealtime client
  • New tool registration system with add_tool() and add_tools() methods
  • Automatic schema generation from Python functions
  • Support for both synchronous and asynchronous tool handlers
  • Tool definitions are sent to OpenAI on connection
  • Added function call handling in the message handler

Code Organization

• Split audio-related code into separate audio.py module
  • Moved StreamingAudioRecorder class to its own file
  • Cleaned up imports in main app.py

SimpleRealtime Client Improvements

• Added tool/function management
  • New tools dictionary to store registered functions
  • Added _function_to_schema() helper method for automatic OpenAI schema generation
  • Enhanced connect() to configure session with registered tools
• Made receive() method asynchronous
• Added proper typing hints and docstrings
• Improved error handling for function calls
• Enhanced websocket connection management

App Changes

• Added sample time function tool (get_current_time())
• Updated client initialization to support tools
• Improved session state management
• Enhanced error handling and user feedback

Technical Improvements

• Added proper type hints throughout the codebase
• Improved asyncio integration and error handling
• Enhanced websocket connection management
• Better separation of concerns between modules

Bug Fixes

• Fixed websocket connection handling
• Improved error handling in message handler
• Fixed tool registration validation
• Enhanced session state management

The refactoring mainly focused on adding tool support while improving code organization and robustness. The core audio functionality remains largely unchanged, but is now better organized in its own module.

[mdagost]

Wow! Thanks for this, and sorry for my slow reply! I was take a deeper look at the PR in the next day or two. Thanks again!