Best way to add WebRTC stream to Nicegui app

[h0uter]

What is the recommended way for displaying a WebRTC stream in Nicegui?

I found this Nicegui example that can display a webcam (and rtsp?) stream using OpenCV: https://github.com/zauberzeug/nicegui/blob/main/examples/opencv_webcam/main.py. However that approach does not appear to support WebRTC.

Upon further search I found this related solution for Streamlit: https://github.com/whitphx/streamlit-webrtc

Another potential approach could be embedding this javascript example from the aiortc WebRTC Python package in a ui.html element: https://github.com/aiortc/aiortc/tree/main/examples/server

I would be interested to hear ideas on the best approach to add a WebRTC stream to a nicegui app! This would be really usefull for robotics applications.

[Dronakurl]

Did you achieve this somehow? I desparately need this feature

[rodja]

What kind of features do you need from WebRTC? If you only nee the video transfer, you can look at ui.interactive_image. It automatically adapts frame updates to the available bandwidth per client.

[rodja]

Hmm.. so your camera does not provide a rtsp stream but only WebRTC? Them maybe you can utilize https://github.com/aiortc/aiortc or similar to get the frames in Python.

[rodja]

Or do you want to share a camera from the client (eg. the browser visiting the server) to send the data to the server? Like in a video call?

[Dronakurl]

Yes, exactly like in a video call. A user would call up the nicegui application in his browser and will be asked to share his camera. The camera frames are sent to the server and then transformed/ analyzed.

[rodja]

Ok, there is already a feature request for capturing the user's camera image: #2010. It got a bit stale but you could try out whats suggested there and pick up the discussion.

[Dronakurl]

Thank you, that works for me!

[frankvp11]

Has there been any updates on this?
I'm quite interested in using WebRTC / aiortc to support a calling like feature in NiceGUI.
If there are any code snippets I could look to, that would be great.
Edit:
I've found this example for FastAPI and i'm quite curious to know if it would work for NiceGUI.
https://github.com/priyanshu88064/video-calling-app
Granted, I have not yet tested it (busy with exams 😢)