Custom-modules

[DeFlanko]

Is there a centralized custom-modules location?

[MikeLud]

Is there a centralized custom-modules location?

Module links can be found here https://codeproject.github.io/

My custom models can be found here https://github.com/MikeLud/CodeProject.AI-Custom-IPcam-Models

Also you can find custom models here https://huggingface.co/models?pipeline_tag=object-detection&sort=trending&search=yolo

[finnaGIT]

if you've got the .tflite files in the right location you should be able to make an api call to the custom endpoint: ip:32168/v1/vision/custom/modelname

[8666]

curl -X POST ai:32168/v1/vision/custom/ipcam-general

{"success":false,"error":"Error occurred on the server","moduleId":"ObjectDetectionCoral","moduleName":"Object Detection (Coral)","code":500,"command":"custom","requestId":"38eed4d4-a1e0-4c64-a06d-69a2af0f0659","inferenceDevice":"Multi-TPU","analysisRoundTripMs":3,"processedBy":"localhost","timestampUTC":"Fri, 06 Dec 2024 11:25:08 GMT"}

I've put these under
/modules/ObjectDetectionCoral/custom-models/ipcam-general.tflite
and also in
/modules/ObjectDetectionCoral/assets/ipcam-general.tflite

I think there is a fixed list in the python code and does not except other models @MikeLud

[finnaGIT]

have you gone into the Coral module's options.py and updated the self.MAX_IDLE_SECS_BEFORE_RECYCLE = 600000 parameter? by default it times out the multi-tpu after 60s which caused me some issues until i changed it to 600000 lol

[ChrisMaunder]

@8666 calling an API without providing the correct payload (in this case an image) will result in an error. This is by design.

[8666]

OK so agentDVR custom module detection is wrong (but I also get the same list on the explorer.html test page). I need to paste "/v1/vision/custom/ipcam-general" in the agentDVR text box and it works. Now I can finally use both Coral Edge TPU (USB) that takes 16-20ms per detection and Yolo8 CPU that takes 115-130ms in parallel and expect the same results.

Can we expect iGPU support on Yolo?

[DeFlanko]

Follow up question for you @MikeLud , can any custom models be applied to the License Plate Reader (3.3.0) component? This way it can use those custom modules and still display the licence plate value if detected?

[ChrisMaunder]

The ALPR module (at least the non-RKNN version) first makes a call to the main server with a request for a license plate, and once it gets a region back from that call that contains plates, it then uses an OCR model to read the plates.

When you suggest using custom models do you mean for the plate detection or for the OCR? There's certainly scope to allow custom models in the plate detector to be used, but that would require coordinating two modules. Not hard, just slightly fiddly.

[DeFlanko]

i guess both to try other community models, sounds like the APLR pipeline that has the models and process baked in to the module. if there was way to plug in custom models to the pipe line for the plate detection and OCR i wonder if the community could help enhance this easier.