Skip to content

Commit

Permalink
Update report.md - trial 6
Browse files Browse the repository at this point in the history
  • Loading branch information
AnanayG authored Dec 14, 2023
1 parent 8ed9bdb commit 6a2d75e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/report.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ The Paper ‘NeuriCam: Key-Frame Video Super-Resolution and Colorization for IoT

There are plenty of techniques to reduce power consumption in computer vision/ML based approaches like parameter quantisation, filter compression, knowledge distillation, hierarchical neural network. These approaches were not explored in our approach as the stimulus we expect is 20-60 times/day which is very sparse. We expected the passive power to be a large component of our energy budget and the NN by itself to be a very small fraction of the total energy cost. This also turned out to be the case as detailed in the later sections in the report.

The generation expectation of the power characteristics when trading off between resolution, color, SNR applies to the choice of the camera as well. There is existing work to help with power-aware image compression and motion detection (https://ieeexplore.ieee.org/document/745120) and many commercial cameras use advanced on-device compression including neural networks to reduce the data rate. Additionally there are approaches that use RL to detect the optimal moment to capture the key-frame(https://www.researchgate.net/publication/347359703_Self-Supervised_Learning_to_Detect_Key_Frames_in_Videos), which can also help with power optimisation. Albeit helpful, these approaches were also not considered for our project as our active power consumption of the camera is relatively very low.
The generation expectation of the power characteristics when trading off between resolution, color, SNR applies to the choice of the camera as well. There is existing work to help with power-aware image compression and motion detection [Link](https://ieeexplore.ieee.org/document/745120) and many commercial cameras use advanced on-device compression including neural networks to reduce the data rate. Additionally there are approaches that use RL to detect the optimal moment to capture the key-frame [Link](https://www.researchgate.net/publication/347359703_Self-Supervised_Learning_to_Detect_Key_Frames_in_Videos), which can also help with power optimisation. Albeit helpful, these approaches were also not considered for our project as our active power consumption of the camera is relatively very low.

Finally, as mentioned before, our project also draws inspiration from the paper “An ultra-low-power image signal processor for hierarchical image recognition with deep neural networks”[1]. This paper focuses on optimizing the power consumption for person detection, face detection, and facial recognition using change detection and neural network techniques, which is similar to our approach. The group was able to achieve extremely low power consumption through a custom ASIC design. The paper also serves as a power consumption benchmark for our work.

Expand Down

0 comments on commit 6a2d75e

Please sign in to comment.