VeatBision is an open-source software that enhances the excitement of listening to music by dynamically manipulating real video elements in sync with the beat.
- Beat Timing Analysis: Detects rhythm and tempo in real-time.
- Size Modulation: Adjusts video element sizes to match beats.
- Color Transformation: Alters colors dynamically based on the music.
- Genre-Based LUT Filtering: Applies unique filters to complement different music genres.
- Includes 10 custom LUTs in the
lutsfolder!
- Includes 10 custom LUTs in the
- Manual Beat Input: Fine-tune sync by launching
beatmaker.py, pressingspaceto mark beats, andqto save.
- AI-powered lyric visualization: PTAM-based lyric insertion synchronized with the music.
- YOLO-powered object tracking:
- Real-time detection & segmentation for enhanced visual effects.
- Motion-based effect triggers.
- CNN-based video processing:
- Object classification & tracking.
- Artistic style transfer.
- Advanced image segmentation.
- Clone the repository:
git clone https://github.com/younghun1124/VeatBision
- Install dependencies:
pip install ultralytics==8.2.8 opencv-python==4.9.0 librosa==0.10.2.post1 numpy==1.22.4
- Run
main.py(requires Python 3.8 or higher).
⬆️ Click to watch!
We welcome contributions! Feel free to open an issue or submit a pull request.
VeatBision is released under the MIT License.
For inquiries, contact: