RobotVRM

Project to develop LLM robots (smart phone robots) that can be created at low cost live with people .

• This repository encourages forking. Each person is encouraged to develop his/her own robot.
• When using this repository or software, please indicate that you are using “RobotVRM” (see LICENSE
• Using the software in this repository to directly harm or injure any person is prohibited (for details, see LICENSE.

Running cost

Need a multimodal LLM that can use Tool.

API rates at Claude 3 Haiku for videos are “no more than US$5” per hour.

• Speech synthesis is free with home server use

Verification environment

RobotVRM First Model Mina (as of 11/19/2024)

For simple trial (iOS, Android)

If you have trouble setting up an environment, you can download the application from the store for a fee.

• a paid app due to maintaining. (API required separately)
• Gemini is not supported in the store version; please use the OSS version.

iOS app

Android app

Community

We have a community called RobotVRM Community(Discord), so feel free to join. Even those who fork repositories are welcome to join (rather, that is the main focus). Let's exchange information together.

ベース

RobotVRM is built on the open source, tegnike/aituber-kit (around the time of the MIT license, before 2024/9/25) by Nike-chan based on [pixiv]'s pixiv/ChatVRM.

Building an application development environment

See Building an App Development Environment

How to build a robot

See How to Build a Robot

Design

1. periodically take camera captures and keep them in a queue (there is a maximum number in the queue and the oldest ones are deleted)
2. request LLM with periodically kept captures and system prompts, specifying Tools for “speak”, “show emotion”, and “move”. 3.
3. move the robot in response to Tool calls in the LLM response

The “robotvrm” topic on GitHub

In the future, we will create a list of RobotVRMs. If you have forked it, please set “ robotvrm ” as a topic in the “About” section in the upper right corner of the repository.

Character Terms of Use for this Repository

The characters in this repository are basically free of charge and can be used for commercial purposes by both individuals and corporations (for details, please refer to the Terms of Use of Characters in this Repository for details)

Sponsor

(The larger the sponsor's icon, the larger the amount)

Dragon Sponsor US$12,000 (maximum)

There are currently no sponsors at this level.

Hero Sponsor US$10,000

There are currently no sponsors at this level.

Demon King Sponsor US$5,000

There are currently no sponsors at this level.

Elf Sponsor US$1,000

There are currently no sponsors at this level.

Demon Sponsor US$500

There are currently no sponsors at this level.

Wizard Sponsor US$100

There are currently no sponsors at this level.

Auger Sponsor US$50

There are currently no sponsors at this level.

Warrior Sponsor US$10

There are currently no sponsors at this level.

Wolf Sponsor US$5

There are currently no sponsors at this level.

Slime Sponsor US$1