Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configure Isaac_Ros_Apriltag to use multiple cameras #311

Open
BergerKing333 opened this issue Nov 5, 2024 · 4 comments
Open

Configure Isaac_Ros_Apriltag to use multiple cameras #311

BergerKing333 opened this issue Nov 5, 2024 · 4 comments
Labels
new feature Implementation of a new feature

Comments

@BergerKing333
Copy link
Member

Being able to use multiple cameras to detect apriltags would make early match localization quicker/easier and would allow fusing of apriltags throughout the entire match when neither of the 2 zeds are facing towards the base. We should be able to use one of our plain webcams to do this since apriltags don't require depth cameras

@BergerKing333
Copy link
Member Author

Im pretty sure nvidia has support for this with isaac ros 3.1 (they added multi cam support for nvblox), but if not we could frankenstein it and stitch multiple camera feeds into one with OpenCV or something then feed that to nvblox. Determining the pixel that the tag is found in we could replicate apriltag detection but this is not ideal

@jmblixt3
Copy link
Member

jmblixt3 commented Nov 5, 2024

You could also run multiple instances of the april tag node and then combine.

@Isopod00
Copy link
Member

Isopod00 commented Nov 8, 2024

Jonathan's comment is the way we would want this to be done. Run one instance of isaac_ros_apriltag per camera we want searching for apriltags, and since each of these instances return TFs from the camera frame to the tag frame, it should just straight up work honestly with the Apriltag math we are already doing since I wrote it to rely on the ROS TF tree. Although, some minor modifications might be needed.

@jmblixt3
Copy link
Member

jmblixt3 commented Nov 8, 2024

I also know there was discussion of an EKF, and they could be combined there as well potentially

@Isopod00 Isopod00 added the new feature Implementation of a new feature label Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new feature Implementation of a new feature
Projects
None yet
Development

No branches or pull requests

3 participants