Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

点云与RGB结合失败 #151

Open
autumntang opened this issue Mar 8, 2025 · 3 comments
Open

点云与RGB结合失败 #151

autumntang opened this issue Mar 8, 2025 · 3 comments

Comments

@autumntang
Copy link

郑博您好!我运行fast_livo2得到的结果存在一些问题,具体表现如下:

Image

Image
我使用的传感器为mid360以及d435i,已经做过外参标定和时间同步,以下是时间同步后的lidar与相机timestamp效果:

Image

Image
想向您请教,出现以上结果,可能是在什么地方出了问题。
并且,以下是我使用的mid360.yaml参数:common:
img_topic: "/color"
lid_topic: "/livox/lidar"
imu_topic: "/livox/imu"
img_en: 1
lidar_en: 1
ros_driver_bug_fix: false

extrin_calib:
extrinsic_T: [-0.011, -0.02329, 0.04412] #
extrinsic_R: [1, 0, 0, 0, 1, 0, 0, 0, 1]
Rcl: [-0.0385484, 0.0582421, 0.9975579,
-0.9992565, -0.0032215, -0.0384259,
0.0009756, -0.9982976, 0.0583231]
Pcl: [0.0191877, 0.0314342, -0.0181279]

time_offset:
imu_time_offset: 0.0
img_time_offset: 0.1
exposure_time_init: 0.0

preprocess:
point_filter_num: 1
filter_size_surf: 0.1
lidar_type: 1 # Livox Avia LiDAR
scan_line: 4
blind: 0.5

vio:
max_iterations: 5
outlier_threshold: 1000 # 78 100 156 #100 200 500 700 infinite
img_point_cov: 100 # 100 1000
patch_size: 8
patch_pyrimid_level: 4
normal_en: true
raycast_en: false
inverse_composition_en: false
exposure_estimate_en: true
inv_expo_cov: 0.1

imu:
imu_en: true
imu_int_frame: 30
acc_cov: 0.8 # 0.2
gyr_cov: 0.5 # 0.5
b_acc_cov: 0.001 # 0.1
b_gyr_cov: 0.001 # 0.1

lio:
max_iterations: 5
dept_err: 0.02
beam_err: 0.15
min_eigen_value: 0.005 # 0.005
voxel_size: 0.5
max_layer: 2
max_points_num: 50
layer_init_num: [5, 5, 5, 5, 5]

local_map:
map_sliding_en: false #false
half_map_size: 100
sliding_thresh: 8

uav:
imu_rate_odom: false
gravity_align_en: true

publish:
dense_map_en: true
pub_effect_point_en: false
pub_plane_en: false
pub_scan_num: 1
blind_rgb_points: 0.0

evo:
seq_name: "CBD_Building_01"
pose_output_en: false

pcd_save:
pcd_save_en: true
colmap_output_en: true # need to set interval = -1
filter_size_pcd: 0.15
interval: -1
文件中的extrinsic_T和extrinsic_R我是根据您在另一个issue中的回答所设置,以及还想请问您,该参数是为什么设置为上面的值,与Rcl、Pcl有何不同,Rcl与Pcl是相机到雷达的旋转矩阵和平移矩阵,extrinsic_T和extrinsic_R代表了什么?
对于以上诸多问题我深感抱歉,诚盼您的回复!

@autumntang
Copy link
Author

补充:采集的第一帧rgb与lidar融合效果比较好,移动lidar和相机之后rviz中显示的点云上附着的rgb肉眼可见的变模糊

@gc625
Copy link

gc625 commented Mar 9, 2025

如果第一帧rgb与lidar融合效果比较好,那我觉得应该是cam和lidar同步没做好,rqt_bag里要看lidar msg 和 cam msg header里的timestamp,而不只是看msg在時間軸中的位置

@autumntang
Copy link
Author

感谢您的回答!我选择了如下两个时间戳,这二者之间的时间差距是否过大?此外我发现,尽管我设置相机的频率也为10hz,但从时间戳上看来相机与lidar之间每次发布消息的时间戳差值并不是固定的,请问您是否知道这是什么原因
Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants