An Extrinsic Calibration Tool for Radar, Camera and Lidar
- Abstract
- I. INTRODUCTION
- II. RELATED WORK
- - A. Multi-modal calibration with lidar, camera and radar
  - B. Calibrating more than two sensors
  - C. Contributions
- III. PROPOSED APPROACH
- IV. EXPERIMENTS
- V. CONCLUSION
- Words
- Complementation

An Extrinsic Calibration Tool for Radar, Camera and Lidar

Abstract

joint extrinsic calibration of all three sensing modalities on multiple measurements.
Furtheremore, obtain simultaneous measurements for all these modalities.

Three different configurations of the optimization criterion are considered, namely

using error terms for a minimal amount of sensor pairs,
using terms for all sensor pairs with additional loop closure constraints,
by adding terms for struecture estimation in a probablistic model.

Results:

all configureations achieve good results for lidar to camera errors
fully connected pose estimation shows the best performance for lidar to radar errors when more than 5 board locations are used.

zero mean Gaussian noise

FCPE is the best

I. INTRODUCTION

3 related techniques:

Minimally connected pose estimation (MCPE)
Fully connected pose estimation (FCPE)
Pose and structure estimation (PSE)

II. RELATED WORK

extrinsic calibration is also known as pose estimation [14] and sensor registration.

Extrinsic calibration can in turn be divided into target-less and target-based procedures.

table I

A. Multi-modal calibration with lidar, camera and radar

B. Calibrating more than two sensors

minimally connected pose estimation

C. Contributions

First, three extrinsic
calibration conﬁgurations to jointly calibrate lidar, camera
and radar are investigated. We study the three conﬁgurations,
required number of calibration board locations, and choice
for the reference sensor using a real multi-modal sensor
setup.
Second, we propose a calibration target design that
is detectable by lidar, camera and radar.
Third, we provide
an open-source extrinsic calibration tool for these sensors,
with bindings to Robot Operating System (ROS) 1 .

III. PROPOSED APPROACH

It is implemented as an open-source tool with bindings to the ROS middleware, and which includes a tool that can update Uniﬁed Robot Description Format (URDF), to facilitate extensibility and application on real robotic platforms.

a) Calibration target design:

For lidar and camera, edges and corners are features which can be detected accurately and robustly.

However, rectangular(矩形的) shaped objects are difﬁcult to localise in lidar as a nearly horizontal edge might not intersect with any of the lidar scan planes [9].
So use cirular shapes for lidar.

Our proposed calibration target design has four circular holes and additionally contains a single metal trihedral corner reﬂector in the center at the back of the board to provide strong radar reﬂections as well.

Furthermore, our calibration board is made from styrofoam(聚苯乙烯泡沫塑料) to not affect the detectability of the corner reﬂector [9].

标定板和孔洞的尺寸问题文章中有更详细描述。

b) Detection of calibration target:

Both camera and lidar detectors return the 3D
locations of the four circle centers.

The radar returns detections in a 2D plane and generates
for each reﬂection a measurement in polar coordinates and
a RCS value.

c) Calibration procedures:

ﬁrst introduce extrinsic calibration for two sensors.

Since each sensor has a different Field of View (FOV),the calibration target may not always be detectable by all.

To parameterize
the 6 degrees of freedom of transformation T 1,2 , we use
parameter vector θ 1,2 = (t x , t y , t z , v x · α, v y · α, v z · α).

Additionally, we enforce the constraint that the projected
3D points lie within radar Field of View (FOV).

Pose estimation can now be formulated as an optimization
problem to ﬁnd the optimal transformation which minimizes
the total error f (θ 1,2 ) between all K calibration targets,…

Our tool uses Sequential Least SQuares Programming
(SLSQP) from the SciPy library [25] for optimization.

d) Joint calibration with more than two sensors:

Minimally connected pose estimation (MCPE):

minimally connected graph
Fully connected pose estimation (FCPE):

consider optimizing transformations between all sensors at once, without a special reference sensor.

In addition,the closed loop constraint is introduced to ensure that all loops l equal the identity matrix,

optimization is potentially more robust against noisy observations from one reference sensor. The downside is that the number of error terms increases
quadratically with the number of sensors. Furthermore, additional loop constraints must be added as well.
Pose and structure estimation (PSE):

This conﬁguration explicitly estimates the calibration board poses and the observation noise of each sensor.

The objective is to estimate both the unknown structure M = (m 1 , · · · , m K ) of the true target poses in a ﬁxed coordinate frame, and the transformation T M,i from the ﬁxed frame to each sensor i, see ﬁgure 2c.

The potential beneﬁt is that this is a homogeneous error metric. Another beneﬁt of such a probabilistic formulation is that prior knowledge on board and sensor poses could be included, we have not pursued this direction here. The disadvantages are that the optimization is more complex and that the loop closure constraint is not explicitly enforced.

IV. EXPERIMENTS

lidar => on roof
radar => behind bumper
stereo camera => behind windscreen

With these sensors, we have recorded a dataset with sensor measurements of 29 calibration board locations that are located in the FOV of all
sensors and in the working range of 5 m from the car.

The used measure is the Root Mean Squared Error(RSME).

a) Choice of MCPE reference sensor:

b) Comparison to baseline method:

c) Required number of calibration board locations:

The ﬁgure shows that when 10 boards are used, the errors for FCPE and PSE have converged to ≤ 2 cm for both l2c and l2r transforms. MCPE performs the worst for the RMSE of l2r, whereas FCPE performs the best with a RMSE of less than 1.5 cm when using all 29 board locations. We have observed that PSE is sometimes less robust.

d) Sensitivity to observation noise:

e) Qualitative results:

V. CONCLUSION

presented an open-source extrinsic calibration tool for
lidar, camera and radar, and proposed three conﬁgurations
to estimate the sensor poses from simultaneous detections
of multiple calibration board locations.

all conﬁgurations
can provide good calibration results.

Words

multi-modal 多模态
modalities 模式
dismount v. 下马
schematic [skiːˈmætɪk] adj. 略图的，纲要的
explicit 明确的
formalize 正式化，形式化
distinction n. 差别
focal 焦点的
skewness 偏斜
Field of View (FOV)
suboptimal 次优
abbreviations n. [əˌbriːviˈeɪʃn] 缩写
routine [ruːˈtiːn] 常规
heterogeneous [ˌhetərəˈdʒiːniəs] 各种各样的
normal vectors 法向量
centroids 质心
diagonal [daɪˈæɡənl] 斜线的
variances n.方差;变化幅度;差额
deviation n. 偏差
styrofoam n. 聚苯乙烯泡沫塑料
beam n. 光束
intersect v. 相交，交叉，合流
diameter [dīˈamədər] n. 直径

Complementation

对这篇文章的理解：

所谓多传感器的标定，就是要找到多个传感器在相同的作用域范围内，把他们的坐标系调整到同一位置上，使它们看到的角度和目标物体是在同一维度观察的。
要实现这个目标，就要构建一个loss function，表示的是各个坐标系之间的偏差，求一个最小化偏差的问题，从而实现标定的效果最好。

常见的求最小偏差的方法有：

【论文阅读】An Extrinsic Calibration Tool for Radar, Camera and Lidar相关推荐

论文阅读 End-to-End Multi-View Fusion for 3D Object Detection in Lidar Point Clouds
[论文阅读] End-to-End Multi-View Fusion for 3D Object Detection in Lidar Point Clouds 原文链接:https://arxiv ...
[论文阅读][SLAM]Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation
Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation 文章目录 Targetless ...
【论文阅读】Blur Calibration for Depth from Defocus
题目:Blur Calibration for Depth from Defocus从散焦模糊定标深度主题:defocus深度,PSF建模作者:Fahim Mannan 学校:加拿大McGill大 ...
论文阅读笔记：(2022.05) Observability-Aware Intrinsic and Extrinsic Calibration of LiDAR-IMU Systems
这是发表在IEEE Transactions on Robotics上关于Lidar和IMU标定的文章: 论文:https://arxiv.org/abs/2205.03276 代码开源了: GitH ...
论文阅读——《Online Photometric Calibration of Auto Exposure Video for Realtime Visual Odometry and SLAM》
论文阅读--<Online Photometric Calibration of Auto Exposure Video for Realtime Visual Odometry and SLA ...
论文阅读Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Optimization（含代码解读）
原文链接: https://arxiv.org/pdf/2007.14759v1.pdf 代码地址GitHub - APRIL-ZJU/lidar_IMU_calib: Targetless Cali ...
CalibNet：Geometrically Supervised Extrinsic Calibration using 3D Spatial Transformer Networks阅读理解
CalibNet:Geometrically Supervised Extrinsic Calibration using 3D Spatial Transformer Networks 无目标标定的 ...
毫米波点云生成论文阅读笔记 | 3D Point Cloud Generation with Millimeter-Wave Radar
毫米波点云生成论文 | 3D Point Cloud Generation with Millimeter-Wave Radar Kun Qian, Zhaoyuan He, Xinyu Zhang ...
《论文阅读06》Calib-Anything: Zero-training LiDAR-Camera Extrinsic CalibrationMethod Using SAM
一.论文研究领域:激光雷达-相机标定论文:Calib-Anything: Zero-training LiDAR-Camera Extrinsic Calibration Method Using ...

【论文阅读】An Extrinsic Calibration Tool for Radar, Camera and Lidar

目录