kitti数据集介绍论文Vision meets Robotics: The KITTI Dataset

下载链接：http://www.cvlibs.net/publications/Geiger2013IJRR.pdf
摘要：
使用灰度摄像机、彩色摄像机、雷达扫描器、高精度GPS/IMU惯性导航
系统记录了6h的交通情况，记录频率10-100 Hz。图片经过calibration(校准)、同步并且有时间戳（calibrated, synchronized and timestamped），有原始数据集和经过修正后的数据集（rectified），标注文件包括 3D tracklets形式的标签。
一：介绍
二：传感器设置
2个灰度camera
2个彩色camera
一个OXTS和GPS导航系统
一个雷达扫描器
注意他们的XYZ轴

三：数据集
The raw data set is divided into the categories ’Road’,
’City’, ’Residential’, ’Campus’ and ’Person。
For each sequence, we provide the raw
data, object annotations in form of 3D bounding box tracklets
and a calibration file, as illustrated in Fig. 4.

A.数据描述
date_drive.zip 存放的是整个的视频序列，除了raw data，也提供了 synced data（rectified and synchronized处理后的）。
image、雷达等都有自己的timestamps，雷达的timestamps有三个，雷达起始旋转时间(timestamps_start.txt)，spin end时间（旋转一周采集） (timestamps_end.txt)， facing forward and triggering the cameras (timestamps.txt)。
数据这样存储：
1.image:包括raw data 和 calibrati之后的图片。
2. 每帧包括30个值： The geographic coordinates
including altitude, global orientation, velocities, accelerations,
angular rates, accuracies and satellite information
3.点云数据：Each point is stored with
its (x, y, z) coordinate and an additional reflectance value ®
B.数据标注
3Dbbox的坐标系方向和雷达的坐标系的相对关系看下图，种类 ’Car’, ’Van’, ’Truck’, ’Pedestrian’, ’Person (sitting)’, ’Cyclist’, ’Tram’ and ’Misc’
bbox信息在date_drive_tracklets.xml
For each frame, we provide the object’s translation
and rotation in 3D, as illustrated in Fig. 7.
Note that we only provide the yaw angle, while the other two angles
are assumed to be close to zero

本文也提供了The total number of objects and the object orientations
for the two predominant classes ’Car’ and ’Pedestrian’ are
shown in Fig. 8.
For each object class, the number of object
labels per image and the length of the captured sequences is
shown in Fig. 9.
The egomotion of our platform recorded by
the GPS/IMU system as well as statistics about the sequence
length and the number of objects are shown in Fig. 10 for the
whole dataset and in Fig. 11 per street category.
C.开发组件
reading tracklets ：readTrackletsMex.cpp
run_demoTracklets.m：demonstrates how
3D bounding box tracklets can be read from the XML files and projected onto the image plane of the cameras.
run_demoVelodyne.m： The projection of 3D Velodyne point clouds into the image plane，See Fig. 6 for an illustration.

run_demoVehiclePath.m：shows how to
read and display the 3D vehicle trajectory using the GPS/IMU data.
从当前车辆所在的经纬信息、海拔信息以及偏航角、俯仰角等，可以使用墨卡托投影计算出车辆的6D信息（Rx Ry Rz tx ty tz）

D. Benchmarks

四. 传感器标定
we write scalars in lower-case
letters (a), vectors in bold lower-case (a) and matrices using
bold-face capitals (A). 3D rigid-body transformations which
take points from coordinate system a to coordinate system b
will be denoted by Tba
, with T for ’transformation’
a. 同步：雷达扫到前面的时候，相机与其同步数据
b. 相机标定：相机中心是在同一个x-y平面的，标定参数在calib_cam_to_cam.txt
Here, i ∈ {0, 1, 2, 3} is the camera index, where 0 represents
the left grayscale, 1 the right grayscale, 2 the left color and
3 the right color camera. Note that the variable definitions
are compliant with the OpenCV library, which we used for
warping the images. When working with the synchronized
and rectified datasets only the variables with rect-subscript are
relevant. Note that due to the 枕形失真效应 the images have been cropped such that the size of the rectified images is smaller than the original size of 1392 × 512 pixels.

. Note that in order to project a 3D point x in reference camera coordinates to apoint y on the i’th image plane, the rectifying rotation matrix of the reference camera R(0)rect must be considered as well.

A 3D point x in IMU/GPS
coordinates gets projected to a point y in the i’th image as

这篇文章中出现很多的
calibration 标定
synchronized 同步
rectified 修正相机坐标系位置
这是我的理解

kitti数据集介绍论文Vision meets Robotics: The KITTI Dataset相关推荐

【3D目标检测】KITTI数据集介绍
目录概述数据集下载激光雷达数据(`data_ object_velodyne`) 图像数据(`data_ object_image_ 2`) 标注数据(`data_ object_label 2 ...
计算机视觉数据集介绍：KITTI数据集
KITTI数据集简介 KITTI数据集是由德国卡尔斯鲁厄理工学院和丰田美国技术研究院联合创办,利用组装的设备齐全的采集车辆对实际交通场景进行数据采集获得的公开数据集.该数据集包含丰富多样的传感器数据( ...
KITTI数据集详解和评价标准
from: https://blog.csdn.net/Solomon1558/article/details/70173223 摘要:本文融合了Are we ready for Autonomous ...
数据集：KITTI数据集分析
摘要:本文融合了Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite和Vision meets Robotics: ...
【MMDetection3D】环境搭建，使用PointPillers训练测试可视化KITTI数据集
文章目录前言 3D目标检测概述 KITTI数据集简介 MMDetection3D 环境搭建数据集准备训练测试及可视化绘制损失函数曲线参考资料前言 2D卷不动了,来卷3D,之后更多地工作会 ...
KITTI数据集学习笔记
Kitti数据集本文为笔者自我学习的笔记,本人刚入门3D视觉,若有错误的地方恳请各位指正.另外参考了一篇热门博客:https://blog.csdn.net/Solomon1558/article/ ...
Kitti数据集的使用
摘要:本文融合了Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite和Vision meets Robotics: ...
KITTI数据集（概念版）
一.参考资料 KITTI 官网 kitti数据集各个榜单介绍自动驾驶KITTI数据集详解 KITTI数据集简介与使用 kitti数据集各个榜单介绍 KITTI数据集介绍 KITTI数据集简介(一) ...
多相机坐标转换_使用KITTI数据集实现坐标转换
本文的主要内容,是讨论如何将KITTI激光雷达的点云数据,映射到图像中去. KITTI数据集是怎么采集的下面这幅图是车的俯视图,可以看到,用到了2个彩色相机,2个灰度相机,1个激光雷达.1个GPS/ ...
KITTI数据集raw_data标定文件说明
官方文档:Vision meets Robotics: The KITTI Dataset calib_cam_to_cam.txt为相机i到0号相机的标定参数. calib_time: 09-Jan ...

kitti数据集介绍论文Vision meets Robotics: The KITTI Dataset

kitti数据集介绍论文Vision meets Robotics: The KITTI Dataset相关推荐

最新文章

热门文章