基于环境反馈的控制方法，叫做反馈控制。

控制模块的目的是让无人车能够按照规划好的路径行驶，需要将环境当前的反馈和规划的参考量进行比较，得到当前偏离参考量的误差，并基于这个误差设计一定的算法来产生输出信号，使得误差不断变小，直到为0.

PID控制器是目前应用最广泛的控制理论。

PID控制器是指P(Proportion 比例)、I（Integral 积分），D(Derivative 微分) ，这三项如何使用误差来产生控制指令。

1. P控制

假设控制输出的是车辆的转角；

偏离航迹误差(Cross Track Error, CTE):就是车辆到参考线的距离，用CTE作为误差度量,即转向角与CTE成比例；

s t e r r i n g a n g l e = K p ∗ e ( t ) sterring angle = K_p *e(t) sterringangle=Kp∗e(t)

e(t)是车辆在t时刻的CTE，CTE偏大时，转向角也大，反之偏转小一点；

在P控制器中，系数 K p K_p Kp会直接影响实际控制效果，在合理范围内， K p K_p Kp越大，控制效果越好。

伪代码实现：

def run(robot, tau, n=100, speed=1.0):x_trajectory = []y_trajectory = []for i in range(n):cte = robot.ysteer = -tau * cterobot.move(steer, speed)x_trajectory.append(robot.x)y_trajectory.append(robot.y)return x_trajectory, y_trajectory

但是P控制器容易受零值影响，实际中表现为来回多次穿过参考线

为了矫正这个问题，我们引入一个新的参数，CTE变化率

2. PD控制

CTE的变化率，描述无人车向着参考线移动的多块，如果无人车一直在参考线上运动，CTE变化率就是0；

s t e e r i n g a n g l e = K p ∗ e ( t ) + K d d e ( t ) d t steering angle = K_p*e(t) + K_d\frac{de(t)}{dt} steeringangle=Kp∗e(t)+Kddtde(t)

增大P系数会增大无人车向参考线运动的倾向，增大D系数则会增大无人车转向角快速变化的“阻尼”；

对于P偏大，D偏小的系统，称为“欠阻尼系统(underdamped)”, 这种情况无人车将沿参考线震荡前行；

而P偏小，D偏大的系统，称为“过阻尼(overdamped)”，这使得无人车需较长时间才能纠正误差；

合适的P，D系数，可以使无人车快速回到参考线，同时很好维持在参考线运动；

伪代码实现：

def run(robot, tau_p, tau_d, n=100, speed=1.0):x_trajectory = []y_trajectory = []prev_cte = robot.yfor i in range(n):cte = robot.ydiff_cte = cte - prev_cteprev_cte = ctesteer = -tau_p * cte - tau_d * diff_cterobot.move(steer, speed)x_trajectory.append(robot.x)y_trajectory.append(robot.y)return x_trajectory, y_trajectory

系统偏差

PD控制器可以保证正常的控制需求，但是容易受系统偏差影响；

比如当车轮存在偏移角(非理想化)，对人类驾驶来说，这问题不大，但是对于无人驾驶，会产生巨大的CTE。

为解决熊偏差问题，引入一个控制量来消除这种误差。

3 PID控制器

引入一个积分项，加入到控制输出函数中

s t e e r i n g a n g l e = K p ∗ e ( t ) + K d d e ( t ) d t + k i ∫ 0 t e ( t ) d t steering angle = K_p*e(t) + K_d\frac{de(t)}{dt} + k_i\int_0^te(t)dt steeringangle=Kp∗e(t)+Kddtde(t)+ki∫0te(t)dt

K i K_i Ki积分项，本质上是车的实际路线和参考线的图形面积，加入积分项后，控制器会使车辆路线的积分尽可能小，从而避免稳态误差情况。

伪代码实现:

def run(robot, tau_p, tau_d, tau_i, n=100, speed=1.0):x_trajectory = []y_trajectory = []prev_cte = robot.yint_cte = 0for i in range(n):cte = robot.ydiff_cte = cte - prev_cteprev_cte = cteint_cte += ctesteer = -tau_p * cte - tau_d * diff_cte - tau_i * int_cterobot.move(steer, speed)x_trajectory.append(robot.x)y_trajectory.append(robot.y)return x_trajectory, y_trajectory

积分向系数的大小也会影响整个控制系统的稳定性， K i K_i Ki过大，会使系统“震荡”运行， K i K_i Ki过小又会需要较长时间才能修正车辆稳态误差。

PID控制器，就是由 K p , K i , K d K_p, K_i, K_d Kp,Ki,Kd三项共同决定的，其实现非常简单，但是这三个系数的选择缺很难。

PID算法Python实现：

# -----------
# User Instructions
#
# Implement a P controller by running 100 iterations
# of robot motion. The steering angle should be set
# by the parameter tau so that:
#
# steering = -tau_p * CTE - tau_d * diff_CTE - tau_i * int_CTE
#
# where the integrated crosstrack error (int_CTE) is
# the sum of all the previous crosstrack errors.
# This term works to cancel out steering drift.
#
# Only modify code at the bottom! Look for the TODO.
# ------------import random
import numpy as np
import matplotlib.pyplot as plt# ------------------------------------------------
#
# this is the Robot class
#class Robot(object):def __init__(self, length=20.0):"""Creates robot and initializes location/orientation to 0, 0, 0."""self.x = 0.0self.y = 0.0self.orientation = 0.0self.length = lengthself.steering_noise = 0.0self.distance_noise = 0.0self.steering_drift = 0.0def set(self, x, y, orientation):"""Sets a robot coordinate."""self.x = xself.y = yself.orientation = orientation % (2.0 * np.pi)def set_noise(self, steering_noise, distance_noise):"""Sets the noise parameters."""# makes it possible to change the noise parameters# this is often useful in particle filtersself.steering_noise = steering_noiseself.distance_noise = distance_noisedef set_steering_drift(self, drift):"""Sets the systematical steering drift parameter"""self.steering_drift = driftdef move(self, steering, distance, tolerance=0.001, max_steering_angle=np.pi / 4.0):"""steering = front wheel steering angle, limited by max_steering_angledistance = total distance driven, most be non-negative"""if steering > max_steering_angle:steering = max_steering_angleif steering < -max_steering_angle:steering = -max_steering_angleif distance < 0.0:distance = 0.0# apply noisesteering2 = random.gauss(steering, self.steering_noise)distance2 = random.gauss(distance, self.distance_noise)# apply steering driftsteering2 += self.steering_drift# Execute motionturn = np.tan(steering2) * distance2 / self.lengthif abs(turn) < tolerance:# approximate by straight line motionself.x += distance2 * np.cos(self.orientation)self.y += distance2 * np.sin(self.orientation)self.orientation = (self.orientation + turn) % (2.0 * np.pi)else:# approximate bicycle model for motionradius = distance2 / turncx = self.x - (np.sin(self.orientation) * radius)cy = self.y + (np.cos(self.orientation) * radius)self.orientation = (self.orientation + turn) % (2.0 * np.pi)self.x = cx + (np.sin(self.orientation) * radius)self.y = cy - (np.cos(self.orientation) * radius)def __repr__(self):return '[x=%.5f y=%.5f orient=%.5f]' % (self.x, self.y, self.orientation)

############# ADD / MODIFY CODE BELOW ####################
# ------------------------------------------------------------------------
#
# run - does a single control runrobot = Robot()
robot.set(0, 1, 0)def run(robot, tau_p, tau_d, tau_i, n=100, speed=1.0):x_trajectory = []y_trajectory = []prev_cte = robot.yint_cte = 0for i in range(n):cte = robot.ydiff_cte = cte - prev_cteprev_cte = cteint_cte += ctesteer = -tau_p * cte - tau_d * diff_cte - tau_i * int_cterobot.move(steer, speed)x_trajectory.append(robot.x)y_trajectory.append(robot.y)return x_trajectory, y_trajectoryx_trajectory, y_trajectory = run(robot, 0.2, 3.0, 0.001)
n = len(x_trajectory)plt.plot(x_trajectory, y_trajectory, 'b', label='PID controller')
plt.plot(x_trajectory, np.zeros(n), 'r', label='reference')
plt.savefig("PID_Contrl.png")

PID系数调整方法：

1.twiddle算法：

如上例PID算法实现，返回一个CTE的平均值来度量系统的误差程度，问题转化为，寻找使CTE均值最小化的PID系数。

设立一组初始值, 比如系数初值p=[0, 0, 0]; 系数调整范围初值dp=[1,1,1]

循环遍历迭代系数p，

首先调大p[i]值，p[i] += dp[i]

若效果改善，保留该值，将对应系数范围加大dp[i]*=1.1

若无改善，调小p[i], p[i] -= 2*dp[i] ;

若有效，保留该值，将对应系数范围加大dp[i]*=1.1

若无效，p[i]保留原值，缩小dp[i]范围 dp[i]*=1.1；

循环迭代，通过缩放得到的参数越来越精确，直到收敛(系数范围和sum(dp[i])足够小).

这是一种局部爬山算法，但是它非常高效.

伪代码实现：

def twiddle(tol=0.2): p = [0, 0, 0]dp = [1, 1, 1]robot = make_robot()x_trajectory, y_trajectory, best_err = run(robot, p)it = 0while sum(dp) > tol:print("Iteration {}, best error = {}".format(it, best_err))for i in range(len(p)):p[i] += dp[i]robot = make_robot()x_trajectory, y_trajectory, err = run(robot, p)if err < best_err:best_err = errdp[i] *= 1.1else:p[i] -= 2 * dp[i]robot = make_robot()x_trajectory, y_trajectory, err = run(robot, p)if err < best_err:best_err = errdp[i] *= 1.1else:p[i] += dp[i]dp[i] *= 0.9it += 1return p

2. 实践调试方法

该方法是做优达学城项目过程中，mentor给的建议，实践中效果挺不错，哈哈

具体参考：https://blog.csdn.net/luteresa/article/details/104582834

Additional Resources on Control

Model Predictive Control (MPC)

Vision-Based High Speed Driving with a Deep Dynamic Observer by P. Drews, et. al.

Abstract: In this paper we present a framework for combining deep learning-based road detection, particle filters, and Model Predictive Control (MPC) to drive aggressively using only a monocular camera, IMU, and wheel speed sensors. This framework uses deep convolutional neural networks combined with LSTMs to learn a local cost map representation of the track in front of the vehicle. A particle filter uses this dynamic observation model to localize in a schematic map, and MPC is used to drive aggressively using this particle filter based state estimate. We show extensive real world testing results, and demonstrate reliable operation of the vehicle at the friction limits on a complex dirt track. We reach speeds above 27 mph (12 m/s) on a dirt track with a 105 foot (32m) long straight using our 1:5 scale test vehicle. […]

Reinforcement Learning-based

Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Driving by D. Li, et. al.

Abstract: This paper investigates the vision-based autonomous driving with deep learning and reinforcement learning methods. Different from the end-to-end learning method, our method breaks the vision-based lateral control system down into a perception module and a control module. The perception module which is based on a multi-task learning neural network first takes a driver-view image as its input and predicts the track features. The control module which is based on reinforcement learning then makes a control decision based on these features. In order to improve the data efficiency, we propose visual TORCS (VTORCS), a deep reinforcement learning environment which is based on the open racing car simulator (TORCS). By means of the provided functions, one can train an agent with the input of an image or various physical sensor measurement, or evaluate the perception algorithm on this simulator. The trained reinforcement learning controller outperforms the linear quadratic regulator (LQR) controller and model predictive control (MPC) controller on different tracks. The experiments demonstrate that the perception module shows promising performance and the controller is capable of controlling the vehicle drive well along the track center with visual input.

Behavioral Cloning

The below paper shows one of the techniques Waymo has researched using imitation learning (aka behavioral cloning) to drive a car.

ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst by M. Bansal, A. Krizhevsky and A. Ogale

Abstract: Our goal is to train a policy for autonomous driving via imitation learning that is robust enough to drive a real vehicle. We find that standard behavior cloning is insufficient for handling complex driving scenarios, even when we leverage a perception system for preprocessing the input and a controller for executing the output on the car: 30 million examples are still not enough. We propose exposing the learner to synthesized data in the form of perturbations to the expert’s driving, which creates interesting situations such as collisions and/or going off the road. Rather than purely imitating all data, we augment the imitation loss with additional losses that penalize undesirable events and encourage progress – the perturbations then provide an important signal for these losses and lead to robustness of the learned model. We show that the ChauffeurNet model can handle complex situations in simulation, and present ablation experiments that emphasize the importance of each of our proposed changes and show that the model is responding to the appropriate causal factors. Finally, we demonstrate the model driving a car in the real world.

无人驾驶13：PID控制器相关推荐

变速积分pid控制器matlab,变速积分PID控制系统设计.docx
课程设计报告设计题目变速积分PID控制系统设计课程名称计算机控制技术B 姓名苏丹学号 2008100731 班级自动化0803 教师闫高伟摘要错误!未定义书签. Abstract 第1章数 ...
计算机控制实验PID数字控制器设计,实验二数字PID控制器的设计
<实验二数字PID控制器的设计>由会员分享,可在线阅读,更多相关<实验二数字PID控制器的设计(13页珍藏版)>请在人人文库网上搜索. 1.实验二数字PID控制器的设计直流闭 ...
PID控制器（比例-积分-微分控制器）
PID控制器(比例-积分-微分控制器)- I 形象解释PID算法小明接到这样一个任务: 有一个水缸点漏水(而且漏水的速度还不一定固定不变),要求水面高度维持在某个位置,一旦发现水面高度低于要求位置, ...
PID控制器（比例-积分-微分控制器）- I
原文链接:https://www.cnblogs.com/shangdawei/p/4825259.html 形象解释PID算法小明接到这样一个任务:有一个水缸点漏水(而且漏水的速度还不一定固定不变 ...
m基于强化学习的PID控制器simulink仿真,对比PI控制器和变结构PI控制器
目录 1.算法描述 2.仿真效果预览 3.MATLAB核心程序 4.完整MATLAB 1.算法描述 PID控制器,即控制器的控制方式为P比例调整,I积分调整以及D微分调整三个部分构成,PID控制器是目 ...
【MATLAB】自适应果蝇优化算法整定PID控制器参数（六）—— 一阶带时延的被控对象
[MATLAB]自适应果蝇优化算法整定PID控制器参数(六)-- 一阶带时延的被控对象目录 [MATLAB]自适应果蝇优化算法整定PID控制器参数(六)-- 一阶带时延的被控对象 0研究背景 1自适 ...
【MATLAB】FOA优化算法整定PID控制器参数（五）—— 一阶带时延的被控对象
[MATLAB]FOA优化算法整定PID控制器参数(五)-- 一阶带时延的被控对象目录 [MATLAB]FOA优化算法整定PID控制器参数(五)-- 一阶带时延的被控对象 1研究背景 2果蝇优化算法 ...
matlab数字pid控制仿真程序,基于MATLAB的数字PID控制器设计及仿真分析
基于MATLAB的数字PID控制器设计及仿真分析基于基于MATLABMATLAB的数字的数字PIDPID控制器设计及仿真分析控制器设计及仿真分析摘摘要要 PID控制作为历史最为悠久,生命力最强的 ...
《MATLAB智能算法30个案例》：第14章基于粒子群算法的PID控制器优化设计
<MATLAB智能算法30个案例>:第14章基于粒子群算法的PID控制器优化设计 1. 前言 2. MATLAB 仿真示例 3. 小结 1. 前言 <MATLAB智能算法30个案例 ...

无人驾驶13：PID控制器

1. P控制

2. PD控制

系统偏差

3 PID控制器

PID系数调整方法：

1.twiddle算法：

2. 实践调试方法

Additional Resources on Control

Reinforcement Learning-based

Behavioral Cloning

无人驾驶13：PID控制器相关推荐

最新文章

热门文章