Intelligent vehicles: integration and issues Z. Alsayed, G. Bresson, P. Merdrignac, P. Morignot, F. Nashashibi, E. Pollard, G. Trehard
IMARA Informatique, Mathématiques, Automatique, pour la Route Automatisée
became
RITS Robotics & Intelligent Transportation Systems
Praxitèle
Imara
Rits
1990
2002
2014
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
-2
Robotics vs. Artificial Intelligence (AI) Robotics: science of perceiving and manipulating the physical world through computer-controlled mechanical devices
AI: any computer program which would be said "intelligent" if the same observed behavior would be so qualified when performed by a human.
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
3
Robotics • “ Robotics is the science of perceiving and manipulating the physical world through computer-controlled mechanical devices.” [S. Thrun, 2006]
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
4
An attempt to define an intelligent robot • Ultimate goal: ensure its survival in its environment • Ensure its energy independence • Diagnose its own state • Evaluate its perception abilities
• Achieve a mission • React properly to an unknown/abnormal situation • Learn from experience
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
5
Work in progress with intelligent cars • Ultimate goal: ensure its survival in its environment • Ensure its energy independence • Diagnose its own state • Evaluate its perception abilities
• Achieve a mission: move safely from a point A to B • React properly to an unknown/abnormal situation • Learn from experience
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
6
Inputs
Automation loop Process
Sensors Exteroceptive
Knowledge base
Camera LIDAR RADAR
Perception
Odometry Inertial GPS
Communications
Supervision
Proprioceptive
Planning Global Planning (Route Planning)
Local Planning (Trajectory Planning + Trajectory Coordination)
Outputs
HMI Actuators Steering/Direction
Control (Trajectory Execution)
Speed/Propulsion
How to introduce intelligence (human behavior) into the driving process? Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
7
How do we introduce intelligence into the driving process? 1. Supervision through Software Architectures: a unified framework 2. Dealing with uncertainty 3. Increase the perception using communication 4. Limit the combination explosion
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
8
Supervision through software architectures: a unified framework
Inputs
• reaching a full autonomous driving mode in all situations impossible • self-assessment for the vehicle of its own perception abilities Process
Sensors Exteroceptive
Know. base
Camera LIDAR RADAR
Odometry Inertial GPS
Outputs
Communications
Supervision
Perception Proprioceptive
Planning Global Planning
Local Planning
HMI Actuators Steering/Direction
Control
Speed/Propulsion
E. Pollard et al., An Ontology-based Model to Determine the Automation Level of an Automated Vehicle for Co-Driving Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
9
E. Pollard, An Ontology-based Model to Determine the Automation Level of an Automated Vehicle for Co-Driving
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
10
Longitudinal control layer Levels of automation in terms of decisions to make about…
0: fully driving
P1
Long1: Cruise
Longitudinal control
control
Long2: Dynamic Set Speed Type
P2
Long3: Autonomous CC
P3
Long4: Stop&Go
CLong: Cooperative cruise control communication
C1
Increasing needs in terms of perception and communication Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
11
Dealing with uncertainty
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
12
Dealing with uncertainty
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
13
Supervision: dealing with real time Supervision
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
14
Multi-sensor fusion: • To combine properly data from multiple sensors • Deal with the problem of track spatial and temporal correlation
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
[H. Li, et al, 2013] Track-to-Track Fusion Using Split Covariance Intersection Filter-Information Matrix Filter (SCIF-IMF) for Vehicle Surrounding Environment Perception Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
16
Perception with Transferable Belief Model
[Trehard 2014] Credibilist simultaneous localization and mapping (C-SLAM) with a lidar Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
17
Dealing with uncertainty and building generic architectures SLAM
Low level High Level
Landmark queue Drift handling
Drift estimation Absolute information (GPS, V2I…)
Loop EKF SLAM [Bresson 2013] , A General Consistent Decentralized SLAM Solution
Information from another vehicle (V2V)
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
18
Increasing perception using communications Decorrelated maps Send
v b1 l1
Decentralized map
1
Pv Pb
vu1
Pl
b1
Receive
v
2
Pv
b1 l1
lu1 vu2
Pb
Pl
b2
Pvu1
Pb1 Pb 1
Pau1 Plu1 Pvu2 Pvu2 Pb2 Pb2
vu3
Receive
v b1
3
Pv
Pvu3 Pvu3
Pb 3
b3
Pb
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
19
Limit the combinatorial explosion: SLAM stretching compacted grid map:
• Dedicated to “open” areas • Load in memory only the local neighborhood map slots, since the rest of the map is saved on the hard disc • a coding technique to compact and save the old or non-used far slots
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
20
SLAM stretching compacted grid map
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
21
Conclusion • The main issues related to autonomous vehicles can be summarized like this: • •
• •
Deal with integration problems Using redundancy and complementary information to achieve very precise state estimation Using the fact that a vehicle should know that it does not know Imitate human behavior for decision process
More experiment results on: https://team.inria.fr/rits/ Thank you for your attention! Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
results with both synthetic data and real data prove the high accuracy, low .... stereojvision based obstacle detection[5] is used to remove .... time is unavoidable by using deadjreckoning, all the ... environments are campus, urban roads, and highw
Wireless communications are realized by the terminologies ZigBee and GPRS: ZigBee is used for the wireless communication between vehicles (V2V), and the.
l'utilisation des communications, ainsi que la gestion des ressources. Mots Clef .... ware architecture as a structure to organize the various al- gorithms inside a ...
l'utilisation des communications, ainsi que la gestion des ressources. Mots Clef .... ware architecture as a structure to organize the various al- gorithms inside a ...
the Study of Fault-Tolerant Control Systems in Robotic .... In most applications, a dedicated sensor must be integrated in the system in order to measure .... hyper-redundant manipulator arms using electrical motors results in a discrete non-.
(6) Never disassemble and repair the airbag sensor as- sembly ..... Observe the following instructions and then measure with the rear ... If the vehicle has trouble in the chassis and drive train, use method 1 (flat bed truck). ... (e) Do not run eng
Sep 19, 2005 - Network/Communications. â Sensors ... Unmanned Air Vehicles. Extended Range. & Increased ... UAVs navigate to arrive and land on demand.
infrastructure, and testing and evaluating intelligent vehicles. Intelligent infrastructure ...... paper presented at IST 2000, Torino, Italy, 2000. 54. Stephanedes, Y.J. ...
The Optical Bypass Switch with Heartbeat monitors the link to the attached in-line device by sending a programmable heartbeat packet to the device once every.
RF et le câblage terrestre onéreux en diminuant le besoin de câblage ... Aucune étude RF du site, aucune installation de câblage, aucune .... car le trafic n'est pas relayé sur ce SSID. Gestion facile. Toute la gestion du réseau maillé intelligent es
In parallel, the road in the scene can be represented by a simple generic 3D model and can be textured using visual information from camera acquisitions.
IP Rating Plug Area: IP 45 when plugged-in (MENNEKES Connector); with flap lid ... LV Harness: 7-wire sheated cable with 0,35 mm², LV harness is assembled.
conventions. The early British computer con- ferences - portal.acm.org, 1989. ... ning short cribs on the us navy bombe. Cryp- tologia - Taylor & Francis, 2003.
been refined before in the literature [3, 136,. 150, 171, 187, 114, ..... 3 citation(s). [33] AM Turing. A note on normal numbers. -, 0. 8 citation(s). [34] AM Turing. .... has a normal form. Manuscript ..... esis. 1953. Bulletin of mathematical biol
wire's application to medical imaging. The boundary definition times (for ... Vision,â IEEE Transactions on Pattern Analysis and Machine. Intelligence, vol. 12, no.
application. All software was hand assembled using. AT&T System V's compiler built on Richard Ham- ..... Public Record Office, London -, 1940. 3 citation(s). 6 ...
grâce à l'alliance de la norme 802.11n et de la technologie. Wi-Fi intelligente .... convergent et de latence, tout en optimisant les performances. Maillage hybride ...
Turing test (see Introduction section) on the long term. Unfortunately, A.I. is often only considered as a library of algorithms, in which Robotics researchers dig as ...
indicators increases your management options and ... Reset statistics counters and peak data. ⢠Turn off ... stream, sending all aggregated traffic out one or two ...