135 views

Uploaded by ramalakshmi_r

- 1998 - Rethinking JDL Data Fusion Levels
- A Survey of Maneuvering Target Tracking_ Dynamics
- Design and Analysis of Modern Tracking System
- Kalman Dan Simon
- Data Fusion Notes
- Bayesian Approaches to Multi Sensor Data Fusion
- An Introduction to the Kalman Filter (FULL VERSION)
- Tracking and Data Fusion Applications
- Multisensors Fusion and integration
- Multi Sensor Fusion and Integration
- Tracking and Kalman Filtering Made Easy
- 10.1.1.207.351.pdf
- kalman filter
- Papers Not Found
- Advances in Multi-Sensor Data Fusion- Algorithms and Applications
- GMTI and IMINT data fusion for multiple target tracking and classification
- Lecture 5
- Ict349 Ict649 Topic 04
- TAM ThesisInfo 2012-04-04 AyseTosunMisirli
- 3imp

You are on page 1of 52

Andrs Navarro

Contents

Introduction

Definition

Sensors and levels

Fusion models

Fusion techniques Distributed Data Fusion Scenarios Conclusions

Introduction

Motivation

Guide for people who do not know about sensor fusion to get introduced to the issue

Introduction

Research questions

What models for multisensor data fusion exist in the literature? Do they have common descriptions? Do they contradict each other?

What techniques or methods can be used in multisensor data fusion? Centralized or decentralized data fusion? What scenarios can multisensor data fusion be applied?

Definition

A process dealing with the association, correlation, and combination of data and information from single and multiple sources to achieve refined position and identity estimates, and complete and timely assessments of situations and threats, and their significance. The process is characterized by continuous refinements of its estimates and assessments, and the evaluation of the need for additional sources, or modification of the process itself, to achieve improved results.

Data fusion is the process of combining data or information to estimate or predict entity states.

Wald

Data fusion is a formal framework in which are expressed means and tools for the alliance of data originating from different sources. It aims at obtaining information of greater quality; the exact definition of greater quality will depend upon the application.

High-level Fusion

Fusion models

JDL data fusion model Dasarathy's functional model Waterfall fusion process model

Boyd Loop

Thomopoulos' Fusion Model

Durrant-Whyte architecture

The Omnibus process model Endsley's Situation Awareness General Data Fusion Architecture

Fusion models

Sources

Sources preprocessing

Level 1

Level 2 Level 3 Level 4 Database management system HCI

Fusion models

Drawbacks

Different revisions

New definitions

Fusion models

Levels of abstraction

Data Feature Decision

Categorization of data fusion functions in terms of the type of data level at input/output.

Fusion models

Fusion process in stages Omission of feedback data flow is the major limitation.

Fusion models

Boyd Loop

OODA cycle:

Fusion models

Fusion models

Durrant-Whyte achitecture

Fusion models

Fusion models

Fusion models

Network based

Fusion models

Models classification

Elmenreich

Architecture: Meta, Algorithmic, Conceptual, Logical and Execution Centralized - Decentralized Local Global Modular Monolithic Heterarchical - Hierarchical

Techniques

Classification

Overview

Fuzzy Logic Support Algorithms

Selection

Techniques

Classified by

JDL levels

Techniques

Classified by

Techniques

Classified by

JDL levels

Type of method

Techniques

Classified by

Techniques

Classified by

JDL levels

Type of method Fusion problems

Data Association Estimation Identity declaration Decision-level identity fusion

Techniques

Kalman Filter

Assumed noise

Techniques

Inertia System:

Good high frequency information Drift at a slow rate

Good data at low frequency, on the average High frequency noise

The Kalman Filter approach is instead to use the statistical characteristics of the errors in both the external information and the inertial components to determine this optimal combination of information. Actually, the filter statistically minimizes the errors in the estimates of the navigation parameters: on an ensemble average basis, no other means of combining the data will outperform it, assuming the internal model in the filter is adequate.

Techniques

Direct implementation

Indirect feedforward

Erros in the inertial must remain of small magnitude

Indirect feedback

Techniques

Probabilistic Inference

Bayesian Inference

It can be used to discriminate between conflicting hypotheses Initial beliefs are needed before any evidence is ever collected Sensor fusion:

Techniques

Probabilistic Inference

Bayesian Networks

Probabilistic graphical model that represents a set of variables and their probabilistic interdependencies

Algorithms to perform inference and learning

Extension of Bayesian networks that allows the representation of temporal information Signals

Model for Markov process: a stochastic process in which the probability distribution of the current state is conditionally independent of the path of past states

Techniques

Probabilistic Inference

Dempster-Shafer Theory

Generalization of Bayesian Theory: Instead of requiring probabilities for each question, belief functions are used.

Two ideas:

Obtain degrees of belief for one question from subjective probabilities fora related question. Use Dempster's rule for combining these degrees of belief:

Sensor1 m1(u0) Sensor2 m2(u0)

m(u0)=m1(u0)m2(u0)

Techniques

Probabilistic Inference

Dempster-Shafer Theory

Generalization of Bayesian Theory: Instead of requiring probabilities for each question, belief functions are used. Two ideas: Obtain degrees of belief for one question from

subjective probabilities fora related question. Use Dempster's rule for combining these degrees of belief:

Sensor1 m1(u0) Sensor2 m2(u2)

m(u0)=m1(u0)m2(u2)

Techniques

Probabilistic Inference

Dempster-Shafer Theory

Generalization of Bayesian Theory: Instead of requiring probabilities for each question, belief functions are used. Two ideas: Obtain degrees of belief for one question from

subjective probabilities fora related question. Use Dempster's rule for combining these degrees of belief:

Sensor1 m1(u0) Sensor2 m2(u1)

Dempster's rule

Techniques

Probabilistic Inference

Unifies the Bayesian theory with the D-S, combining their advantages and avoiding their disadvantages Each sensor collects evidence and assigns the evidence via probability masses; unlike D-S, GEP assigns and combines probability masses based on the a priori conditional probability of the hypotheses.

Techniques

They can learn a complex relationship between inputs and outputs, normally established by the unit weights

Learning:

Units' weights Backpropagation algorithm Network structure

Techniques

Neurons can be trained to represent sensory information and, through associative recall, complex combinations of the neurons can be activated in response to different sensory stimuli.

The main advantage of neural networks for multisensor fusion is that there is no need of a model for the sensors or the uncertainties

Techniques

Fuzzy Logic

Elements have degrees of membership to the different sets, differing from classical set theory, where elements belong or do not belong to a certain set. Rules: IF antecedent THEN consequence Operators: OR, AND and NOT Steps: Fuzzyfcation

Techniques

Fuzzy Logic

Uncertainty in multisensor fusion can be directly represented in the inference process by allowing each proposition to be assigned a degree of truth.

Input

Techniques

Support Algorithms

Library of basic numerical methods Database management Man-Machine Interaction Sensor Management

Techniques

Techniques Selection

Goals:

Maximum effectiveness: Algorithms should make inferences with maximum specificity in the presence of uncertain and missing data, dealing with minimal or no available a priori information. Operational constraints and time constraints must be considered. Resource efficiency in CPU and communications load. Operational flexibility to account for operational needs with changing a priori data. Functional growth.

Techniques

Techniques Selection

Steps:

1.Identifying categories of data-processing techniques or algorithms. 2.Surveying existing prototype and fielded data fusion systems. 3.Analyzing system requirements. 4.Analyzing and defining operational concepts for manual and automatic processes. 5.Identifying preliminary algorithms 6.Performing trade-off analyses of algorithm effectiveness versus required system resources. 7.Preparing detailed designs and prototypes of selected algorithms. 8.Refining and tuning the algorithms.

A collection of processing nodes, connected by communication links, in which none of the nodes has knowledge about the overall network topology.

Requirements

Scenarios

Advantages:

Reduction of overall uncertainty and increase of accuracy. New features in a scene can be perceived More timely information is available

Scenarios

Robot Navigation

Scenarios

Ambient Intelligence

Electronic environments that are sensitive and responsive to the presence of people. Characteristics:

Embedded

Context-aware

Personalized Adaptive Anticipatory

Scenarios

Augmented Reality

Integration of virtual content in a real environment in real time. Alignment between virtual content and real world

Accurate position

INS

GPS Ultrasound Vision-based

Scenarios

Augmented Reality

Conclusions

Most of definitions are restrictive to a certain terminology and applications A broader definition is needed to cover such a wide diversity of sensor fusion applications Wald's definition is chosen Discussion will continue

Conclusions

What models for multisensor data fusion exist in the literature? Do they have common descriptions? Do they contradict each other?

A common point in most of them is the need of divide the fusion process in levels of data abstraction.

Relationship between specification and usability Combine the underlying ideas for the final design.

Conclusions

Data fusion at different levels of abstraction implies the use of multiple techniques. A layout or scheme for the implementation of any kind of sensor fusion application is not feasible. The design of the fusion algorithms is a lengthy task where multiple fusion techniques can be combined.

Conclusions

The decentralized fashion has some advantages and some disadvantages comparing to the centralized one. The implementation of Distributed Data Fusion requires:

The use of certain fusion models that allow decentralization. Specific algorithms

Conclusions

Final conclusion

Multisensor Data Fusion is a broad issue due to the wide range of scenarios that it can be applied to. Therefore, to find a definition, a model or an algorithm scheme that is explicit, meaning that it can be followed to implement a real system, and at the same time usable for any kind of application, is an unfeasible task. Hence, a view of the different approaches, theories and implementations in the issue of sensor fusion can be presented, intending to be useful as a collection of different ideas that should be combined in the implementation of a real fusion system.

Andrs Navarro

- 1998 - Rethinking JDL Data Fusion LevelsUploaded byEmilio Martin Gallardo
- A Survey of Maneuvering Target Tracking_ DynamicsUploaded bymykingboody2156
- Design and Analysis of Modern Tracking SystemUploaded byHRC
- Kalman Dan SimonUploaded bydushtunini
- Data Fusion NotesUploaded byuslg
- Bayesian Approaches to Multi Sensor Data FusionUploaded byrakgosi
- An Introduction to the Kalman Filter (FULL VERSION)Uploaded bykasra_tm
- Tracking and Data Fusion ApplicationsUploaded bynekizajob
- Multisensors Fusion and integrationUploaded byapi-19989949
- Multi Sensor Fusion and IntegrationUploaded byRuchi Singh Raghuvanshi
- Tracking and Kalman Filtering Made EasyUploaded byKiran Ali
- 10.1.1.207.351.pdfUploaded byYoke Ching
- kalman filterUploaded byerdemhayir
- Papers Not FoundUploaded byIvan Miguel Serrano Pires
- Advances in Multi-Sensor Data Fusion- Algorithms and ApplicationsUploaded byPankaj Pratap Singh
- GMTI and IMINT data fusion for multiple target tracking and classificationUploaded byAnonymous 0U9j6BLllB
- Lecture 5Uploaded byJung Yoon Song
- Ict349 Ict649 Topic 04Uploaded byjacklee1918
- TAM ThesisInfo 2012-04-04 AyseTosunMisirliUploaded bysro1990
- 3impUploaded bysuchi87
- 193228Uploaded byMoldovan Alina
- 10.1.1.378.8719.pdfUploaded byDjamel Taibi
- A Novel Solution for Maze Traversal Problems Using Artificial Neural NetworksUploaded byOscar Groenewold
- Multisensor Data Fusion Based Autonomous MobileUploaded byInternational Journal of Research in Engineering and Technology
- 1-15 p18 Sensor Fusion is on the Agenda ZeltwangerUploaded byRudresh Rakesh
- Ole Rummel 4 Feb State Space Models and the KF ErciseUploaded byBrian Gorst
- Evaluations of Evidence Combination Rules in Terms of Statistical Sensitivity and DivergenceUploaded byDon Hass
- DWDM BitsUploaded byjyothibellary2754
- IJEAS0211035Uploaded byerpublication
- Multiple Object Detection and Tracking in Dynamic Environment using Real Time VideoUploaded byEditor IJTSRD

- 011238_Ielts SureSuccess Band 7+Uploaded byramalakshmi_r
- PTEG_ScoreGuideUploaded byMrJuice007
- upsc-prelims-2015-solved-paperII.pdfUploaded byramalakshmi_r
- AC DRIVESUploaded byramalakshmi_r
- HEYDT TutorialUploaded bymehtah
- Types of Harmonic FiltersUploaded byAdeline Winster
- Linear Induction MotorUploaded byramalakshmi_r
- cen & decen algthmUploaded byramalakshmi_r

- Module 6 Analysis of VarianceUploaded byLao Mjie
- Chapter 15Uploaded byUdevir Singh
- Wilcoxon Mann Whitney or t TestUploaded byRodrigo Chang
- Sensitivity and SpecificityUploaded byPrisia Anantama
- Chapter 18Uploaded byCassie Desilva
- Exercise Simple Linear RegressionUploaded byIşık Demeti
- RegressionUploaded byRiskaa Pricilia
- lutfi anwar 0910440287Uploaded byLutfi Anwar
- infodatin tuberkulosis 2018Uploaded byVzhall El-Bryan
- 20101229Uploaded bykeyka89
- idk tugas hani.docUploaded byRifqi Afriandy
- Assignment ProblemsUploaded byAhamed Wasil
- ch16Uploaded byAbdul Taiyab
- many way of serial correlation checkingUploaded bysaeed meo
- logitUploaded byVijetha Nuthakki
- Doc AddendumUploaded byskkundor
- Methods for Estimating Regression Discontinuity Design With Multiple Assignment Variables a Comparative Study of 3 Estimation MethodsUploaded byEskender Girmay
- Mult RegressionUploaded byiabureid7460
- Persson and Ryden - Exponentiated Gumbel distribution for estimation of return levels of significant wave height - 2010.pdfUploaded byAnonymous p9SPc84
- Unequal Number ObservationsUploaded byJosé Ojeda López
- Stat 115 - Basic Statistical MethodsUploaded byaramafe
- Advances in Neural Information Processing SystemsUploaded byAdi Nouashcinci
- REG3_LOGUploaded byAlruAlmu Bandar
- consistentsamplevariance.pdfUploaded bySeungho Lee
- ECON 762 Lecture NotesUploaded byAnonymous PRFZyG
- betareg.pdfUploaded byluli_kbrera
- Detection of HeteroscadasticityUploaded byIshanDogra
- Profile likelihoodUploaded byAnonymous Y2ibaULes1
- DAta MIRAUploaded byMuhammad Mubarak Chadyka Putra
- StatisticsUploaded bySANIUL ISLAM