FINAL YEAR

PROJECT PROPOSAL

“AUTOMATED ACTIVITY
RECOGNITION USING SMART PHONE
CAMERAS”

SUPERVISED BY: Dr. Humaira Ashraf

humaira.ashraf@iiu.edu.pk

SUBMITTED BY: Memoona Sadaf (3071-FBAS/BSCS/F15A)

Palwisha Amjad (3128-FBAS/BSCS/F15A)

DATE OF SUBMISSION: 19th-November-2018

EMAIL ADDRESSES: memoonasadaf29@gmail.com

palwisha50@gmail.com

Department of Computer Science

1|Page
 Faculty of Basic and Applied Sciences
International Islamic University, H10, Islamabad

CONTENTS
1 Introduction .................................................................................................................................... 3
2 Existing system ................................................................................................................................ 3
3 Problem statement ......................................................................................................................... 3
4 Proposed Solution ........................................................................................................................... 3
4.1 STEP 1: Data Acquisition ........................................................................................................ 4
4.2 STEP 2: Data Pre-processing…………………………………………………………………………………….………..3

4.3 STEP 3: Feature extraction ..................................................................................................... 4

4.4 STEP 4: Event Recognition...................................................................................................... 4
4.5 STEP 5: Experimentation and Model Testing ......................................................................... 4
5 Tools and technologies ................................................................................................................... 4
6 Deliverables..................................................................................................................................... 5

2|Page
1 INTRODUCTION
The optical satellite in geostationary orbit (GEO) is a new generation of Earth observation
satellite which has become a hot spot of research in recent years. The GEO satellite can
greatly improve the temporal resolution and coverage and achieve continuous, nearly real-
time, long-term surveillance of an area and get more dynamic information than traditional
satellites. At present, China’s GaoFen-4 (GF-4) satellite, launched on 31 December 2015, has
the highest spatial resolution in GEO in the world. A panchromatic multispectral sensor
(PMS) is on board the GF-4 satellite, providing images at a spatial resolution (50 m) and
wide coverage (500 km). GF-4, almost like a video camera, has high responsiveness and
high-revisit observation capabilities.
The spatial resolution of 50 m seems much lower compared with the high-resolution (≤5 m)
satellites in low Earth orbit (LEO), but it’s good enough to track large-size ships in near real
time from space. The image sequences of such GEO satellites can be used to obtain the
motion information about ships, which can assist the decision-making, guide high-resolution
LEO satellites for further observation and identification, and so on. In this article, we focus
on the low-resolution GEO satellites such as GF-4 to demonstrate the capability of ship
tracking for marine surveillance with the help of this type of satellites. So far, motion
detection and estimation from remote-sensing images have been studied in many published
articles.

2 EXISTING SYSTEM
A single image from Quick Bird, WorldView-2, etc., has been successfully used to extract
information about moving vehicles, which is based on that there is a time lag between the
acquisition times of panchromatic (Pan) and multispectral (MS) images on the same high-
resolution platform generally, making it possible to detect the motion of targets. However,
there are big spectral differences between spectrally neighbouring bands, and the capability
of target detection is different in different bands, so we cannot guarantee that the target can
be detected in all bands.

3 PROBLEM STATEMENT
use the time-series images for ship tracking in the article. There are two ships moving in
opposite directions in five image chips of GF-4 (size: 128 × 128, revisit interval: 186 s) in the
near infrared (NIR) band sequentially, and basic information about two ships is shown in the
right of this figure. In such sequential images of the low-resolution GEO satellite, a ship
generally has a few pixels and little feature information, which can be regarded as a weak
point target in the complex sea background. Compared with traditional video sequences, the
imaging interval of the GEO satellite is long, from tens of seconds to a few minutes per
frame. At the same time, due to the long distance away from the Earth, a small attitude
control error of the GEO platform will cause a large position bias between the target
corresponding to pixel point and image position.

3|Page
4 PROPOSED SOLUTION
The overall frame consists of the following steps:

4.1 STEP 1: DATA ACQUISITION

GeoFen-4 (GF-4) satellite images will be used as a dataset. We will use time series images for ship
tracking.

4.2 STEP 2: DATA PRE-PROCESSING

This step will be essential to address blur, sharpening, smoothing, noise reduction and edge
enhancement etc.

4.3 STEP 3: FEATURE EXTRACTION

The detection method focuses on the sea–land segmentation and feature extraction, mainly
based on histogram statistics, significance detection, feature description, deep learning, and
other methods. Among them, the application of deep learning makes ship detection really
practical, but it may not be suitable for low-resolution images. Some of the possible features
include: colour, edges, something, sharpening and blur.

4.4 STEP4: EVENT RECOGNITION

A novel modelling of a ship in geographic coordinate is utilized in MHT tracking, which is

used to further reduce false targets and estimate the motion information. The tracking
algorithm can meet the demand for continuous monitoring and tracking of ships with a strong
engineering application value, and it can further be used for data fusion with high-resolution
imaging satellites and other detailed identification satellites in LEO. However, we can
recognize that there is still potential for improvement in ship detection and the geo-location
accuracy. Any improvement in reducing the false alarm and position error can increase the
accuracy of tracking. At the same time, it also needs to improve the tracking performance in
more complex scenes by using limited characteristics of ships. Those will be the focus of our
future research.

4.5 STEP 5: EXPERIMENTATION AND MODEL TESTING

After training, we’ll test our model by taking one third part of dataset. Testing result will be
calculated depends on different conditions of algorithms. With testing we will analyse our
model and according to it, performance can also be increased.

5 TOOLS AND TECHNOLOGIES

 MATLAB

4|Page
6 DELIVERABLES
 Project Proposal Document
 User Interface
 Requirement Analysis Document
 Design Document
 Testing
 Deployment

5|Page