WEBGRABBER

Presented By
Dhishna Devadas S6 MCA Reg.No 138067 RIT,Kottayam

CONTENTS
About The Project Existing System Proposed System About The Organisation Hardware & Software Tools User Characteristics Module Descriptions Data Flow Diagram Entity Relationship Diagram Table Design Input & Output Design

About The Project

Web grabber allows easily browsing your website offline or to make your corporate site available on CD-ROM

Web Grabber aims to build a tool that collects both static and dynamic content from web pages Web Grabber empowers you to extract web content more efficiently , accurately Categorization of web pages and searching is done

Existing System
In Existing System no updating or navigation through links is possible. To download entire website, he should visit all pages. Disadvantages Links are not functional Cannot navigate through links Web site cannot be downloaded completely Only html view of saved file can be accessed offline Time Consuming

Proposed System
The new system is easy to incorporate changes. The website is downloaded completely through grabbing. The links are functional . The user can interact with the grabbed site at any time offline. The online cost can be reduced such that it is economically efficient.

Proposed System
Advantages
Save time and money Reduced operational cost The web site can be downloaded completely The links are functional User interface is simple and usable Performance optimization Grab website provides efficient updating and retrieval of the websites.

About The Organisation

Bessel InfoTech Solutions is a global provider of information technology services We provide our clients a range of services through the Enterprise and Education Division The Enterprise Division includes Business Software Application which offers a wide array of information technology services The Education & Training Division oversees the education and computer software training courses

Hardware Tools
Server Configuration Machine Processor speed Ram Hard Disk Client Configuration Machine Ram Hard Disk :Intel Pentium IV :2.4 GHZ :256 MB :40/80 GB :Intel Pentium III or Higher :128 MB :40 GB

Software Tools
Operating System Software platform JDK Front End Back End Web Server Editor Web Browser : Windows 98/XP : J2EE : Java Development Toolkit 1.6. : JSP : SQL Server 2005 : Apache Tomcat : Net Beans :MS IE 5.0 and above

User Characteristics
The various types of users in this system are Administrator General Users Administrator

Administrator is the super user and has complete control over all the activities that can be performed Administrator can have control over the processing renewal requests, creating categories, and sections in searching Administrator can validate user details and view the users grabbed information.

General Users The users have to register their details in the registration page The logged users have the option of viewing the grabbed site details, updating their profile, and grabbing a site, searching based on categories and changing the password .

Module Description
The system has Mainly 3 Modules 1)Registration 2)Grabbing 3)Searching

Data Flow Diagram

Level 0
Request Request

Administrator

Web Grabber System

User

Response

Response

Level 1

User Details
1. Registration

User Details User

Log name Log name Request to search User

2. Searching
Urls Grab details Search Urls

Category & Sections

Search

Category & section creation

Grab request Grab details 3. Grabbing Grab details Grab details Grab Details

User Details

Feedback details Feedback details

Feedback Administrator

Reports

Reports to view

4. Publish Reports

Level 2 for Grabbing

User

request to grab

2.1 Processing request

requesting details

Request details requesting details request date expiry date Administrator request to checks for expiry User 2.2 Expiry Checking expiry date expires Update details

success message
2.3 Assigning Permissions

expiry date doesn't expires

renew message

2.4 Renewing request

grabbing

grab details
Grab details 2.5 Grabbing site

Level 2 for Searching

Section Details 3.1 Section Creation Section Details

Administrator

Category details

Sections Section details

3.2 Categorization Request to search Category details

User
Search urls 3.3 Searching

Category

URLs

Entity Relationship Diagram

fname uid usernam e User url keyword M Searching M url requestid request date requests 1 grabid folder classifyid

M Grabbing M M

controls 1 Administrator

validates

user name

passwor d

Table Design
1) Table name : LOGIN Description : Login details of the administrator Structure :
FIELD NAME logname CONSTRAINT primary key DATA TYPE varchar DESCRIPTION username

pwd

varchar

password

status

varchar

status

2) Table name : USER REGISTRATION Description : Details of the user Structure:

FIELD NAME uid CONSTRAINT primary key DATA TYPE varchar DESCRIPTION User id

ufname

varchar

First name

ulname

varchar

Last name

FIELD NAME

CONSTRAINT

DATA TYPE

DESCRIPTION

uemail

varchar

Email id

uphone

integer

Phone number

utype

char

User type

uregdate

datetime

Registration date

uexpdate

datetime

Expiry date

FIELD NAME

2) Table name : USER REGISTRATION DescriptionForeign key of the user : Details uloginname nvarchar Structure:
ugender char udob datetime

CONSTRAINT

DATA TYPE

DESCRIPTION loginname

gender

Date of birth

uadress

nvarchar

address

3) Table name : GRAB DETAILS Description : Grabbing details Structure:

FIELD NAME CONSTRAINT DATA TYPE DESCRIPTION

grabid
logname url folder grabdate

primary key
foreign key

Integer
nvarchar nvarchar varchar datetime

Grab id
User login name URLs destinationfolder Grabbed date

4)

Table name : SEARCH SECTION

Description : Grabbing details

Structure:
FIELD NAME CONSTRAINT DATA TYPE DESCRIPTION

sectionid
head description

primary key

Integer
varchar varchar

section id
Search section name Section description

5)

Table name : SEARCH CATEGORY Description: Category Details Structure:

FIELD NAME

CONSTRAINT

DATA TYPE

DESCRIPTION

catid
Sectionid description link

primary key
foreign key

Integer
Integer nvarchar nvarchar

Category id
Section id descriptions Links added

6) Table name : PAYMENT DETAILS Description: Payment Details of user Structure:

FIELD NAME pid paytype payamt CONSTRAINT primary key DATA TYPE Integer nvarchar nvarchar DESCRIPTION Payment id Payment type Payment amount

plogname
paybank paybranch paydate

Foreign key

nvarchar
nvarchar nvarchar datetime

Login name
Payment Bank name Payment branch name Payment date

7) Table name : FEEDBACK DETAILS Description: Feedback Details Structure:

FIELD NAME
fid

CONSTRAINT
primary key

DATA TYPE
Integer

DESCRIPTION
feedback id

uname

Foriegnkey

varchar

User name

emailid

nvarchar

Email id

msg

nvarchar

message

8) Table name : RENEW DETAILS Description: Feedback Details Structure:

FIELD NAME CONSTRAINT DATA TYPE DESCRIPTION

rid
nutype nreqdate nexpdate paytype payamt plogname renewstatus

primary key

Integer
varchar datetime datetime nvarchar nvarchar

Renew id
usertype New request date New expiry date Payment type Payment amount Login name Renewal status

Foreign key

nvarchar nvarchar

 Home This is the home page

Input Design

Login Form This is the login form for Administrator

Section Creation Form This is the section creation form for Administrator

Category Creation Form This is the category creation form for Administrator

Login Form This is the login form for User

Register Form This is the registration form for User

Grab Form This is the grabbing form for User

Grab Process This is the grabbing process

Search Form This is the searching option for User

Output Design
Grab Details Report This is the report showing grab details

User Accept or Reject This report has the option to accept or reject the users

QUERIES??

THANK YOU.