Professional Documents
Culture Documents
T S Rajoo /
1 August 2018 Template V Vijayakumar F M Elhenawy Ali Muhannadi
M Kandiah
Signatures
Revision Status
Revision Date Amendment Document Owner Approval
20 June 2016 Draft V Vijayakumar ---
0 1 August 2016 Version 1 for Issue V Vijayakumar N Al-Yami
1 August 2018 Template V Vijayakumar Ali Muhannadi
TABLE OF CONTENTS
2. INTRODUCTION .............................................................................................................. 5
5. RESPONSE .................................................................................................................... 12
6. RECOVERY .................................................................................................................... 22
This Site Response Procedure has been written to هذا الموقع كتب للمساعدة بتحقيق ولالستجابة السريعة الالزمة
aid in the rapid response required by DNO&M to لتشغيل وصيانة الصرف الصحي عند حاالت الفشل التي تؤثر على
investigate and respond to failure situations that تشغيل محطة
have the potential to, or impact on the operation of
Pumping Station PS-44. The purpose of the PS-44
Procedure is to guide DNO&M and onsite staff in
الغرض من هذه اإلجراءات هذه هي إدارة
managing those situations and return service to a
الحالت والعودة الى العمل المعتاد
Business as Usual state as soon as possible. .بأسرع وقت ممكن
The Procedure outlines how to manage potentially
disruptive situations through a coordinated
approach based on defined triggers and escalating هذه اإلجراءات تحدد كيفية إدارة
actions allocated to individuals and teams. والتعامل مع اإلضرابات من خالل نهج منسق على
اساس تعريف وتصعيد االجراءات المخصص لألفراد
The Procedure provides flowcharts, response .والمجموعات
actions, maps and operational data to support
DNO&M and onsite staff to respond to and recover
from these unplanned situations and manage them
خرائط، اجراءات االستجابة،ويقدم هذا االجراء رسم تخطيطي
effectively if they do occur, escalating from Business وبيانات االزمة لتشغيل وصيانة الصرف الصحي ودعم فريق العمل
as Usual Alert/Investigation في الموقع ولالستجابة و التعافي من لهذه الحاالت الغير متوقعة و
Incident Emergency. -- متصاعدة من العمل كالمعتاد, ادارتها بطريقة فعالة اذا ما حدثت
تنبيه---
طارئ---------الحادث-------- التحقيق
2. INTRODUCTION
The Incident and Emergency Response Plan (IEMP) is the overarching Plan to guide DNO&M in managing
a significant business disruption, including but not limited to 22 different situations. Beneath the IEMP
reside a number of other Plans and Procedures that guide response for specific situations which require
greater detail. These include the asset-specific Contingency Plans (including the Pump Stations
Contingency Plan), the Rainy Season Work Procedure, Site Response Procedures (such as this document)
and Standard Operating Procedures.
The Pump Stations Contingency Plan classifies PS-44 as a critical pump station. A critical pump station is
one which has a high consequence of failure, has limited bypass or isolation capability, and may be difficult
or expensive to repair. Failure of a critical pump station such as PS-44 could result in adverse impacts to
communities and assets due to resultant flooding and inundation of areas by foul, surface or ground
water.
The Site Response Procedure has been written with input of DNO&M personnel to aid in the response
required by DNO&M to control and mitigate the impacts caused by failure at PS-44. The primary objective
of this procedure is to provide detailed site level information to assist DNO&M in maintaining required
levels of service to customers through appropriate management of Incident and Emergency situations,
effective stakeholder communication, rapid reinstatement of asset operations and minimised health and
environmental impacts.
The Procedure describes how to escalate issues or abnormal situations at PS-44 from:
a Business-as-Usual scenario, to
an Investigation, to
an Incident, and finally to
an Emergency which could escalate to Pump Station failure.
The Procedure also identifies specific failure modes at PS-44, provides detailed on-site actions for each
failure mode under each Alarm Level, identifies specific on-site and off-site roles and responsibilities
during a disruptive situation or event, provides relevant asset operational data, location maps and contact
information, and outlines recovery actions that need to be taken to reinstate the facility to Business As
Usual in an acceptable time period.
The Procedure comprises of the following sections and is supported by two Appendices:
Section 1 - A Brief overview of the purpose of this Procedure and its use;
Section 2 - An introduction and outline of the overall Procedure including alerting the reader to adjacent
Contingency Plans;
Section 3 - A description of Pump Station PS-44 including outcomes from risk assessment;
Section 4 - Information on situation escalation and notification;
Section 5 - Incident and Emergency response actions for different failure situations;
Section 6 - Recovery actions after a potential failure situation;
Pumping Station PS-44 is a forwarding station to Doha South STW and handles foul sewer for major
portion of the Doha /Abu Hamour area. This station is deemed a critical pumping station as per the
Pumping Stations Contingency Plan and is classified as a Group 1 station managed in house by the
Pumping Stations section within DNO&M (unlike other groups which are managed by Framework
Contractors).
Under the Qatar Integrated Drainage Master Plan (QIDMP) it was initially planned to shut down PS-44 by
2020 under the IDRIS project. This decision was later changed and it was decided to keep the station to
allow for flexibility in flow diversion to Doha West STW and to reduce the load on the Doha South STW
and for future flow diversion from New Doha South to Doha West.
This pumping station has 5 upstream forwarding smaller pumping stations which adds to the quantity of
flow to the underground network system to be collected and forwarded by PS-44. These stations are: PS-
20/1, PS-20/2, PS-21/1, PS-28 and PS-44 A. The schematic diagram below (Figure 3.1) shows the flows
from feeding stations coming into PS-44, which is then forwarded on to the Doha South STW. The locations
of the PS-44 catchment boundary and its feeding stations are shown in Appendix B.
Figure 3.1
PS-44 Schematic
This pumping station has been configured to six dry installation pumps with two rising mains. Two of the
pumps are on duty, two pumps on assist and two on standby. The station has an operational capacity of
91,500 m3 per day with an average daily flow of 60,000 m3 per day. Further operational data for PS-44
and its feeding stations are provided in Appendix B.
The diagram below (Figure 3.2) shows a layout of the pump station including the key assets at the station.
Failure of any of these assets could impact the normal operation of the pumping station. A more detailed
station layout map is provided in Appendix B.
Figure 3.2
PS-44 Layout and Key Assets
There is no bypass arrangement at the station (as at August 2016). Temporary bypass by overpumping
can be arranged by the Workshop Section. Internal bypass as a partial permanent solution through one of
the rising mains has been recommended. There is also a proposal for a permanent rising main to connect
PS-32 and Doha West STW. This is currently under feasibility study by the Infrastructure Affairs Design
Department.
Like many utility organisations worldwide, DNO&M is in the process of improving its asset management
through implementing an Enterprise Asset Management System (EAMS). The EAMS will assist in the
management of Pump Stations by providing a repository of Pump Station asset and operation data
including condition grade data that will be analysed for optimisation of operations and maintenance.
Appendix B provides operational data and layout maps for the pump station which in future will also reside
within EAMS.
It is important to be mindful about the inherent risks within the facility, so that appropriate contingencies
can be planned and implemented to reduce the likelihood or consequences of such risks.
A detailed risk assessment of PS-44 assets and operations was undertaken in early 2016 to
a. understand vulnerable areas that can potentially fail within the station considering the current
control measures, and
b. identify additional risk mitigation actions so as to reduce the likelihood or impact of any identified
risks.
The results of the PS-44 risk assessment were recorded in a risk register, a copy of which is located on
the Intranet.
Major works
a. Portable over-pumping connection required at this station urgently due to limited redundancy
provisions available
O&M works
a. Install two diesel pumps (100 litres/sec flow each) at PS-21 New as redundancy to enable diversion
to PS-13 New in case of failure at PS-44
3.2.2 Medium to Long Term Recommendations (require further analysis by Asset Management)
Major works
a. Construction of permanent overpumping connection to rising main (internal bypass system)
b. Construction of additional pressure main (PS-44 -> PS-32 Old and / or PS-44 -> Doha South)
c. Refurbishment of PS-21 New and upgrading the diversion to PS-13 New (-> PS-32 -> Doha West)
d. Construct permanent diversion via PS-20 -> Doha South
e. Construct permanent diversion from PS-44 A -> Doha South
f. Install dry submersible pump
O&M works
b. SOP to control feeding stations
c. SOP to implement network diversion
d. Emergency simulation exercises
e. Monitoring power consumption
f. Continuous monitoring, maintenance and overhauling, upgrade where required
g. Reliability Centered Maintenance programme
h. Wet well cleaning programme
i. Flowmeter installation and calibration
j. Operational levels in wet well and network to be as per QND
k. Modified fire protection for control panel
l. Fire Tracing system
m. Change to Woqod refuelling regulation
n. Corrosion assessment surveys
The above recommendations will form part of the asset investment management planning process for
this pumping station.
•Level 1 Alarm
•A planned investigation into a Pump Station operational abnormality
Investigation •An Investigation could escalate to an Incident
•Level 2 Alarm
•Any unplanned reduction in Total Pump Station Capacity (TPSC)
Incident •An Incident could escalate to an Emergency
•Level 3 Alarm
•A situation where there is an unplanned reduction in TPSC below 105% AND available
pumps operating above 80% of remaining operational capacity
Emergency •An Emergency could escalate to a Failure
Figure 4.1
Alarm Level Escalation for Pump Station Failure
The above framework clearly differentiates for Pump Stations what represents an Incident and what
represents an Emergency and both reference an unplanned reduction in Total Pump Station Capacity
(TPSC), which is the trigger for a step up to a Level 2 Alarm.
The framework provides a mechanism for DNO&M personnel to understand, at any time, the Alarm Level
status of the Pump Station, and this can eventually be represented for all Pump Stations through GIS
mapping via EAMS. This improves transparency of asset status and of the dynamic risk inherent in a
complex operational system such as the Ashghal drainage network. The Alarm Level Escalation flowchart
is presented in the Pumping Stations Contingency Plan, along with additional response flowcharts.
Based on observations at site or SCADA observations, staff should notify relevant senior staff of emerging
situations so that an appropriate response can be taken and the Alarm Level escalated as required.
Typically, for a Level 1 Alarm (Investigation), a Site Foreman or the SCADA Team would notify the Area
Engineer regarding an observed operational abnormality at PS-44, including if escalation is likely. For a
Level 2 Alarm (Incident), the Site Foreman or the SCADA team would inform the Area Engineer who would
Rev: 1 Date: August 2018 Ref: TEMPLATE Page 9 of 38
UNCONTROLLED IF COPIED OR PRINTED Contingency Plan – Package Treatment
Plants v1 Page ii 25 May 20
Public Works Authority
Drainage Networks Operations and Maintenance
State of Qatar
in turn notify the PS HoS regarding the Incident, including if escalation is likely. For a Level 3 Alarm
(Emergency), the PS HoS would inform MDOM, Networks HoS and Engineering HoS. MDOM would inform
the Asset Affairs Director and the President about the situation and provide regular status updates.
Communications in all instances could be by any means, including phone, instant messaging, or radio and
confirmed by email. For every event, appropriate records need to be maintained by the Area Engineer
about when Alarm Level notifications were issued and when escalation or de-escalation of Alarm Levels
were undertaken.
Although the Alarm Level Escalation Process shows escalation from Alert to Emergency, at the operational
level an event may originate at any point in the process.
The diagram in the following page provides the Alarm Level Escalation triggers for the following pumping
station failure modes.
Penstock Failure
High Flow Situation
Pump Failure
Rising Main Failure
Power Failure
External Flooding Situation
Fire or Explosion
Earthquake
Malicious Threat/Action
Depending on the intensity of the event or failure mode, the site staff and Area Engineer in consultation
with the PS HoS can use this framework to escalate the situation on site, so that appropriate response
actions can be taken as outlined in Section 5.
Figure 4.2
Alarm Level Escalation for PS Failure Modes
5. RESPONSE
For generic site response actions, please refer to the Pumping Stations Contingency Plan.
The following site specific failure modes have been considered in this Procedure
Penstock Failure
High Flow Situation
Pump Failure
Rising Main Failure
Power Failure
External Flooding Situation
For the above failure modes, site specific response actions for each Alarm Level are described below.
These site response actions are not prescriptive and should only be used as a guide. There may be
additional actions that need to be taken on site in order to effectively manage a particular failure situation.
All actions mentioned here should be discussed with the Incident or Emergency Manager before being
implemented and should be used in conjunction with the O&M Manual, SOPs, pump station schematics
and general repair procedures.
BUSINESS AS USUAL
1. Observer notes and reports potential abnormality in penstock operation (e.g. Site Foreman, Area Engineer,
SCADA).
2. AE / SF to carry out investigation if there is abnormality in penstock operation.
BUSINESS AS USUAL
High Level – 4.80 metres
High High Level – 5.50 metres
1. Observer (e.g. Site Foreman, Area Engineer, SCADA) monitors wet well level levels at pump station; notifies SF
of any abnormality in wet well levels.
2. AE / SF to carry out investigation if wet well levels are abnormally fluctuating or exceed “High Level”.
*Four hours storage time during night and 1.5 hours storage time during day is available before flooding happens. All redundancy provisions
and / or repairs must be implemented within this time.
BUSINESS AS USUAL
1. Observer notes and reports potential pump failure (e.g. Site Foreman, Area Engineer, SCADA)
2. AE / SF to carry out investigation if there is any abnormality in pump operation with no loss of pump station
capacity.
* Four hours storage time during night and 1.5 hours storage time during day is available before flooding happens. All redundancy provisions
and / or repairs must be implemented within this time.
BUSINESS AS USUAL
1. Observer (e.g. Site Foreman, Area Engineer, SCADA) notes and reports rising main operational abnormality.
2. AE / SF to carry out investigation if there is a minor leak or pressure loss in any rising main.
* Four hours storage time during night and 1.5 hours storage time during day is available before flooding happens. All redundancy provisions
and / or repairs must be implemented within this time.
Rev: 1 Date: August 2018 Ref: TEMPLATE Page 16 of 38
UNCONTROLLED IF COPIED OR PRINTED Contingency Plan – Package
Treatment Plants v1
Public Works Authority
Drainage Networks Operations and Maintenance
State of Qatar
* Four hours storage time during night and 1.5 hours storage time during day is available before flooding happens. All redundancy provisions
and / or repairs must be implemented within this time.
BUSINESS AS USUAL
1. Observer notes and reports potential flooding (e.g. public, Site Foreman, Area Engineer, SCADA).
2. AE / SF to carry out investigation if there is evidence of any flooding on site.
LEVEL 1 - ALARM INVESTIGATION
1. SF verifies report, records details and informs AE.
2. AE outlines investigation requirements and SF conducts investigation (which may include enhanced monitoring).
3. SF to locate and contain the flooding.
4. If the flooding is contained, then AE and SF to continue with routine monitoring and maintenance.
5. If the flooding inhibits access or PS operations, then escalate to Incident level.
LEVEL 2 - ALARM INCIDENT
1. If the flooding is within the PS and inhibits PS operations,
a. SF to investigate the reason for the flooding (rainfall, leaking or damaged pipe, sewer block, pump or
valve failure, rising main failure or collapse etc.)
b. SF to then work with the PS maintenance team to contain the flooding.
2. If the flooding is outside of the PS in the adjoining network and inhibits PS access, AE to immediately liaise with
Networks and Workshop departments to deploy suction tankers or arrange for overpumping to remove sewage
overflow and initiate clean up.
3. If the flooding is contained, then AE and SF continue with routine monitoring and maintenance.
4. If flooding or flood damage severely impacts PS operations, then escalate to an Emergency.
* Four hours storage time during night and 1.5 hours storage time during day is available before flooding happens. All redundancy provisions
and / or repairs must be implemented within this time.
a. Control feeding stations spare capacity (PS 28, PS 20/1, PS 20/2, PS 21/1, PS 44A)
5.2.2 Overpumping
a. Request for pumps and / or tankers to be send to the low points on the PS-44 network.
Based on GIS and historical data, the low points on the PS-44 network could be any of the following,
but these need to be confirmed.
Near PS-44 Station boundary (see Figure 5.1)
Near PS 21-New Station (see Figure 5.2)
Near Cambridge School, Al Maamoura
Behind Dar Al Salam Mall
b. Divert flow via SGW network to PS SW5 only as a measure of last resort to avert a crisis situation and
if nothing else works (refer to “PS 44 Site Layout Map” in Appendix B).
Figure 5.1
Low Network Points – Near PS 44 Station Boundary
Figure 5.2
Low Network Point – Near PS 21 New
6. RECOVERY
Recovery is often viewed as the final phase of Emergency management, following Planning, Preparedness
and Response. Recovery activities focus on restoration of service, assets and activities back to Business As
Usual practice. Backup systems are generally not intended for long term use, so once engaged a pathway
and timeframe should be agreed to restore full normal operations and retire any backup or temporary
measures used to manage the situation. These should be returned, where appropriate, to standby mode.
Clean up of any flood areas, should be prioritized on the basis of minimizing impacts to human health,
particularly exposure of the public to foul water.
For an Emergency situation involving the possible loss of the Pump Station or damage to reputation, the
KAT will play a key role in recommending to the EM who in turn will inform site staff actions to promote
recovery and appropriate sequencing. Procedures in the PS-44 O&M Operating Manual should be adhered
to for recharging pumps and rising mains. The EM or KAT, prior to demobilization of their roles, may
recommend follow up monitoring during and after the repair process to aid in the detection of further
failures or to monitor the effectiveness of any interventions. Such monitoring may include additional
instrumentation and/or asset inspections.
Post event, the following immediate site recovery actions are recommended:
• Area Engineer to liaise with Municipality, Networks and / or Workshop sections to deploy pumps
/ suction tankers to remove sewage overflow and initiate clean up;
• Site Foreman to regularly monitor the facility, assets and / or equipment to make sure that they
have reached normal operating conditions;
• Site Foremen to physically check water levels at PS-44 catchment pump stations to ensure that
they have reached normal operating level;
• SCADA to remotely monitor the upstream stations to ensure that normal operating conditions are
maintained;
• Release any emergency equipment or tools (e.g. tankers, emergency pumps etc.)
Management
Director of Asset Affairs
Ahmed Mohamed Sharif 4452 7222 5503 7555
Drainage Operations and Maintenance Manager
Khalid Al Obaidli 4452 7117 3333 8801
Drainage Operations and Maintenance Assistant Manager
Nasser Al Yami 4452 7171 5556 8559
Head of Pump Stations
External Stakeholders
Police, Fire Services & Emergency Services 999
Other
DNO&M Emergency Coordination Centre (ECC) 4452 4426 (phone)
Located at Asset Affairs depot, Wholesale Market Street 4452 4441 (fax)
1.3 Brief PS-44 is a forwarding station to Doha South STW and handles foul sewer for major
Description portion of the Doha /Abu Hamour area.
PS-44 has been configured to 6 dry installation pumps with two rising mains.
Rising Mains
No. 2 (each rising main connecting three pumps)
Material DI
Surge Tank Yes
Flow Meter Yes
Diameter 700 mm
Crossover chamber Yes
Flow through each rising main 500 litres / sec
20 March 2006
The control panel (MCC) caught fire and the whole MCC was damaged due to failure of
the capacitor. Temporary control panels were arranged to operate pumps.
2. PUMPS INFORMATION
2.1 Pump
Configuration
Schematic
Back Up Motor
Available on site: Yes, one spare.
4.3 Overflow Flooding at the lowest point on the network (near American School Doha)
Consequence
Spill into local surroundings; possibly affecting residential areas and compounds in the
Abu Hamour area.
5. BYPASS INFORMATION
There is also a proposal to connect PS-32 and DW STW which is under feasibility study by
IA Design Department
5.2 Provisions for Overpumping difficult due to the large size of the catchment
Temporary
Bypass
6. OTHER INFORMATION
6.2 Hazardous No
Substances on
Site
6.5 Screen One screen at inlet which is currently being replaced with new one
PS-20/1
Group Team A (Catchment 13)
Location Mamoura
Station Type Sewage / Submersible
Operational Capacity 20 l/s – 30 l/s (2015)
Average Daily Flow 531 m3 / d (2012)
Number of Pumps 2 pumps (1 duty, 1 assist)
Number of Rising Mains 1 (150 mm dia)
Safe Down Time (hours) 6 hours
Provision for diverting flow / bypass Yes - Overpumping connection
PS-20/2
Group Team A (Catchment 13)
Location JBK Villas
Station Type Sewage / Submersible
Operational Capacity 2,074 m3 / day (2012)
Average Daily Flow 297 m3 / day (Jul 2015)
Number of Pumps 2 pumps (1 duty, 1 assist) (16 l / s )
Number of Rising Mains 1 (150 mm dia)
Safe Down Time (hours) 12 hours
Provision for diverting flow / bypass Yes - Overpumping connection
PS-28
PS-21/1
Group Team A (Catchment 13)
Doha & Rayyan Sewage Scheme Al Ghanim Jadeed
Location
Area
Station Type Sewage / Submersible
Operational Capacity 1,728 m3 / day
Average Daily Flow 1,456 m3 / day
Number of Pumps 2 pumps (1 duty, 1 assist) (15 l/s)
Number of Rising Mains 1 (150 mm dia)
Safe Down Time (hours) 3 hours
Provision for diverting flow / bypass Yes - Overpumping connection
PS-44 A
Group Team B
Location Ain Khalid, near Safari Hypermarket
STREET 1114 ,PS-R1
BARWA CITY, ZONE 56, STREET 1114
Station Type Sewage / Submersible
Operational Capacity 20,049 m3 / d
Average Daily Flow 2,000 m3 / d
Number of Pumps 2 pumps (1 duty, 1 assist)
Number of Rising Mains 1
Safe Down Time (hours) 2 hours day, 3 hours night
Provision for diverting flow / bypass Yes - Overpumping connection