SESSION CODE: OFS304

Enterprise Search using FAST Search for SharePoint

Steve Letford SharePoint Specialist Microsoft New Zealand Paul Kelly (FAST)

FAST University (October 11 15, 2010) Virtual Instructor Led Course FAST Search for SharePoint 2010
Search with SharePoint 2010 for IT Pros and Developers I (3 days)
Introduction Deployment & Scalability PowerShell for Search Connectors and BDC Search UI configurations Linguistics Relevancy & Ranking Federated Search Advanced Search Security

Search with SharePoint 2010 for IT Pros and Developers II (2 days)

Custom Connector Development Content Processing and Property Extraction Query API and Query Languages Implementation Examples

Normal Fee: USD 2,800 Early Registration Fee: USD 2,320 Early Registration Deadline: September 10, 2010
The FS4SP virtual training was delivered very well, and despite expecting audio/video issues I was pleasantly surprised when there were none. Attending the virtual training was very convenient and I found the instructor to be very knowledgeable with FS4SP.

Contact Anthony Chan Anthony.Chan@microsoft.com or Steve Letford Steven.Letford@microsoft.com Additional discounts maybe available to partners.
3

Michael Carey, Developer Dimension Data

Attended the Virtual Instructor Led Course for FAST Search for SharePoint in May 2010

Tweet a Nugget!
Tweet a nugget of info from a Tech Ed breakout session and go into the draw to win one of 10 Microsoft Arc keyboard and mouse prize packs!

Include #tenz and #nugget in your Tweet to enter!

Enter as many times as you like! See www.microsoft.co.nz/teched/terms for full terms and conditions.

Agenda
Why/When should I use FAST Install
Setup Configuration Design Scale

Processing pipeline Linguistics Relevance & Ranking Reporting & Analytics

5

Visual Cues
Thumbnails & Previews Visual Best Bets

Context-Based Results
Promote/Demote User Context

Property extraction
Prebuilt Custom/Extensibility

Extreme scale
in 3 dimensions at best footprint Query Expressiveness (FQL)
Relevance and sorting Symbol & proximity search

Exploration
Deep refiners Similarity Search Multilevel Sorting

Relevance Control
Multiple profiles Word/Term control

Content coverage
400+ document types 82 languages Advanced Linguistics Offensive content filter

Provide the best, most productive, user experience

Maximize productivity through control

Make the most of all your content

Tackle the most demanding search challenges

FAST Extends Capabilities of SharePoint Server

This is the out of the box SharePoint implementation
FAST builds on top of this

Content search
SharePoint Server

End Users

People search
Content + Profiles

FAST Extends Capabilities of SharePoint Server

Content search
FAST Search
for SharePoint

SharePoint Server

People search
Unique Social Search from SharePoint Server

Common developer experience and IT Pro Foundation

8

Install
Hardware requirements
Minimum: 4 GB RAM 4 CPU cores, 2.0GHz CPU 50 GB disk Recommended: 16 GB RAM 8 CPU cores, 2.0GHz CPU 1 TB disk space on RAID across 6 spindles or more

Install
Install SharePoint and Office Web Apps to enable thumbnail viewing Secure Sockets Layer (SSL) communication is required. Configure Claims.
HOW???

10

Create SSAs

11

Demo
FAST Content SSA FAST Query SSA

12

Design Agenda
Process flow Deployment Scalability

13

FAST Search for SharePoint

Administration and Schema Object Model

SharePoint Front-end Indexing Content Processing And Linguistics

Connectors:
- SharePoint - BDC - Exchange

Content

Content Connectors:
- Web Crawler - JDBC - Lotus Notes

Custom front-end

Query Web Service

Federation Object Model

Content

Index Index

14

FAST Search for SharePoint

Administration and Schema Object Model

SharePoint Front-end
Query Object Model

Security Access Module

Custom front-end

Query Web Service

Federation Object Model

Query and Result Processing

Search Search

OpenSearch or other Sources

People Search

Index Index ! !

15

FAST Search for SharePoint

Administration and Schema Object Model

SharePoint Front-end
Query Object Model

Security Access Module

Connectors: Indexing Content Processing And Linguistics

- SharePoint - BDC - Exchange

Content

Content Connectors:
- Web Crawler - JDBC - Lotus Notes

Custom front-end

Query Web Service

Federation Object Model

Query and Result Processing

Search

Content

Monitoring Services OpenSearch or other Sources

People Search

Microsoft System Center Operations Manager

! !

16

FAST Search for SharePoint Scale out

Scale-out in different dimensions Query Volume Content Volume Processing power Indexing freshness Redundancy options Search Indexing

17

Usability Demo
Thumbnails Refiners
Chart Sentiment Price

Keywords Phonetic search Visual best bets BDC Search

Profile page Associations

BI Search Connector
18

Refiner example

19

Content Pipeline Stages

Default
Format Conversion Language detection and encoding Lemmatizer Tokenizer Entity Extraction DateTimeNormalizer Vectorizer WebAnalyzer PropertiesMapper

Optional
XML Properties mapper Offensive Content Filter Verbatim extractor Loads dictionary for custom extraction, e.g product names

20

Demo
Extending the pipe line
Entities (companies, people, locations) Whole word extractions Code (Sentiment analysis)

21

Linguistics
Search - Art of balancing Recall & Precision
Entire Collection Missing = Poor Recall Junk= Poor Precision

Relevant Docs

Relevant Docs in Answer Set

Answer Set

22

Linguistics
User s Intent Refine
Extract Properties

What does the user really want to find

Precision

What exactly is the query

Linguistics Ranking
Add Relevant Meta Information

Recall Local Search

Cover variation

23

Linguistic Features
Language Identification Word breaking / tokenization Character normalization Stemming Keywords Anti-Phrasing Spell-Checking Offensive content filtering Phonetic Search
24

Demo
Spell Checking
Exceptions

Keywords
Synonyms, best bets etc

Stemming Offensive Content Filtering

25

Ranking
Managed Property Boosts Context Quality

Authority

Proximity

Query Authority Freshness

26

Demo
Rank Profile
Create a rank profile

Document promotions / demotions Site promotions / demotions Rank Log Analysis

27

Demo - Building a search GUI

FQL

28

Demo - Building a search UI

Search Centre Refiners Best bets etc

29

Reporting and Analytics

30

Monitoring and Alerting

Dedicated Management Pack in System Center Operations Manager 2007 Support of standard Windows monitoring services Detailed monitoring of state and performance at node level Extensive alerting options

31

Reporting Demo

32

SharePoint Search and FAST Search

SharePoint Server Search
Great core search experience Unique social search features Broad content reach including BDC Industrial strength platform Strong developer experience

+ +

FAST Search for SharePoint

Conversational and rich user experience Precise control of the user experience Enhanced content processing capabilities Deep platform flexibility and scale Highly configurable and extensible

Key Capabilities

Target Applications

OOB intranet + site search OOB people + expertise search Custom search verticals

High end (custom) search applications

Common Developer and IT Pro foundation

33

Related Content Monday Sessions

What s new in Office 2010 - and how do I deploy it? 11:50 - 12:50 Metadata and Taxonomy Management in SharePoint 2010 13:45 - 14:45 Self-Service Business Intelligence with Excel 2010 and PowerPivot 14:55 - 15:55 The new SharePoint based Digital Marketing Platform 16:15 - 17:15 The new world of SharePoint 2010 Architecture & Administration 17:25 - 18:25
34

Resources
Advanced search for IT Pros Script Repository FAST Search Server 2010 for SharePoint Capacity Planning Manage search topology (add/remove partition, add query component, etc.) FAST Search System/Protocol Overview Manage Certificates Protocols FAST University Training Portal Improving Relevance & Ranking FixML Installation
Software & Hardware requirements

35

 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.