Professional Documents
Culture Documents
ThereWillBeChange,ButIt'sStillKeywordDriven CanTheFutureOfSearchReallyBeBasedOnA 63YearOldIdea? CrawlingThroughtheChaos. Links,ClicksandCliques. TheTenBlueLinksMustDie:FromSEOtoDigital AssetOptimization(DAO). CollectiveIntelligence. ConnectedMarketing:GenerationY,TheAlwaysOn MobileGeneration. Blah,Blah,Blah,VeryNiceMike.ButSoWhat?
Tocopy,republish,topostonserversortoredistribute,requirespriorspecificpermission. Copyright2008AcronymMedia,Inc.Allrightsreserved.
Page|2
ThereWillBeChange,ButIt'sStill KeywordDriven.
Ihavebeeninvolvedinmediaandmarketingmyentirecareer:tenyearsinbroadcast(radio andTV)andtherestinmarketing,bothAgencyandClientside.Buttoday,astheGlobal KDMOfficerofAcronymMedia,Iveneverbeenmoreexcitedaboutthefutureof marketing. Why?Theanswerliesinanotherquestion,onethatencapsulatestheevolvingsearch marketinglandscape:wheredoesSearchEngineMarketinggonext? Iwrotemyfirstguidetosearchengineoptimization(orpositioning,asitwasknownthen)in 2000.IfinditremarkablethattheadviceIgavethenonhowtomakeawebsitecrawler friendlyandhowtogetqualitylinksforbetterindexingandrankingremainsprettymuch thesame. Googleisfailinginitsmissiontomaketheworld'sinformationuniversallyaccessibleby crawlingtheweb.Thisisntbecausethere'sanythingwrongwithGoogle;instead,its becausecrawlingwasaperfectlyacceptablewaytofindandindexwebpagesbackinthe ninetieswhenonlymillionsexisted.Today,GoogleitselfisawareofatrillionURLs,butit standsnochanceofcrawlingandindexingtheminatimelyfashion.Whatsmore,those trillionURLsdontevenrepresenttheentirewebit'sjustwhatGooglehasdiscoveredso far. Therehastobeabetterway. Inthesecondeditionofmybook,Istudiedinformationretrieval(IR)techniquesandhow theyappliedtowebsearch.Idoveintonetworktheoryandbecameabsorbedwithhow things(suchaswebpages)areconnectedandhowcommunitiesarecreated. Now,asIburnthemidnightoilscribblingawayatmynextbook(dueSpring2009),Irealize justhowpowerfulsocialnetworkanalysisisforthefutureofmarketing.Thewebisno longerjustacollectionofHTMLpageslinkedtogether.Itisanetworkofnetworksofpeople whoaretotallyconnectedtoeachother.Ibelieveit'stheunderstandingofthese connectionsthatwillshapenotjustsearch,butallofmarketing.Thenewbookwillbuild uponthethoughts,conceptsandideasoutlinedinthispaper. Ihavebeenaccused,attimes,ofhavingatootheoreticalapproachtoSearchEngine Optimization.However,asapractitionerIhavehelpedmanyClientsachievemajorvictories simplybybetterunderstandingthescienceofinformationretrievalontheweb.IRis interdisciplinary,withrootsincomputerscience,mathematics,libraryscience,information science,informationarchitecture,cognitivepsychology,linguistics,statisticsandphysics.All ofthisunderpinsthefreshnessandrelevanceofsearchengineresults.
Page|3
Networktheoryinparticularhaslongbeenappliedtolinkagedataontheweb.Itsinfluence isstillsignificanttoday,asthewebevolvesandincreasingnumbersofalwaysconnected targetgroupsemerge.Caseinpoint:AlgorithmssuchasHITSandGooglesPageRankare alreadybeingappliedandtestedinsocialnetworkingsites.Newsignalsareemanatingfrom theenduseratsearchengines,suchasquerychains,clickthroughdataandusertrails. Therefore,tappingintothewisdomofcrowdswillsurelybeavitalcomponentinthefuture ofsearch. Iamnotamathspecialist.Aswithmypreviousbooksandpapers,mygoalistotranslate theunderlyingcomplexitiesandmathematicsof searchintoasimpler,nonmathlanguage,assessing therelevanceofparticularmodelsastheyapplyto onlinemarketing. "A5inchlongrectanglewithalonglistoftextresults Ibelievethenextmajoradvancesinsearchmustbe ofthebillionsuponbillionsofunorganizedbitsofdata intheareaoflearningmachinesandartificial intheworld." intelligence.Searchenginesstartedwiththebare SusanDumais.PrincipalResearcher,Adaptive basicsofcomputertechnology,crawling,indexing Systems&InteractionGroup,MicrosoftResearch. andrankingHTMLpagesbasedonanendusers query.Significantimprovementswerethenrealized withGooglesdistributedcomputingacrossagrid andimplementationofnetworktheoryinitsPageRankalgorithm.Nowitstimeforsmarter programsandlearningmachinesandevennewprotocols. However,thekeywordisstillthecoreofmarketing,notjustsearch.Myfriendand colleagueAntonKonikoff,theFounderandCEOofAcronymMedia,hasdevelopeda frameworkknownquitesimplyasKeywordDrivenMarketing.Itembracestheideaofa keywordasaproxyforacustomer.Thisnotionisofprimarysignificance,asunderstanding anddecodinguserintentremainsattheheartofonlinemarketing,regardlessofthe changestakingplace. Trynottothinkaboutthisdocumentasawhitepaper;instead,useitasajumpingoffpoint fordiscussion.Thisdocumentisbasedonavision.Itanswersquestions,butalsoposesnew ones.Thiskindofdialogueishealthyandvaluableaswetrytothinkofcreativewaysto improveourClients'visibilityatsearchenginesandtheiroverallmarketingobjectives. Searchmarketinghasbeenbasedaroundatwentyyearoldprotocolthatwasnever intendedtobeacommercialmedium.Forsure,thewebtechnologygiantsarenowlooking atnewersignalsfromendusers.Butnow,maybe,theyshouldevenbeconsideringnew Internetplatformsandprotocols.
beneathitdoesn'tdomuchtohelppeoplemakesense
Let'sexplore.
Page|4
CanTheFutureOfSearchReallyBeBasedOn A63YearOldIdea?
Mendel'sconceptofthelawsofgeneticswaslosttotheworldfora generationbecausehispublicationdidnotreachthefewwhowere capableofgraspingandextendingit;andthissortofcatastropheis undoubtedlybeingrepeatedallaboutus,astrulysignificantattainments becomelostinthemassoftheinconsequential. TheabovepassagecomesdirectlyfromAsWeMayThink,theseminal essaybyAmericanengineerandinventorVannevarBush.Oneof America'smostsuccessfulscientistsleadinguptotheSecondWorldWar, Bushisalsoknownasthemanbehindtheatomicbomb. BytheendofWorldWarII,Bushquestionedwhatscientistscoulddo collectivelyasafollowuptotheirjointwork[making]strange destructivegadgets.Inhisessay,hearguedthatashumansturnedfrom war,scientificeffortsshouldshiftfromincreasingphysicalabilitiesto makingallcollectedhumanknowledgemoreaccessible. Hisideasoundsfamiliar,doesntit? Google'smissionistoorganizetheworld'sinformationandmakeituniversallyaccessible anduseful. Bushmademanypredictionsaboutfuturetechnology,includingthefaxmachine,personal computers,theInternet,World WideWebandspeechrecognition allverystartlingashewaslight yearsaheadofhistime.Butitwasa systemhecalled"memex"that probablymakeshimtheearliest hypertextthinker. Considerafuturedevicefor individualuse,whichisasortof mechanizedprivatefileandlibrary. Itneedsaname,andtocoinoneat random,"memex"willdo.Amemexisadeviceinwhichanindividualstoresallhisbooks, records,andcommunications,andwhichismechanizedsothatitmaybeconsultedwith exceedingspeedandflexibility.Itisanenlargedintimatesupplementtohismemory.
Page|5
Asyoureadtheentirepaper,yourealizejusthowthoughtprovokingandinspirationalitis. Bushdidn'tactuallybelievethatmachineswouldeverbeabletoemulatehumanmemory, buthewasconvincedthatmemexcouldaugmentthebrainbysuggestingandrecording usefulassociations. Thehumanmind...operatesbyassociation.Withoneiteminitsgrasp,itsnapsinstantlyto thenextthatissuggestedbytheassociationofthoughts,inaccordancewithsomeintricate weboftrailscarriedbythecellsofthebrain.Ithasothercharacteristics,ofcourse;trails thatarenotfrequentlyfollowedarepronetofade,itemsarenotfullypermanent,memoryis transitory. AlthoughBushwasatotally outoftheboxthinkerforhis time,hedidn'tgetquiteasfar asthepotentialofanewdigital medium.Buthisinnovative thinkingandvisionsparkeda newbreedofhypertext thinkers.
"Auserinterfaceshouldbesosimplethatabeginnerinanemergencycanunderstandit withintenseconds." NelsonfoundedProjectXanaduin1960withthegoalofcreatingacomputernetwork featuringasimpleuserinterface.Heclaimssomeaspectsofhisvisionarealreadybeing fulfilledbytheinventionoftheWorldWideWeb,butasawhole,hedislikesthewebwith allitsXMLandembeddedmarkup."HTMLispreciselywhatweweretryingtoprevent!"he oncefamouslysaid. Hypertext,andtheWorldWideWebasweknowit,hasitsrootsbackin1980.Butof course,somethingelsehadtohappenbeforeanyonecouldevenconceivetheideaofa WorldWideWeb:somebodyhadtoinventtheInternet. Yes,eventhoughthewordswebandInternetareusedinterchangeably,they'retwo entirelydifferentthings.You'reprobablythinking,welleveryoneknowsthat,"butyou'dbe surprised.
Page|6
It'snotnecessarytodiscusshoworwhytheInternetcameabout.Butitisimportantto understandthattheWorldWideWebismoreorlessanapplicationthatisdeliveredviathe Internet. Tobeclear,theInternetisaglobalsystemofinterconnectedcomputernetworksthat interchangedatabypacketswitchingusingthestandardizedInternetProtocolSuite (TCP/IP).Itisa"networkofnetworks." Itcarriesvariousinformationresourcesandservicessuchasemail,filesharingandonline gaming,amongotherthingsaswellastheinterlinkedhypertextdocumentsandother resourcesknownastheWorldWideWeb. Andwhosthe"fatheroftheInternet"?ThatdbeAmericancomputerscientistVintCerf. YoucanfindtonsofstuffabouthimontheWorldWideWeb.Andso,forthepurposeof movingforwardinthispaper,theInternethasnowbeeninvented. Let'snowskipforwardto1980andintroduce,forachange,an Englishcomputerscientist,TimBernersLee.NowSirTimBerners Lee(corankedfirstinthelistof100GreatestLivingGeniusesby TheDailyTelegraph)expandedupontheideasofearlierhypertext thinkersandproposedaprojectbasedonthesharingand updatingofinformationamongresearchers. BernersLeewasalsoafellowwithCERN(EuropeanOrganization forNuclearResearch).By1989hebecameawarethatCERNwas thelargestInternetnodeinEuropeandsawanopportunitytojoin hypertextwiththeInternet. "Ijusthadtotakethehypertextideaandconnectittothe TransmissionControlProtocolanddomainnamesystemideasand tada!theWorldWideWeb." Yes,that'showsimplyhedescribesaninventionthathasprofoundlyimpactedtheentire planet. ThefirstWebsitewasbuiltatCERNon6August1991.Itprovidedanexplanationabout whattheWorldWideWebwas,howonecouldownabrowserandhowtosetupaWeb server.Itwasalsotheworld'sfirstWebdirectory,asBernersLeemaintainedalistofother Websitesapartfromhisown.Andthat,perhaps,alsomakeshimthefounderofweb search. Butyouknowwhat?Thewebandwhatpeopleexpectfromithascomeaverylongway sincethen.
So,isthefutureofsearchreallystillbasedona63yearoldidea?
Page|7
CrawlingThroughtheChaos.
ThereisaprevailingassumptionaboutGoogle,thebeliefthatithasaccesstoallthe contentontheentireweb.Butthisnotionisnotcorrect. Tomanyendusers,Googleistheweb.Yet,mightyasitis,Googlecanonlyreturnresults fromthefractionofthewebithasmanagedtocrawl. Crawler,spider,botthey'reallinterchangeable termsforwhatsearchenginesusetofind,download andindexwebpages.That'swhattheywereinvented for:todownloadHTMLpages. However,they'realmostblindtonontextcontent. Andthevastamountofusergeneratedcontent,such asvideo,images,audioandotherfiletypes,arenot soeasilyhandledorindexed.Nevertheless,wekeep plugginginallkindsofalientothebrowserapps (Flash,forinstance),tryingtoturnbrowsersinto somethingtheywerenevermeanttobe.Asaresult, wevemadeitharderforsearchenginecrawlersto find,classifyandindexourstuff. Thesearchenginecrawleristhe"textbookSEO" favorite,butitfacesmanyimitations.Therearestrongfreshnessrequirementsandmultiple timescales.Tryingtodiscovertherelevanceofexistingpagesintheindexwhiledealingwith therapidarrivalrateofnewwebcontentisn'taneasytask,either. Theoverhead(averagenumberoffetchesrequiredtodiscoveronenewpage)needstobe kepttoaminimum.Bandwidthisalsoanissue:Itwouldn'tbepracticaltoattemptto downloadtheentirewebeveryday(andprobablynotevenpossible).Somesitesareso largethattheysimplycan'tbecrawledfrombeginningtoend,eveninthespaceofaweek. Infact,nocrawleriseverlikelytocrawltheentirereachableweb.Analmostinfinite numberofURLs,spidertraps,spamandallkindsofotherissuespreventit. Moreover,therewillalwaysbeatradeoffbetweenrecrawlingexistingpagesandcrawling anewpage.Afterall,inaconnectedworldwherebreakingnewsisofglobalconcern, searchenginesmustbeabletoprovidesuchinformationinnearrealtimetoavoidenduser dissonance. Newpagesareprimarilydiscoveredwhencreatedandlinkedtofromexistingindexed pages.Ofcourse,thisisalsowheretheFilthyLinkingRichdilemmaIwroteaboutsome yearsagocomesintoplay:websiteswithalargenumberoflinkscontinuallyattractmore
Page|8
linksthanthosewithonlyafew.Asaresult,moreoftheircontentisindexedandlinkedto, perhapsgivingthemanedgewhenitcomestoranking. There'salsothecaseofsearchenginesknowingaboutcertainwebpages,butnothaving yetcrawledthem.Afterall,billionsoflinksareextractedfrombillionsofpagesbyGoogle, meaningtheremustbesomeorderandpriorityastowhichgetcrawledfirst.Recently, GoogleannouncedthattheirlinkprocessingsystemshadhitthetrillionURLmark(but knowingURLsexistdoesn'tnecessarilymeantheywillgetcrawled).Plus,Googleestimates thatthenumberoflinksisgrowingbyseveralbillioneachday. Inaddition,theinvisibleWebstillexists.Millionsof pagesarelockedindatabasesorbehindpassword protectedareasthatcrawlersareblockedfrom.So whilesearchenginecrawlersarecertainlymuch smarternowthaninthewebsearlydays,theymay neverbeabletoprovideacompleteandtimely discoveryofwebcontent. Sowhatrealusewillthecrawlerserveinthe future?Maybeitllbeabackfillforothermethods ofinformationretrievalontheInternet?
TheintroductionofGoogle'sUniversalSearchsupportsthisassumptionandprovesthat methodsbeyondthecrawlarerequiredtoretrieverelevantinformationfromtheemerging structureoftheweb. Butcanthismethodofdatacapturewhichhasitsrootsbasedonatechnologythatcanbe tracedbackto1945beanywherenearasefficientasitwasintheearlydaysoftheweb? Usergeneratedcontentanalysis.Crosscontentanalysis.Communityanalysis.Aggregate analysis.Allofthesemustbetakenintoaccounttoprovidethemostrelevantresultsand richestenduserexperience. ThewebgrewtoobigfortheoriginalhumanpoweredYahoo!indextoscalewith.In response,theyadoptedthecrawling/rankingalgorithmseenatmostsearchenginesnow. Atthetime,itseemedliketheobviouswaytogo.Buttoday,asusergeneratedcontent rangingfromsocialnetworkingtoblogs,photosharingtovideositesgrowsexponentially, thecrawlerisslowlybeingdefeated. Isittimetoexplorenewwaysforsearchenginestobringtogethertheworld'sinformation? Absolutely. Howaboutnewprotocolsfordifferenttypesofsearchenginefeeds?Andwhatabout developingspecialrelationshipswithpublishersofusergeneratedcontent?
Changeiscoming.
Page|9
Links,ClicksandCliques.
There'sananecdoteItellatconferenceswhenI'mspeakingon linkageandconnectivitydata.It'sthestoryofhowforemost computerscientistJonKleinbergdiscoveredtheflawinsearch enginestryingtorankwebpagesbasedonthetextonthepage: Backin1997,whenAltaVistawasthedominantsearchengine, Kleinbergdidasearchforsearchengine.Hewastotally surprisedtolearnthatAltaVistadidn'tappearinitsownresults. HethentriedaninformationalqueryforJapaneseautomotive manufacturer.Hewasevenmoreastonishedtoobservethat manufacturerssuchasNissan,ToyotaandHondadidn'tappearat thetopoftheresults. KleinbergthenwentbacktotheAltaVistahomepageandrealized thewordssearchenginedidn'tappearanywhereonthepage.Similarly,tripstothe Nissan,ToyotaandHondahomepagesturnedupnosignofthephraseJapanese automotivemanufacturer. KleinbergsresearchandworkarethoroughlydiscussedinthefascinatingbookSixDegrees: TheScienceofaConnectedAge,writtenbyworldrenownedphysicistDuncanWatts.Watts andKleinbergcollaboratedondeterminingthenewscienceofaconnectedage,eventually leadingKleinbergtodevelopingthealgorithmknownasHITS,whichisbasedon connectivitydataandranksdocumentsonwhatareknownashubandauthorityscores(this occurredaroundthesametimeLarryPageandSergeyBrinweredevelopingGoogle's PageRankalgorithm). Inanutshell,Kleinberghelpedimprovethequalityofwebsearchbyapplyingsocialnetwork analysistothe rankingmechanism. Insteadofjudging pagequalitybythe textonthepage, focuswasshiftedto theoverallquality ofthepageslinking toit. Thisiswhythere hasbeensomuch emphasisonlink Page|10
buildingintheSEOcommunity.Butconsiderthis:Ifalinkisakindofvotefromoneweb pageauthortoanother(asGooglereferstoit),howdopeoplewithoutwebpagesvote(i.e. thehavesvs.thehavenots)? Afterall,it'snotreallydemocratictoinstantlyalienateafewhundredmillionWebusers (backthen)justbecausetheydidn'thavelinkstovotewith. It'sinterestingbecauseaboutfouryearsagoIspoketoawellknowninformationretrieval scientistabouthumanevaluationbeingfoldedintothealgorithm.WetalkedaboutYahoo's earlyrecognitionthatitcouldneverscaleitshumanpoweredindextomatchthe exponentialgrowthoftheweb. Imentionedthattherehadtobeaddedvalueknowingthataneditorhadactuallyviewed yourwebpagesandindexedthem.HerespondedthatKleinbergshubsandauthorities algorithmdidjustthat,withthehubsitesfunctioningaseditors,pickingoutauthoritysites andessentiallyimprovingtheindexinamutuallyreinforcingway. Inasimilarmanner,thewisdomofcrowdsandthevoiceoftheenduserarenowsending hugesignalstosearchengines.Asbookmarking,taggingandratinggainpopularityand scalesup,sowillitsinfluenceonwhatappearsinthesearchengineresultspages(SERPs). Thestrongestsignalsarenow comingfromtheubiquitous searchenginetoolbar.Mining thesearchtrailsofsurfing crowdsandlookingatend useractivitydataprovides searchengineswithunique insightsthathelpidentifythe mostrelevantwebsites.
Infact,whereassearchhas traditionallybeenbasedaroundsignalsfromcontentcreators(text,linksetc.),itisnowvery muchbasedaroundmodelinguserbehavior.Searcherssubmitqueries,reformulatethem (querychains),clickonresultsandthennavigateawayfromthesearchengine. Thesearchresulttheyclickon,though,isnotalwaysthedestinationpage.Usersgenerally browsefarfromthesearchresults(anywhereuptofiveclicks)andvisitarangeofdomains duringtheirinformationsearch. Searchengineshavealwayshadaccesstoqueryandclickthroughlogsforimplicitenduser feedbackforrerankingdocuments.Butit'spostsearchbrowsingbehaviorwhichprovides valuableinformationondestinationsthataretrulyrelevanttotheusersinformationgoals. Endusersprovidehugeamountsofinformationabouttheresultstheypreferforagiven searchbyclickingononeresultandchoosingnottoclickonothers.Searchenginescanuse
Page|11
artificialneuralnetworkstochangetheorderingofthesearchresultstobetterreflectwhat usershaveactuallyclickedoninthepast. Whyaneuralnetworkasopposedtojustrememberingaqueryandthencountinghow manytimesaresultwasclicked?Thebeautyofaneuralnetworkisthatitcanmake reasonableguessesaboutresultsforqueriesithasneverseenbefore(basedontheir similaritytootherqueries).Thisissignificantasupto25%ofallqueriestosearchengines eachdayhaveneverbeenseenbefore. Thecollectiveintelligencewhichhaspreviouslybeenappliedtolinkagedataforranking documentscanalsobeappliedtoclicksandsearchtrails.Movingawayfromthelimitation ofsystemsthatfocuspurelyonqueriesanddocumentsismostcertainlyamajorshiftin informationretrievalonline.Therelationshipsbetweenqueriesanddocumentsandthe relationshipsbetweendocumentshavebeeneasyforsearchenginestocapture,modeland compute.Buttoolbardataallowssearchenginestocapturerelationshipsbetweenqueries, documentsandauser'struesearchcontext.Ofcourse,searchengineshavealwaysbeen abletodeterminethequalityofapagebyenduserbehaviorbeforethetoolbaridea. Detectingthousandsofclicksonthebrowserbackbuttonsendsaclearenoughsignalthat thepageisoflowquality. Sosearchenginesnowhaveaverypowerfulcombinationofsignals.Iponderedrecently whattheresultsofapurelyhumanpoweredsearchenginewouldbelikethesedays.And thenitoccurredtomethat,basedonlearningsfromorganiclistings,that'sexactlywhat Google'sAdWordsadvertisingprogramiscenteredaround:implicitfeedbackfromtheend user.
TheTenBlueLinksMustDie:FromSEOto DigitalAssetOptimization(DAO).
I'mnotabigfanofthetermWeb2.0.Forme,it's allaboutalwaysonbroadband.Idon'tthinkthe webchangedthatmuchwhenwestartedadopting muchfaster,alwaysonconnections,butoursurfing habitscertainlydid. Longgonearethedaysofwaitingforagraphicto download,onlytothenlookatastaticwebpage debatingwhethertoreadthetextornot.Endusers expectamuchricherexperiencethesedays.Thisis whyYouTubeisnowaspopular(ifnotmore)than Googleitself.
wayweapproachsearchmarketing.ItcannolongerbeaboutgettingClientsintothetop tenbluelinksonaresultspage.Insteaditsallaboutsearchenginepositioning:Where, abovethefold,canyoumakeyourClientsmorevisible?Whatfiletypesormethodsdoyou havetoutilizetoachievethis? I'vealwaysbelievedthatrankingreportsprovidelittleornovalue.Thisisespeciallytruein todayseraofUniversalSearch,whererankingreportsprovidesuboptimaldata.Your searchmarketingfirmmighttellyouthatyou'reinthetoptenforXnumberofkeywordsat Google,butdoestranslateintoactualvisibility? Forexample,atthetimeofwriting,asearchforbedandbreakfastnewyorkbringsback thisresultatGoogle:
Page|13
Takealookatthisresultforthequeryironmanfromearly2008.
Asyoucansee,theonlywayforanyonesellingIronManmerchandisetosurviveistoswitch toapaidsearchcampaignunlessyouhavethepowertouseaverticalcreepapproachand pushtheofficialIronMansitebelowthefold. Sowhatdoesthismean?Essentially,theoldstrategyofpushingbluelinksupthechartsfor visibilitymaynotbeassuccessfulaspushingcompetitorsdownbelowthefold. UniversalSearchoffersmanynewmethodsofincreasingvisibilityatsearchengines. Understandingthesemethods,andcombiningitwithknowledgeofenduserbehaviorat thesearchengineinterface,canbeextremelypowerful. Afterall,studieshaveshownthatendusersrarelyclickthroughtothesecondpageof results(mostdon'tevenbotherscrolling).Instead,usersactinaccordancetowhatare knownasquerychains.Followinganinitialquery,mostusersscanthepageabovethefold. Iftheydon'tseearesultthatlookspromising,theysimplyreformulatethequery.Thiscan happennumeroustimes.Onceasearchenginespotsthesequerychains,itcanthen preemptthesearchersactualdestinationpage. Forexample,someonesearchingforrarecollectionsmaythenfollowitwithspecial editionsandthenfinallylimitededitionbooks.Ifthisisobservedmany,manytimes, thenitwouldbesafetoassumethattheresultsforthelastquerywouldalsobegoodfor thefirst. Page|14
Thedynamicbetweenenduseractivityandthewaythatsearchenginespresentthesenew typesofdata,then,isthekeytodevelopingnewsearchmarketingstrategies.Plus,when executedcorrectly,DAOoffersauniqueopportunitytoachievemaximumvisibilityina minimumamountoftime. Forexample,earlierthisyearI madeashortvideopromoting theSearchEngineStrategies "Marketersneedtoembraceuniversal ConferenceinLondon(Im searchbyintegratingvideo,images,books,etc. honoredtobetheChairofthe AsfarasGoogletrendsgofor2009,they show).Icompressedit, willaffectSEOsaswell." uploadedittoGoogleVideo, Matt Cutts, Google Engineer and Head of YouTube,MetacafeandAOL Web Spam Team. Video.Afterthat,Itaggedand bookmarkeditatvarioussocial mediasites,suchasDelicious andStumbleUpon. Ithensentoutanemailtellingeveryoneonmycontactslistthatitwasavailableat YouTube.Afterithadbeenplayedover100timesandtaggedmorethantentimesaround varioussocialmediasites,itturnedupasthenumberonesearchresultforsesLondon (yes,it'swhatyouwouldcallalongtailsearch)Andithappenedinhoursnotdaysor weeks!. Evenmorenoteworthy,asearch todayformikegrehansesstill bringstwovideostothetopofthe pileevenafterallthesemonths! Nowthat'sthepowerofthesocial webandUniversalSearch.
Page|15
CollectiveIntelligence.
Perhapsthebiggestchangeinsearchistheshifttowardinformationseekingonsocial networkingsites.Theknowledgepossessedbyyourfriendsandpeopleyouknowactsasa supplementtotheweb'shugeamountofother,lessverifiableinformation.Thisknowledge canprovideextremelyqualifiedanswerstospecificqueriesthroughaprocessdefinedas informationseekingviaachainoftrust. Onlinecommunitiesarebecominganincreasingly importantareaofresearchbecauseoftherichsignals theysendtosearchengines.Webpagesarenolonger "Theresalotofexpertise, purelystatic.Realtimechattakesplaceconstantlyon knowledge,andcontextin theWeb.Taggingandfolksonomydataarrangement, userssocialgraphs,so alongwithratingandreputationsystems,areushering puttingtoolsinplacetomake searchintoawholenewera. friendaugmented"search easycouldmakesearchmore Muchresearchisalsotakingplaceintocombiningdata efficientandmorerelevant." fromsocialnetworksanddocumentreference
MarissaMayer,VP,Search Products&UserExperience, Google.
JonKleinberghimselfhasshiftedhisresearchfocusfromasearchengine'scentralizedindex tothesocialstructureoflargeonlinecommunities. Similarly,GooglehaslaunchedanewAPItographsocial networksacrosstheweb.Thisintensiveresearchbymajor searchenginesintotheweb'ssocialfabricclearlyindicatesthat we'removingintoanewformofinformationretrieval,oneof networksoftrust. Butofcourse,whilethetermsocialmediamaybenew,the ideaofusergeneratedcontentisnot.Afterall,bulletinboards, discussiongroupsandforumshavebeenaroundsincethewebs earlydays.Butwhatisnewistheformat.Inthepast,user generatedcontentwasstrictlytextbased,buttodayit encompassesalltypesofelectroniccontent:movies,images, tags,rankings,ratings...thelistgoesonandon. Whatevertheterm,thepowerofusergeneratedcontentcannot bedenied.Socialmediahasbecomeindispensabletomillionsof users.Communityquestionansweringnetworksinparticular havebecomeapopulardestinationforpeoplelookingforhelp.
Page|16
Infact,insomecountriesthistypeofsearchhasbecomemorepopularthansearchengine resultsthemselves.Forexample,anaverageof16millionpeoplevisitSouthKoreansearch portalNavereachday,keyingin110millionqueries.Naversusersalsopostanaverageof 44,000questionsadayonKnowledgeiN,aninteractivequestionandanswerdatabase. Thesereceiveabout110,000answers,whichrangefromonesentencerepliestoacademic essayscompletewithfootnotes.Suchwidespreadinvolvementshowsthattheinfluenceof socialmediaandconnectedmarketingisstrongerthanever. Stillnotconvinced?ThenconsidertheDeweyDecimalsystem,whichhaslongbeenthe backboneoflibrarycataloguingsystemsacrosstheUnitedStates.Now,theDeweyDecimal systemmightseemalittleoutofplacewhendiscussingsocialmedia,butbearwithme. Asanexercise,tryvisitingtheDanburyLibrarysonlinecatalogue.AsGeneSmithnotesin hisnewbookTagging,whatyoullfindissomethingmostunlikeatypicallibrary. Forexample,asearchforTheCatcherInTheRyebringsupalistofrelatedbooksandtags, notjustacallnumber.Thesetagscontainkeywordssuchas20thcenturyadolescenceand angst.Clickonthetagmarkedangstandyou'llfindalistofangstriddledtitles,suchas TheBellJarandTheVirginSuicides.Inessence,eachtaglinkstoanewsetofbooksand ideas. Whyisthissignificant?Well,its becausethesetagsaren'ttheworkof diligentlibrariansintheDanbury Library.Instead,theyretheresultof LibraryThing,awebsitewheremore than200,000userstrackandtagtheir personallibraries. Infact,LibraryThing'smembershave addednearly20milliontagsto15 millionbooks,makingitthesecond largestlibraryinNorthAmerica.Its undeniable:Peoplepoweredmeta dataforthesocialwebisbecoming hugelypopular. Thatswhyitsimplycannotbeignored bysearchengines.Buthowdothey dealwiththisdataandfolditin?
Page|17
ConnectedMarketing:GenerationY,The AlwaysOnMobileGeneration.
Perhapsthemostdramaticchange,though,willcomewithalways connected,3Gmobilephones.Forexample,theiPhoneisalreadythe leaderinthenumberofmobile/localsearchesatGoogle.Sucha devicewhichcansendandreceiveemailonthemove,notto mentionsurftheweb,receiveRSSfeeds,instantmessage,Twitter anddialogueatsocialnetworkingsitesindicatesthatthistrulyisthe ageofconnectedmarketing. Infact,connectedmarketingmaybeamuchmorerealisticand descriptivetermthansocialmedia.Inordertohavesocialmedia,one needstohavesocialnetworks.Inanetworkoftrustyoucantapinto thewisdomofcrowds.Andsocialsearchprovidesmuchmore validatedandverifiedanswersthanthatofasearchenginealgorithm. Anewphenomenonofdigitallyconnectedcommunitiesareemerging asaforcetocounterbalancethepowerofthebigbrandsandadvertising. Modernconsumersareformingcommunitiesandpeergroupstopooltheirpower, resultinginadramaticrevolutionofhowbusinessesinteractwiththeircustomers.Weneed tothinkaboutinteractiveengagementmarketingandcommunitybasedcommunications. Newmarketingstrategieswillbebuiltaroundthis. Traditionalmarketingmethodsarebecomingincreasinglyineffectiveandevencounter productive.Thepowerofthebrandsandtheabusesbymarketinghavecreatedavacuum foracounterbalance,anddigitallyconnected communitiesareemergingasthecounterforceto redressthebalance. Everythingisinterconnected:Thephysicalworld,social systems,yourinnermostthoughts,theunrelentinglogicof Thewayabusinesscanandmustinteractwiththe thecomputereverythingformsoneimmense, powerfulnewcommunitiesisthroughengagement interconnectedsystemofreality.Nothingexistsin marketing,byenticingthecommunitiestointeract isolation;everythingispartofthesystemandpartofa withthebrands. largercontext.
AndyHunt,ProgrammerandAuthor.
Page|18
Blah,Blah,Blah,VeryNiceMike. ButSoWhat?
It'sathoughtpaper,so
Thinkaboutsearchyesterday. LongbeforeGoogle,evenbeforetheWorldWideWeb,thereweresearchengines.In1994, BrianPinkertonlaunchedWebCrawler,arguablytheWeb'sfirstfulltextretrievalsearch engine.IspokewithPinkertonafewtimesmanyyearsagowhenresearchingthesecond editionofmybook.HeexplainedtomehowhehadappliedCornellUniversitycomputer scienceprofessorGerardSalton'svectorspacemodelfortheextractionandanalysisoftext forrankingdocuments.Atthattime,SEOwasallaboutmanipulatingrankingsthroughon pagefactors. Alittlecottageindustryofsearchengineoptimizersstartedtogrow.Moreandmorepeople becameawareofthetacticsandtechniquestheycouldemploytomessaroundwithWeb pagesandoutsmartcompetitors. ThenGooglearrivedandintroducedahyperlinkbasedalgorithmcalledPageRank.This wasntacompletelynovelidea:beforeGoogle,foremostcomputerscientistJonKleinberg hadwrittenaboutincorporatingnetworktheoryandcitationanalysisintoaranking algorithm. Buttenyearsago,theemphasisinSEOswitchedfrombasicpagetweakingtothequestfor inboundlinks.Theindustryhadtochangewithit.Unfortunately,toparaphraseThomas Edison,PageRankcamedressedinoverallsandlookedlikework.
Thinkabout
SearchToday. Discoveringknowledgefromhypertextdatasuchastextandlinkanalysisisstillalargepart ofarapidlydevelopingscienceunderthebannerofinformationretrieval.Thesesignals havebeenverystronginhelpingsearchenginesdeterminerelevancyandrankaccordingto authority.YeteventhoughindustryleadersacknowledgethatSEOismuchmoreofa marketingprocessthanatechnicaleffort,muchattentionisstillgiventocrawleractivity andindexing. Overtime,crawlershavegottensmarterandCMSdevelopershavebecomemoreawareof sites'needtobemorecrawlerfriendly.Butevenafter10yearsofresearchand
Page|19
development,inherentproblemsfromprocessesrelatedtosearchengineinformation retrievalstillremain. ButGoogle'srolloutofUniversalSearchlastyearcompletelychangedtheplayingfield.All oftheothermajorsearchengineshavefollowedGoogle'sleadandarediscoveringnew methodsofuncoveringpatternsindifferenttypesofwebcontent,structureandenduser data. Signalsfromenduserswhopreviouslycouldn'tvoteforcontentvialinksfromwebpages arenowabletovoteforcontentwiththeirclicks,bookmarks,tagsandratings.Theseare verystrongsignalstosearchengines,andbestofall,theydon'trelyontheelitismofone websiteownerlinkingtoanotherortheoftenmediocrecrawlofadumbbot.
Sowhatabout
SearchTomorrow. InNovember2003theindustrywasrockedwithGoogle'sFloridaupdate.Google'srolloutof UniversalSearchlastyearcaughteveryonebysurprise.Andnow,withGoogle'slaunchof Wiki,youcansayfarewelltotheoldfashionedrankingreport. TheguysatGoogledon'tgiveanyadvancewarningaboutfairlydramaticchangesthat affecttheentireSEOindustry,soweneedtobebetterpreparedandunderstandwhere searchisgoing. IsyourSEOvendor(oryourinhouseSEOteam)fullyawareofthenewsignalsandableto developnewformsofoptimizationandstrategy?Afterall,SEOwillgivewaytoanewform ofDigitalAssetManagementandOptimizationforasearchengineaudienceexpectinga muchricherexperience.ThisnewtypeofSEOwillplaceamuchlargeremphasison optimizingarangeoffiletypes,fromPDFstoimagestoaudio/visualcontent. Moreeffortwillbeplacedonfeedstosearchengines.ThiswontbejustXMLfeedsinto paidinclusionandshoppingcomparison,butwillalsoincorporatefeedswithothertypesof information,suchaslocal,financial,newsandotherverticals.Mobilewillbecomemuch morepopularandsearchwillgraduallybecomemoreofapersonalizedexperience. PersonalizationandDigitalAssetOptimizationwillend1999stylerankingreports,assearch resultswillbebasedonblendedresultsfromenduserspecifics,suchasgeographic location,timeofday,previoussearchinghistoryandpeergrouppreference. Online,monitoringofthecustomersvoicewillbecomemuchmoreimportantthanpushing abrandmessage.Monitoringsearchresultsfordifferentfiletypeswillbecomeincreasingly importantasendusers(evencompetitors)uploadcontentthatmayberelatedtoyour brand/product/service.Reputationmanagementwillbehighlyvaluedasmarketing continuesitsreversalfromabroadcastmediumtoalisteningmedium.Marketinginto networkswillseehugegrowth,andsocialsearchwillgrowwithit.
Page|20
KeywordDrivenMarketing(KDM)isattheverycoreoftheseemergingnewtechniquesand practices.Understandingthelanguageoftheendusertobettershapemarketingmessages fordeliveryintonetworksisthevitalcomponentforsuccess. Google'smissionistoorganizetheworld'sinformationandmakeituniversally accessibleanduseful. I'mreturningtothismissionstatementfromGoogle.Iquoteditatthebeginningofthis document.Havinggatheredtogethersomeofthefactsrelatingtothefutureofinformation retrievalontheweb,IfirmlybelievethatGoogleisfailinginitsmission.Thatsaid,it'snot becauseanythingiswrongwithGoogle.It'sbecausethewholeapproachtoawalled gardenenvironmentwhereeverythingiskeptin ordermaynotbefeasibleanymore.Iftheweb(and crawlingtheweb)reallywastheanswertothe "Ihad(andstillhave)adreamthattheWorldWide futureofinformationretrieval,thenitmightbe Webcouldbelessofatelevisionchannelandmoreof possible.Butwithsomuchcontentoutsidethe crawlandendusersnowrequiringamuchricher aninteractiveseaofsharedknowledge." experiencethanafewtextbaseddocuments,itmay SirTimBernersLee,InventoroftheWorldwideWeb. betimetorethinkthewholething. We'reessentiallytryingtoforceelephantsinto browsersthatdon'twantthem.ThebrowserthatSirTimBernersLeeinvented,alongwith HTMLandtheHTTPprotocol,wasintendedtorendertextandgraphicsonapagedelivered toyourcomputerviaadialupmodem,nottowatchmovieslikewedotoday.Search enginecrawlersweredevelopedtocapturetextfromHTMLpagesandanalyzelinks betweenpages,butwithsomuchinformationoutsidethecrawl,isittherightmethodfor analwayson,everdemandingaudienceofselfproducers? It'sclearthat"Web2.0"hascreatedafundamentaltransformationofthewebintoatrue collaborativeandsocialplatform.Intherealmofthesocialweb,technologyisbeing developedtoaugment"socialcognition"thatis,theabilityofagroupofpeopleto rememberthinkandreason. Inthe1975sciencefictionmovieRollerball,alloftheworld'sinformationisstoredon computers.Somehow,thecomputersmanagetolosetheentire13thcentury.Perhapsthe movieisright:acentralizedrepositoryisnotthewaytogowhentryingtoorganizethe world'sinformationandmakeituniversallyaccessibleanduseful. "IjusthadtotakethehypertextideaandconnectittotheTransmissionControlProtocol anddomainnamesystemideasandtada!theWorldWideWeb." It'sthisstatementwhichissointriguing,though.SirTimBernersLeeinventedtheWorld WideWebinnotimeatall.Hesimplyusedhispreviousknowledgeofhypertextthinking andappliedaprotocoltoamediumthatalreadyexisted.
Page|21
Interestingthought!
Page|22
Toreceivemorebreakthroughthoughtpapers,orforhelpwithyoursearchmarketing campaigns,emailAcronymMediaatnewsignals@acronym.com,visitwww.acronym.comor call+1(212)6917051). AndcomingsoonmorerevolutionaryinsightfrombestsellingauthorMikeGrehan! FollowingtheinternationallyacclaimedSearchEngineMarketing:TheEssentialBest PracticeGuidecomesanewbook,simplytitledSearchMarketing,tobepublishedinSpring 2009.SearchMarketingwillexpandonthebreakthroughconceptsexploredinNew Signalsandexplorenewandemergingtechniquesandtrendsinbothorganicandpaid search. TofutureproofyoursearchmarketingandreceiveupdatesonMikesnewbook,email AcronymMediaatnewsignals@acronym.com,visitwww.acronym.comorcall+1(212)691 7051). AcronymMediaGlobalHQ AcronymMedia EmpireStateBuilding 350FifthAvenue,Suite5501 NewYork,NewYork USA
CopyrightAcronymMedia,Inc.Allrightsreserved.AcronymMedia,theAcronymMedialogo, KeywordDrivenMarketingandKDMareregisteredtrademarksofAcronymMedia,Inc.
Page|23