You are on page 1of 7
(LD) Web Speech API A TECHNOLOGY IN ITS INFANCY, BUT WITH THE POTENTIAL TO INTRODUCE ENTIRELY NEW MODES OF EXPERIENCE TO THE WEB ‘The Web Speech APs an experimental tecnnolgy ae ois evercanaing speciation, which beings voce tation setware tothe wen The unser premise the Isto prone capscy fr bet ef np rank Wana of mapnation ts eture couse beg fqutea change inthe way that user mrtaces are esgned onthe webs Ged ad Approve aready the user experince mther rcs wth Oy Goats ae Hey Set Sun facates er the wo wl surely beng new arsexcting opportunites "he speciation suggess more ran aon dul uncon sch as vie we Serh, certinsosrecagationct open dg, need tobe present ado ctu cetecton eset specch trawl ‘Ofcourse there wb some prvacy cores wth ay API Eat potty enables a cave to cect {rt store ca amen frat The for vendors to folow rch paropeaned are “Use interme conser. User agents must provide bv Inacaions wren spaecn ing records Tie intertoo emt must io alow users acre the type, teinertaeeavent ven, SpeschRecogiion Browser Support CHROME CHROME FOR ANDROID. FIREFOX SAPAR| see EDGEIIE 105 +e 66 Google and A Target Audience Ts techreagy wi be parce sell for people wth seis suenas st patent and ener make tneweb on ac. ‘xvas never an onan Rate than yt expan amp tinacion var recog = new window spesctiecognition) var dict = dociaent querySeleetor(asict’) recog. continuous = (rue rocog.onresult = function(e) ( results. foreacnFunction(r) ¢ dict, textontent += rC0). transcript Ds ? recog. tart Ths cove rate @ new istnceet the Speacrfecogntion wer then contgures meinstance © recognise cortruous no hich operat vith the most aly URL: biiycanty Scenarios VOICE WEB SEARCH conmonpiace Werle cents eabesting ther ownveronct hay Googe CONTINUOUS RECOGNITION OF OPEN DIALOG “ss onerenty depends on woes ook tupto an mallet and send en es SPEECH UIPRESENT WHEN NO VISIBLE UINEEDS TO BE PRESENT ‘is tectlony coutdulackan ent ew rrictofovenmore mineral wring Voice activity o&TECTION Trershovegettobesomeinereting cepertunies when general vie atvty level are paedth HTMLS Canvas. ple have already been eae speech to enhance particular aspects of the user experience 99 HTMLS &CSS3 Genius Guide Text to speech API WEB SPEECH API'S OTHER HALF Tre tips ctspseen totes tteapaech realy ste me ay comer en ay Ma 05 tecrraogy nean ae sult put spe ise ‘Most oftheleqwork is doneby Web Speoch APs specensjnneas trace yeh wees na mise ‘lamer Speccecogntion, where evertad functensareesposed erg wth th speech funeton act namaspeck ecko ‘tropes doan mpl of what can ke row SpechsynthesisbtteranceQ: infos. soechSyntosis.speak(s) A new stance othe Speeches. Aeronce ‘extcetnad- ne tng the compute B93N0 1 spenkaorg wan a ongiage Te rane pass ‘mecompure rstanceto te speak uncton and ‘thecomputr begs tak Speechsyrinesssmore wey supoorted whch ‘at son OSs Safa This saute rane for any band feomoble pleats. such astur byt ‘econs ot maybe wen a sept seo ec aR URL biiyLsHp| Scenarios LISTENABLE BLOG POSTS ‘great este torthe vay impair, blog {orarealycompling experience ‘TURN-BY-TURN DIRECTIONS Put your phone in your pocket and youcan ‘nen be avaby guided to your destationby thebromeersvoiee STEP-BY-STEP RECIPES ‘Steky marks on touchscreens while weighing ‘outingrecints could be ating othe pat Browser Support CHROME (CHROME FOR ANDROID +++ NIA NIA a IMLS &C383 Gens Guide 11 Tips & Techniques (3) WebSockets API FIRST THERE WAS HTTP, THEN ALONG CAME AJAX. NOW, THERE IS WEBSOCKETS Weesoceisc fundamental arent coneptto reserces and ta serve esperang wth the the ‘server araclent agree tormantan a common cas vod re overhead that comes wth HTT. Thelean raturectthe protac! nd sao tency crcl ‘eto cre appcator fon equre roe rebel passer correc seme tat ‘raster sever site ecologies ten tobe boda facta Soversgearentactres tat how for ih concureney ona cet ar cten cured ae those that ae out os nen cing URL: matiai9x550 Tools SOCKETIO SOCKETIO Rest Node Wetsocet wentecre TORNADO. GITHUB.COM/TORNADOWEB/TORNADO Prion twang ray na amewor PUNK DINAHMOELABS.COW/PLINK fester colatorive muse mngeseerece (4) History API SAVESTATESINASNGLEPAGE WEB APP ath Jaret Ms ent to st oar, ad ther retry events wth push torypushtate takes tree vaues an cect associ we the state, te and then apape URL heh il be stayed te ronsars aes bar Thehistory APIs very useful for sine page soplcabore tt have dierent tates ews that 2 the bento URL: matiankFukx Scenarios REALTIME PROPERTY UPDATES ‘realtime property updates, pewaing an ‘eecanaing map property ott. MULTIPLAYER GAMING AND COLLECTIVE EXPERIENCES ay mutetayer game il equretow tency “communication betwen cents andthe ever ‘Ts could apy 0 oter group experencesas wel REALTIME CHAT Websockets could make aresonsble replacement torte aging IRC enabing ener Browser Support cHrome EDGENE 05 = (5) Link Prefetch API PREFETCH NEXT STEPS INKY JOURNEYS preetcresdocumerts bela a ze any equests te cnes rat ney ate ety vat miners tue Peering esources ha ths tp users hovng to wate tne watna fer server esparse-the ages cela wren fetcng new pages and assets Implevertra prefetch came canhave avast ‘eect onpeceve performance pec whe ers 290 dona reps ts Peeing age appa the rua of he pe ‘tena wth the other raha else te URL: mattarwatayit Browser Support CHROME FIREFOX SAFARI Browser Support cHROME FIREFOX. oven SAFARI + (6) GetUserMedia API CAPTURE veOHAUDIOFROMDEMCES HIMLSsoetuseteca AP aks develops cextire messes om the deceit ‘ectin.on tone bulk getsinisesing when ed wi ther MTL tecinloges Far aie the vo steam red by getMeta can be -ppled oa 0a aco amet That video demert tunes ri a za athena bb 30) 0 be aren nto MIMS Cana alos fer manpustion tthe magebetoret gets st othe server weal every ey tosealthe frames daw, tr net hemor evn app asianend fectssich sb enddstrton eed lea by HTVLS video caret he 0 “visho steplay> var video = dooment, querelector(‘vieo"): ravigator. getsereta(( 3, Fetiens) { ‘ideo sre = wlnow U. crestensectLRLs) video.ply D: Tre OOM eure forthe vise leant Tesi stron va the getUerecs AP ia. he steam eure Sen othe 20 eee ich bee ‘obit browser URL: maLLRLW Parameters CONSTRAINTS Tetesancretcesring estar constants, alenas wh, ght, tome tear SUCCESSCALLBACK ithe request for users mci wassuccest ths functonis msc ancthe steam psted ERRORCALLBACK the renee formed fac to ermine lackof sources ts uncon invoked. CHROME « ‘CHROME FOR ANDROID « FIREFOX = 38+ SAFARI + NA EDGENE « a 108 even 12 HIVALS 8553 Genius Guide ‘ou ass ‘rampehefate ase prepertes oe inengpayoct speed Here the ‘evloperas smpemerted bespoevlume onic. HTMLS5 & CSS3 Genius Guide seese baproverty ‘led caret, ‘re poperty contre tepoyoos oe edad aso ‘TreNedabenent (7) HTML Media API HTMLS VIDEO AND AUDIO HAVE PHASED OUT FLASH. IT'S TIME TO THINK ABOUT USING EMBEDDED MEDIA MORE CREATIVELY ‘he HIVES Meda AP provide tana Jat Por reractng be HTML Meare Inteoce HTMLéecEemen and HTMLAusoEkeent ze bon cen ofthe IML Sedaemen and re "opropetes Moa Elements ve prepares ty manpusing te oybek of reda ind od by and so The scenarios for ung hs apa set may Plugs ut tere arcer beets frre engaging and crandernteracve xperencas. Comat elope nate aie pa ar sxclybespoeeflets ‘Vio tats more inert wtn the aroun ebge asc now posse The lvaer terface lows fer poy tater to be erator be tara for wer evperence deers to make une Ireeporateg supparing ama 6 cates ‘rents such as expaengheveing video on ¢ ‘source sren"exaple.rpt ypen"vide/ept* shee ourtonPlaycitutton Var video = docinent.qveryselector ("video") var button = document, erySelectorbutton’): button aéventListener(‘lick', play, false); Tunction par ¢ ‘F(video paused) ¢ video play: y else ( 1c p80 ) } Fst 00M references are made tothe veo ad button ements Then acicrancer ales Pay then hours tothetaston Te pay funcon pow pyro ane aucra actors the vdeo ty mange ofthe HIMLMcaelerant 2 atace ‘Ging onto uil mre anced contol ht tock unto areal pce tru te APL ‘nismeans that much ease tong vl tye tanto enbeddedmescnthe neo thanitewe atime meda.etement rteace ks devsopets esteauopiaying mada qving teat sont video 23 URL: malianvojvc comoper to contol ‘mepioyct ome ‘contined a paypouse Scenarios STANDARD VIDEO EMBED Bronsersupprt for HTML mess 0 990d tmetereay no excuse for not using tas andar for mediaembeding. STANDARD AUDIO EMBED Standord aus embedding also prelerres ‘over tin powered solutions, suchas ash or Shertont SILENT VIDEO Use set video intend of mages to capture human emeton and make emotenat connections ith users, HYPERREALITY Soot video tat contains very tle ‘moverant but more than photograph Hyperreal scenes can bring 2 page toe, Browser Support CHROME ae ANDROID "yess a FIREFOX 38+ SAFARI a EDGE/IE 9+ 105 HIMLS &C353 Genius Guide 13 Information API ee Timing API SMART DECISIONS AND CONNECTIONS 8 Navigation 9) Network PERFORM ANALYSIS ON LOAD TIMES OF WEB PAGES WITH THIS API pov essa ant pected a Kwon ing iten gare posted taeda UMass ACH, iments Scenarios Ga omen scepter : H fee ‘The navigation timing API should be used asa Hiiegtiy niente iF comatng ts wert Seiten srereint trot —nigewacuermene Ua meaner eee ok benchmark for subsequent test (C.doxtontentbeniedEventStart Browser Support Browser Support ‘Antoine 1 100, complete: (t-derrplete ¢dentending) / a 1000 ay > BF Ts ferences the performancetrng mes than 9 ceermines he mens fer stage the ral 9 onary Page Visibility () Battery Ors Lae Soot Berane ee TAILOR FOR BATTERY etna) Per ricer Rene Mantes eT ee ee ag Dee a ad Pee og oot eo eee ce i en ie Shi crores Drag & Drop API HTMLS5 & CSS3 Genius Guide USE DRAG AND DROP TO MAKE SORTING, REORDERING AND COLLECTING ITEMS A FAST AND EASY TASK Noloner dodendopers have orev on bry Jvasorg Ul ramewors he Query 6 enblethe Ireerenin etary ancirop Te HTML rogandiop AP prodos eer fnctens and IM_areatesnasieg mos eementsen any ven pageto be made rate eragacle Ths means every tks and applets previous he ctr Wiha dood ekmenatn oh rogandeton shoud be rarer cya. ke mouse vert, > Fanetien ragtver(s) ( SF (e.preventefaule) ¢ espreventdeFanleO; > e-datateansfer dropetfect = “ve > Function dragenter(e) ¢ ‘his.class stad draeine") ) function dractene(e) ( this.classLst some 'Srgine’): ? Fetion rope) ( if Ce stopPropagation) ( -stopprepasationO; > retur false; Iesimportanttorusers toast oh uaty visa oedack om ‘raga crop mectanms They ‘elton ee dopoed wi sng advert. ee bose ireementtontte crag ice ‘tiv clasn"iter? sragganlew'trve> function dragstart(e) { this. styte.opscity = *0.6 > funetien deagene) ( stan, clase. emoue ‘rage; sen’ 4-addventstener(‘dragatare’, cragstart, false): ‘adden tener (draganter', eragenter, false): |. adlventListener Cdragever", dregover false); 1.addventistenerdrageave Srag.enve, Falee)s 4. asdvertListener(‘érop', drop, false) advent istener('érogend, dain, false); cooiment. quarySleetorAL Drastat rences the opacy of he ange ‘Semen Oragentr ant aagteave) manage ‘thar tam Drop stops af re cure cust ropagater Drage ensures the ss S200 URL: mztlasiENGVES Scenarios MANAGING CALENDAR ENTRIES Rather Waren spe nes ar dts ‘when managing scaendar Rs mich esto tkagand crop appintments USTSORTING Sotng Its beter dane with dag kon TASK PRIORITISATION ‘rd rp. wich enables te anit erceing ot IMAGE SORTING ‘isl sorting sao sea Bergabletosort imagesinto two ples, sia sable’ and ‘raat means that mage orgeriston ld be vay improves by 9 nc op. Browser Support CHROME ANDROID FIREFOX 38 SAFARI a EDGENE los HIMLS &C353 Genius Guide 15 Tips & Techniques (5) Web Workers HAND COMPUTATIONALLY INTENSIVE TASKS TO BACKGROUND PROCESSES, Low concur CPU ere processing someting hat asain the bowser ras never boon good at lng une Bock ne read and tp ther tng em rappenngen he page Theleb Wares API can enable backend teas computatonaly eoensve tasks wircut tere beng any tral fectsto the ran applcaten tree Wao Works crunestowh te man avait tread throusrian ecceed incten cles poeMesige Herts ‘ar verker = new Worker worker. 3°95 sorter vent ttener("mss306", Function) ( console. eget); 1, false) eorkerpstessage("T Like cat Feat"); 1 verter 38 sn oder tener mesoge'Functlen(e)[ seit psthessage(. data); 3, false); rtantes wor ome other were The Then tsencs coat the werker ura postessage. thseasea snp sting. Wor scortansafuncten Pointer Lock API ENHANCE IMMERSIVE SD EXPERIENCES raw mouse mevemertcesurng bayer the constant he tone nda a el 35g tt Curse The APiens ts fstperson carts in ‘xpenences anc expercnces that aque sf mouse croverantsich 2 Dest toe Sferethe one Lock AP fuller eoererces would un up against ego ct te browser vind. ‘ahem out te experience. URL: matarysYZ0r processing that woutshappen inte worker ous be Sens amessage back tothe man ead extn URL: mlaiKAJDYK Scenarios SPREADSHEET APPLICATION Spreadsheets can require an immense amourtot Caleaton theyre arg enough Hana tat computation another tread VIDEO ENCODING Veo encode ie anintensve computational task isnot semething tat should be donein Browser Support cHrome EDGENE 05 = (1?) Vibration API PROVIDE PHYSICAL FEEDBACK smart eves become mere common or nractng tne we Rates enc to tt tkng advareage of \roten Nost adem mobledovces nave veraton rarcware The viaten AM ofers arrester the zy toaccestnshacnarel texts The APIS Very svacretorwact aon indo navigator. vibrate(2s@); Thetinoet cool eau the dee fo vrata fo 250 then aie forever her srgurerk URL: metiaM778 Browser Support CHROME FIREFOX SAFARI sees Ste Browser Support CHROME FIREFOX oven SAFARI +1 WebRTC Spec ConvecTINGDeMCeS TO EACHOTHER Taba onc det baler ipmaldetattemntitied cence tation Sua patwscenacona he enor eee Acerca gee aceon at Mcwhne hetreren e mo Tinocanocteateyeangeerae Suwon penn omen: ebanGume eres camunenintnen na TetednSecnaprcl bE ae ce ineminmea necaee foun tpercrecr nea poninihromeepin gery Stereo coop Seecyeccoereomenase rome omen ees Reapugcumubintnoccipren araaeeene cea oem ee.. err P ret ne on enone ‘oars encnretonrso on oaeewn ncn bcd MeDaoCore wis per wee resin ‘toric Th me eto cence (atoiame purer oerere ScStmlaveoerwesee pss Scenarios DEVICE-AGNOSTIC VIDEO CHAT WebRTCcan ring video chat to almost any device tha browse camera ane mirophone PEER-TO-PEER GAMING Games designed wineutacentased server can se WeBRTC to canect peers wow ten. PEERTO-PEER FILE TRANSFER WeDRTC makes possible senalarge amounts of za between peers 16 HIVALS 8553 Genius Guide Web Components USE WEB COMPONENTS TO PACKAGE HTML, CSS AND JAVASCRIPT WIDGETS INTO REUSABLE, ISOLATED PACKAGES Lite WebRIC, the Web Components spectcatons 3 wees rat erage ther open wen tacnloges Using aeady auc Veb Canponertsis Import statement n an HTML pane Wen Components prewie 3 29 to pazsaye walgets but wah HTML, (Sand Java nto re.zabe wen wget at agen sarap from te reste the DOM, The wits Stying st woh the ret fhe CSS he JaaScipt ‘mace arto wand west widgets witout covert regress oer parse cove hase The four parts Web Compaoants tat work to ae ts pram are as otows TereiatesShacow DOM (custom Eemerts ae HTML ingots Remember itis not Polymer toymerisaGoogletramework ts on eb Components technologies ana not requred ‘Component. Temes ae sami to tempates notes "ruc ecnreoges ke Anguas.Tey erate rap 0 be defied, ready tobe made use ot ser the DOW sandzoung se, wheres eveopesto ceatefuly eset DOM cements HINL rrp re the CSSand Jvascnt Wieb Components are siren to rete developers can sek whieh sof Web Components Py need to use gansta ecet proj. hey cul be apie 0 any seltcontanea fee oa webpage atoning thet raw URL: webcomponents.org 20) Shadow DOM ISOLATE PRESENTATION FROM CONTENT FOR MORE FLEXIBLE AND. ROBUST FRONT-END ARCHITECTURES The Shadow COM erabes dewopersto encase (DOM demerts ram e es ofthe page a corncton vw tems his nabs the separate cf concer hove witan someting Me is when want share syle direction-wisget ( ... )