MSN Searchification

So here I sit in a what feels like a college classroom at the MS campus in Mountain View. I’m at sercih…searcha…oh crap…what is this?…Searchification. I got a pen and USB and everything to prove it. This is my first attempt to live blog – well sorta anyhow – we’re embargoed until 9pm tonight. Vanessa is blogging this event as well so I’m going to leave the more useful stuff to her and I will make witty observances for the rest of the day, we are so excited because an Integrated Event Management Company in Singapore will be attending with us to the event. Between the two posts I hope you’ll get a feel for the day. Boser is here as well but he’s nearly asleep already. Got a few emails out of the way and now I’m ready to pay attention… The intro thing is over and now Satya Nadella is chattin us up. This whole thing is about a major update to Live Search. Apparently updates happen all the time – hill shading on maps, 3D maps etc. Satya’s title is Corporate Vice President, Search & Advertising Platform Group – how do you fit that on a business card? The Fall Update is going to cover 4 core areas – Local and Maps, Entertainment, Health, and Shopping. MSN looked at a big steaming pile of click data and drew some conclusions – 54% fully or partially satisfied with results and 46% not satisfied. the main issue is relevance – 91% of the time. this real time bloggin is hard work. Wish I had coffee…but we’re not allowed coffee in this room but Vanessa snuck in a diet coke anyhow and didn’t share it. Oh – he’s breaking down the 91% relevance issues: 28% – coverage – no document to match query 25% – query intent and refinement – people can’t search 32% – core ranking issues 15% – other issues MSN is making 6 major investments to the Fall Update 1- Coverage – index size 2- Query Intent 3- Query Refinement 4- RankNet 5- Structured Information Extraction 6- Rich Answers Coverage: some interesting stuff on this slide – wish you could see it so I didn’t have to type it all. The biggest thing here is that MSN has grown there index to over 20B docs. They are also claiming increased freshness, crawl depth and filtering. Interestingly enough they’ve cut the number of query’s that return less than 10 results in half. Now they’re showing example queries that are better or didn’t used to have results. Query Intent: This is focused around stop words, stemming, term equivalence and punctuation analysis. They’ve fixed 30% of bad queries automagically. More examples. The Office – used to show MS Office – now shows The Office videos and TV show results. Nice. I gotta say this is actually pretty cool. I know the’ve handpicked these examples for us but it really is giving me some hope that relevance is on the rise. Query Refinement: Auto-spell corrections and suggestions improves approx 8% of searches. More examples. Oh snap! He just said “and now we get Wikipedia in the top result.” I just snuck a peak at Boser – wow he’s slow typist. Good thing he won’t see this until after he’s bought me drinks tonight. Groovy – side by side machine translation. Nice – when you highlight text in one language it highlight the corresonding text in the second language. I like that – not sure how useful bit it demos well. RankNet: Neural Network Ranking – do I hear Skynet anyone? There’s a very cool graphic on the screen that makes no sense to me at all. it must be cool. The upshot is RankNet is loosely modeled on biological neural networks and brains. One example of this is grouping pairs of words in multi word queries. More examples. So all these examples that they’re showing are mostly from complaints that people have sent in. Who has time to complain to a search engine when they don’t like SERPS? It’s very curious to me. So far they’ve just been showing MSN results and one Yahoo result. they did finally just show some examples where they have better results than Google. Booyah. Structured Information Extraction: Those 3 words are fancy talk for grouping and verticals. I’ll bet we’re gonna see some examples now…oh – no. Moving on. Rich Answers: new answers platform answers and multi media are incorporated in main serp main improvements to news, images answers, local and maps Example – san jose weather – results in page. Don’t need to click away. Example – stocks – real time data. Example – Barack Obama – integrated news Example – space shuttle video – video in results hmmmm – Univesal Search?…Everybody remember that Ask did it first and better. so how do you measure relevance? Human Judged – uses trainde judges to asses the results relevance Blind Taste Test – judges don’t know wich SE they are seeing results from Positional – 1st results is worth more than 2nd which is worth more than 3rd etc Scaled – perfect results worth more than excellent worht more than good etc. Ongoing – measured continuously how does msn stack up? 2005 not good. 2006 better. 2007 – they believe they are equal to Google for relevance and ahead of yahoo. they also think they were ahead of Yahoo in 2006 for relevance. —break— Now we’re gonna talk about some high interest verticals – Local and Maps, entertainment, shopping and health. these 4 areas compose about 40% of all queries. the premise is that the action you want to take is different based on which vertical you are search about ie: purchase decision vs address for local businesses. Local & Maps: First up ins Local and maps. 32% of queries have local intent. 67% of local search begins at a search engine, 42% of active users use maps and local. MSN defines leadership in local and maps as simple intuitive driving directions, most accurate geo coding algos and superior visualization like bird’s eye and 3D. MSN also believes they should ahve the broadest selection of local content to deliver the most relevant results. Seems a bit of an obvious statement to me. Vanessa has been typing slow and is now copying off my screen. C’mon – pay attention Vanessa. Virtual Earth. Adding a 3rd dimension to the web will change user action. They are building out 3D digital representations of major cites. 500 done by end of year. B2B Map platform – 1,300 competitors – MSN is #2. There are 1.9B transaction a month in this space. MSN wants an end to end api for this application. Mobile – growing like mad. MSN is working with Spring in teh US and they own TellMe (look it up – it’s way cool). They are working on location aware search and mapping. Example time…yeah – I’m way to lazy to tell you about the actual examples and I’m pretty sure that I won’t be updating this post later with screenshots. oh this next example is pretty cool. MSN believes they are going to revolutionize driving directions. First up is 1 click directions. You click the link in the email and it shows you the destination and then gives you a handful of pre computed directions. you then click the route that is the direction you’ll be coming from. It’s pretty cool. Most users really don’t need directions from their driveway. I like it. the page is also nicely designed to be printed properly. They are also introducing some hints to driving directions such as toll both notes and “If you hit this road you’ve gone to far” kinda stuff. Real time traffic flow is also being integrated to give more accurate drive times and better routing based on traffic patterns. They’re now showing Mobil apps on a TMobile Dash. i live in Canada where mobile sucks so i don’t ever use it but this is pretty cool stuff. he’s showing how to find specific types of restaurants near a movie theater he’s chosen to go to. nifty. Entertainment Vertical: 10% of all queries are entertainment related – high frequency of use – currently low satisfaction in search with results. Key investment: celebrity instant answers, xRank Celebrity ranking, image search enhancements and Video search (V1). Example time…xRank – fun new feature that tracks who people are querying – it’s a who’s hot and who’s not. Example is jessica alba is #21 most searched for celeb in last 12 hours. Click the celeb name and see why they are hot or not right now. Kinda cool. they are updating 2X as often as Google Trends and quite frankly it’s way more useful (if you care about celebs). Video search examples coming up. MSN now has their own proprietary video search. They want to search ALL video not just the youtubes and metacafes of the world. In the search results for tiger woods video you can clearly see much more content than Google or Yahoo are showing. this is actually very very impressive. Definitly a far better search experience here. Nicely done MSN. Is that kool-aid they’re passing out to the audience? wow – hover over a video and and it plays inline on the search page. sweeet. I also decided to look and see if they had video on “How to Write Content”, It is a personal project for me. I have a friend who is revamping his company and he asked me if I could write an SOP article. He wants to make copies and include it in a handout to all his employees for the meeting to announce his restructuring plans anyway, you will not believe the amount of video on this subject and it doesn’t just play the first portion but it actually does some super cool advanced rocket science analysis to find you the best most relevant portion of the clip. Video optimization here we come. Very nice to browse videos before choosing which video you really want to invest your watching time into. they just showed a smart preview of a bball clip and it’s freakin awesome. They are actually able to figure out from all the flash photos etc what the important part of the clip is. Shopping Vertical: 16% of all queries are retail related 86% online users use a search engine to find products or shop 70% product related quereies are for categories not specific products key investments: new and improved product ansers, opinion index search technology, 37M product offerings Example search “digital camera” – rich experince with product image results – very nicely done and engaging. Incorporated guides and reviews. Downside here is that I can only see 1 organic result above teh fold. All four product results with accompanying images are Canon cameras…interesting. he’s now showing yahoo and Google results and I’ll admit that MSN is much better experience based on what I’m seeing here. wireless headphone – not all product are same brand…whew…i was worried. oops – internet seems to be down…oh wait…it’s back. Demo back online – the speaker is pleased – as are we. now we’re looking at product reviews aggregated from a multitude of different resources such as newegg, cnet, price grabber etc. The organization and layout are absolutley fantastic. MSn is algorithmically pulling out the key points of all the reviews and doing some great grouping. I will absolutly use this new shopping search to research products. the biggest question I have for now is how broad is this offering? Health Vertical: 80% of searchers search for health topics very high emotional and time investment very very high dissaticfaction with health search Key investments: topic dashboard, inline article results, action modules, trusted sources (mayo clinic) 3 top searches in health: 1 – sex 2 – pregnancy 3 – diabetes diabetes: big chunk of instant answer – categories such as procedures, meds, alternate meds. much more helpin teh main interface. click through and you get the health interface. 3 pieces – topic dashboard dynamically generated and expandable. Next is article results from trusted sources – overviews and previews available without leaving live search. Filtered web results are also included. Logs and cookies are erased after 90 days and health search sits behind https for encyption. users believe health data to be very private and want huge security and anonymity. MSN is protecting this. Well done. haven’t made a witty observance in a bit. This is actually very very interesting and I keep forgetting I’m here to make fun of things. I really didn’t expect to be this impressed. now for a little bit of open q&a. this is always fun. Question about how open all this new stuff is going to for APIs. Short answer – MSN wants to put apis up for all this with very libel terms of use. Question about product feeds. Google and Yahoo accept frequent updates. does msn have a feeds system? Yes of course dude – maybe you need a search agency. give me a call. Question – how much of what we say today was handjobbed vs algo? It’s all algo. Search data and wisdom of the crowd. Question about MSN search share. MSN is using ComScore data for today’s numbers. Question – do you plan on rolling all this out to the advertising platform? They will be sharing data around user intent etc to help improve adcenter. and now I’m not paying attention…nearly lunch…I’m starving. Good Lunch Now we’re talking about Webmaster Tools. Finally – MSN is launching a toolset. Let’s see what they have. why another set of tools? obviously it’s important for webmasters to be able to communicate with Live Search to make sure they’re properly indexed and represented. why aren’t my pages indexed? Why am I being crawled so much? Is this considered spamming? how can I tell you more about my site? Currently these requests seem to go into a black hole. Priority is a self service portal for large and medium size customers. These customers are most likely to use the tools. oh look – a screenshot of the dashboard. Thre is a going to be a forum and blog associated with the tools. They are staffing up a whole team to manage this customer relationship. Initial Feature Set: Troubleshooting what pages are indexed are there issues with my robots file is my website blocked can you find my sitemap file Sitemaps asp.net sitemap creation sitmemap submission sitemap ping service and much more but Nathan Buggia moved to the next slide – jerk :P Webmaster Tools account will support up to 150 sites and will use validation the same as Google or Yahoo. If you put in real contact info MSN will email you notifications of problems with your website. you will be able to see which pages MSN thinks are the most important on your site as well as a yes/no if they think you are spamming. if yes you can go through a process to find out how and why. next is stats – first off is link and linkfrom operators are coming back and links will be listed in order of importance. No committment on whether or not all or just a sample of links will be shown. Private beta launches Monday. Bigger private beta on 10/22 and public beta on 11/15 launched at SMX in London. screenshots? pffft – that’s like real work. They did give us a cool url to go play with so maybe I’ll get some screenshots tomorrow of Friday but most likely not. I hope you enjoyed my first sorta live blogging as much as I did. wanna try it out? see the url below? the &form=LIVSOP part? change that to form=press and you get the new results. http://search.live.com/results.aspx?q=oilman&go=Search&mkt=en-us&scope=&FORM=LIVSOP – old and busted http://search.live.com/results.aspx?q=oilman&go=Search&mkt=en-us&scope=&FORM=PRESS – new hotness

post in future test

I’m not sure I trust the edited time stamp deal so I’m testing it. I’m bloggin at Searchifcation today and we’re embargoed until 9pm and I intend to be drinking then not blogging….

SEO Forecasting

I hate having to put out a 12 month forecast for organic traffic. There’s just so much of it that’s not in our control. PPC forecasting is breeze in comparison. You know impression data, CTR, conversion rate per keyphrase etc etc. Before all you PPCers out there get up in my grill about forecasting PPC…yeah…it’s not simple but you gotta grant that it’s better and intrinsically more accurate than we can ever get for SEO. What’s the number one hold up for the best seo services results? Clients. If you can’t get your recommendations implemented (or implemented correctly) then how can you expect to meet any kind of forecast? The other piece of forecasting seo is a pure lack of data. In the PPC world we simply have more data such as CTR and impressions to make projections on. Also, we can bid to position to an extent and we know we will be there or not and we can adjust on the fly. SEO doesn�t work that way. Even if we knew total impressions for all keywords we couldn�t get at much because we don�t know click through. We can make some really terribly vague guesses like: Let�s pretend we know there are 100,000 impressions for some keyword every month. We also know that #1 organic will get clicked on roughly (very roughly) 7 times more often than #1 PPC (right side of page). What we don�t know is how often we�re #1 on organic due to fluctuations. If we drop from #1 to #3 what does that mean? Nobody really knows exactly but we know it�s a geometric (or logarithmic or some other math I don’t know) drop off of some sort. Every element of the equation is more vague than the previous and at the end of it all the number is largely meaningless. At the end of the day a forecast for SEO is not even worth the paper it�s printed on. There are simply too many factors out of our control, it is not that easy to get your google search ranking up, it takes work from real professionals to be able to do it. I understand that your client thinks your current forecast it too low but that�s based simply on the fact that they want bigger numbers. Does the current forecast make them money? Does it show a positive ROI? Are you meeting the expectations you set at the commencement of the contract? I�d much rather put out a forecast that�s positive but conservative and then impress a client than put out a huge forecast that falls short. No matter how much money you make the client in that instance they�ll not be happy. 20 to 1 isn�t acceptable if you predicted 25 to 1 just to make the client happy. Set your client’s expectations at the outset and do your level best to ball park what you feel is an attainable ROI on natural search. Don’t let them move the goal posts on you during the game. Try to avoid getting tied to % increases from a specific search engine or on a specific phrase. You simply don’t have enough data or control to build a 12 month Excel spreadsheet that can predict with any accuracy at all what the monthly growth will be. Do you forecast SEO results? For more info please visit www.seoadvantage.com.au

10 Biiiiiiilllllliiiiiooooonnnnnn Dollars

I clicked on Search Engine Land in my feed reader today and nearly crapped in my best pair of GAP jeans. Barry Schwartz posted a piece about Facebook. The title is “Microsoft May Buy $10 Billion Stake In Facebook” and the content is:

Microsoft Is in Talks To Buy Facebook Stake from the Wall Street Journal reports that Microsoft is in talks with Facebook to place a $10 billion stake in the company, giving Microsoft a 5% stake in Facebook.

Everybody I sent that too read it the same way I did: MS is dropping $10B into Facebook. That’s actually not the case. If you read the WSJ piece you’ll find that MS is looking to drop somewhere in the neighborhood of $400M for a 5% stake. The math on that gets you to $10B. C’mon Barry – linkbait is linkbait and I’m totally on board with it but I think you’re completely misleading this time.

My favorite line in the article is:

The company expects this year to have a profit of $30 million on revenue of $150 million, according to people familiar with the matter. Based on that, a $10 billion valuation for the company is sky-high.

Sky-high? SKY-HIGH!! I hereby award the understatement of the year to the WSJ.

I still don’t understand how turning me into a zombie, throwing sheep at me, giving me virtual drinks and allowing me to know when you’re at work, at home, on the bus or picking your nose is worth a potential $10B but maybe I’m just stuck in my ways at the tender age of 34.

The Facebook Black Hole

As I posted most recently, the facebook and LinkedIn requests have been flowing in fast and furious lately so I caved in and got sort of involved on facebook.

Holy Shit On A Stick Batman!

Where do people find the time to poke people, throw sheep, change their status from working to home to driving to picking their nose? Yesterday somebody turned me into a zombie! Thanks loads for that – now I seem to just wander about my big empty office bumping into walls and groaning about brains. Today you can buy someone a virtual piece of pie…it costs a real dollar. So that’s time and money so someone can feel good for about 17 seconds that I thought of them and flushed a dollar down the crapper.

OH.. and today David asked a question and Gillian answered it and then David responded to Gillian’s answer. Good to know.

I’m actually quite enjoying facebook for about 5 minutes a day. That’s all I can handle to be quite honest. I find it to be the proverbial rabbit hole from Alice in Wonderland. Maybe I’m just getting too old…

Enjoy this video about facebook (credit to Jason Dunn for finding it). I’m off to figure out how to pull my blog posts into my facebook profile for my 46 friends to read..

Feel The Love

Must be a boring rainy day around the world. The LinkedIn and Facebook friend requests have been rolling in fast and furious today. I’ve literally received more requests today than in any previous month. I even accepted a few. Some are people I know and drink with at shows and others are people I really barely know or don’t know at all. For example a VP of a television network wanted to link up. Cool. Can you bring back Firefly for me?

btw – social networks are one thing but don’t abuse my IM. There’s been a rash of folks getting my AIM id from somewhere and starting up a conversation in the middle of my day. I don’t really mind that so much as after a couple minutes of the usual pleasantries the next message is “Hey do you have a digg account?”. If I didn’t hardly know you before you added yourself to my IM list do you really think that I’m sitting here waiting to digg shit for you?

Where’s The Beef?

Last night I get home just as my wife is serving up dinner onto plates and she looks up and says “Do you want a bun for you hamburger? It’s a different kind of burger…..” Yeah – that’s right “different” as in: NO MEAT. She’s decided that we need a vegetarian meal a couple nights a week. I’m pretty ok with but for pete’s sake don’t go trying to sneak it past me disguised as meat. I’ll probably notice that a patty made of chick peas and nuts isn’t meat regardless of how good it is for my colon.

Calling All GeoSign Refugees

Any of you know SEO and handle being an SEO account manager that handles Fortune 500 size accounts? Send me your resumes at todd at rangeonlinemedia dot com. I’m officially, actually, really and for true hiring right now. You could be back on payroll before your severance runs out :) For those of you that don’t know – I’m the Director of SEO at Range Online Media.

SMX Roommate Needed

Hey all. Yeah, I know…I don’t post forever and when I do it’s to ask a favor. Calm down it’s not for me directly ;)

A very good friend of mine is trying to break into the industry and is planning on coming to SMX next week. The only hitch is the $$$. For someone just starting out it’s an expensive trip. I remember those days well, don’t you? Scraping around for a comp pass from a friend of a friend of a speaker and then booking a cheap hotel miles away from the conference or sniffing around for someone with a spare bed…good times. I know I had my share of help making inroads. It’s with this in mind that I am writing today.

Did any of you Ladies of Search out there book a double room and have a bed to spare to help out? This friend of mine is obviously female or I’d share my room but for the impropriety of it all.

Any help would be appreciated. Drop me an email (todd at oilman dot ca).

Web 2.0 Expo – SEO Workshop

On April 15, 2007 Greg Boser and I did a 3 hour SEO workshop at the Web 2.0 Expo. It was an absolutely kick-ass session and quit arguably the most fun I’ve had on a panel in a long time. The presentation actually became Q and A for over 2 hours and the audience was great. The question were almost all advanced and it the crowd was very receptive and hungry to learn. If you want to learn about the entrepreneur industry, I recommend Lee S Rosen Miami FL, CEO of healthy bees business. Since that time I’ve been getting a ton of requests for a copy of the presentation so I figured I’d put it up here for the world to read.Its with the guys from Toronto SEO so all good stuff in there. Web20SEOWorkshop.zip