The seemingly endless media and industry fawning over Twitter has led to the widespread debate over the merits of real-time search and the future of the search industry. Yes, Twitter is an amazing service that allows people to share their thoughts, however poignant, painful or pointless, about events as they happen. The hype, however, is reaching a fever pitch only exacerbated by Google acquisition rumors. With that in mind, it’s time to try to determine exactly where this wonderful new medium belongs in the world of search.
There’s no question that the Web is getting crowded with content. The user-generated era is spawning such a huge amount of data that it’s nearly impossible to find anything with traditional keyword-based search anymore. The ideal search should be personalized and capable of referencing search history, relevance, social bookmarking, micro-blogging and contextual relevance with each search. Google has been working on this semantic Web model for a while because it will theoretically allow search engines to tell you what you’re looking for before you try to find it. As Twitter has created an online collective consciousness on virtually any topic, it makes sense that as Google labors toward its Web 3.0 ambition to organize all of the world’s data it would be interested in this new data stream. Real-time search is the catalyst to this goal, a cultural paradigm shift, but data without context is useless, and this is where Google excels.
Searching real-time content in its current state finds millions of stream-of-consciousness rants and blurbs that are largely irrelevant in their raw data format. Though given the right context on the aggregated whole based on desired filters, it could provide real-time opinions, sentiment and behavioral data. If Google finds a way to track it back to the Web search, it could be one of the aspects that help the semantic prediction model.
As online utilities, tools and content are created daily, search must adapt as well. Many people seem to think that Twitter will become the de facto medium of the common voice. This isn’t true. How does a 140-character opinion replace a full-length article on Wikipedia, a 30-second video spot, a corporate site or even financial or stock information? Humans interact with different channels because of varied contextual factors; relying on Twitter as the be-all and end-all simply isn’t realistic.
Twitter is a single service, not the final piece of the puzzle for Google as an increasing number of companies publish real-time, user-generated content. A comprehensive real-time search engine would need to monitor a host of user-generated content from sites including Twitter, FriendFeed, Plaxo, Loopt, Brightkite, Facebook, LinkedIn and MySpace as a baseline. There are companies already doing this, but it’s still data with no context for the most part. These companies are currently charging for their services, but it’s only a matter of time until someone like Google taps into this and makes it available for free.