New Twitter Discover Tab Brings Improved Personalization Algorithms and Real-time Indexing

Over the coming weeks, Twitter will be rolling out a redesigned and more personalized Discover experience on Twitter.com, iPhone and Android."We've incorporated additional personalization signals to select Discover stories, including Tweets that are popular among the people you follow and the folks they follow," posted Twitter.The Discover tab makes it easy to discover information that […]

Over the coming weeks, Twitter will be rolling out a redesigned and more personalized Discover experience on Twitter.com, iPhone and Android."We've incorporated additional personalization signals to select Discover stories, including Tweets that are popular among the people you follow and the folks they follow," posted Twitter.

The Discover tab makes it easy to discover information that matters to you without having to follow additional accounts.

The Discover tab's new design shows who tweeted about particular stories.

"You can click "View Tweets" on any story to see popular Tweets from your network or recent, relevant Tweets directly below the story summary. This social context helps you understand why each story matters to you and makes it easier to join the conversation. You can reply, retweet or favorite these Tweets, or you can "Tweet this story" to share your own perspective," Twitter explains.

twitter discover tab: improved personalization, real-time indexing

Twitter notes, the new Discover tab is powered by Earlybird, Twitter's real-time search technology. Explaining behind-the-scenes of new Discover tab, the company says,

"When a user tweets, that Tweet is indexed and becomes searchable in seconds. Every Tweet with a link also goes through some additional processing: we extract and expand any URLs available in Tweets, and then fetch the contents of those URLs via SpiderDuck, our real-time URL fetcher.

To generate the stories that are based on your social graph and that we believe are most interesting to you, we first use Cassovary, our graph processing library, to identify your connections and rank them according to how strong and important those connections are to you.

Once we have that network, we use Twitter's flexible search engine to find URLs that have been shared by that circle of people. Those links are converted into stories that we'll display, alongside other stories, in the Discover tab. Before displaying them, a final ranking pass re-ranks stories according to how many people have tweeted about them and how important those people are in relation to you. All of this happens in near-real time, which means breaking and relevant stories appear in the new Discover tab almost as soon as people start talking about them."