UPDATED 12:41 EDT / NOVEMBER 01 2012

NEWS

Taking a Peek Under the Hood of LiveJournal

Social network and blogging platform LiveJournal has been around a long before Facebook came to be. In the early years of its existence the company had to implement an invite code system that curbed its user base, simply because its infrastructure couldn’t keep up with membership growth.

A lot has changed since then. LiveJournal expanded to hundreds of servers, but as the environment grew more complex similar issues associated with scalability and data protection started to emerge. The company developed its own software to tackle these issues, and eventually open-sourced it – a move that helped kick start a whole new trend in the enterprise. All these factors make the firm a very good example for an entrepreneur who’s looking to start a web-scale business.

LiveJournal had to solve a lot of challenges before it could get its operation going at full swing. Achievement persistent connection was an issue, along with single points of failure, and other performance related barriers.

To solve these the social network took a parallel approach, and removed bottlenecks by spreading out reads and writes, splitting up jobs, allocating storage more efficiently using DRBD and improving caching. It achieved the latter by creating a tailor-made solution called memecached, an in-memory key-value store that has picked up a lot of traction in the open-source world.

The hard work of LiveJournal’s internal IT department (including Brad Fitzpatrick, who discussed this topic more extensively in a session founded here) produced several tips worth taking into consideration; parallelization, for one, is key to scaling. And so is taking care of the low level issues that have a tendency of rearing their ugly heads once a cluster has reached its critical mass.

Lastly, the engineers also learned firsthand that getting a better feel for the purpose a system is supposed to serve – powering a social network in this particular case – makes things easier across the board.


Since you’re here …

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.