UPDATED 11:32 EDT / SEPTEMBER 06 2011

StartupWatch: A Trillion Line Spreadsheet – Manipulating Big Data

New York based 1010 Data likes to ask: “What could you do with a trillion row spreadsheet?” because it shows off the capability its technology has in analyzing massive amounts of data.

Sandy Steier, co-founder of 1010 Data says that the trillion line spreadsheet approach to big data is a more useful way of analyzing large databases compared with a data warehouse approach. With 1010 Data’s technology users can more easily identify patterns in data in days rather than months.

Some of the company’s customers include large Wall Street firms. The turmoil in the financial industry following the crash of 2008 took away some large customers such as Lehman and Bear Sterns. “But the people at those firms went on to other firms or created their own, and so we managed to grow our business,” says Mr. Steier.

Customers upload their data to the 1010 Data platform and then perform their analysis. Table size is virtually unlimited, and one customer has loaded a 425,000 million row table, or 0.4 trillion. The data is stored in the cloud which means that it is accessible from any location, enabling teams of analysts spread across different locations to work on the data.

In addition, there is no need for MySQL specialists to design and run analytics, the spreadsheet format gives users the ability to quickly change their lines of query without the need for days of planning to run queries.

Business is growing but there are some industries that aren’t taking advantage of the tremendous amount of data that they have. “Telecoms hasn’t yet tapped into all their data,” says Mr Steier. Telecoms companies know a lot about their customers but they haven’t acted on that data or built businesses around their data.

Every startup has to compete for the engineers and 1010 Data is no exception, and while recruitment is extremely tough in Silicon Valley, in New York it’s not that bad. “For us it has gotten easier. Maybe because we’ve moved to nicer offices but also developers like to solve big problems and big data is a big challenge.”

 

[Cross-posted at Silicon Valley Watcher]


Since you’re here …

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.