Top Stories

This Week in Big Data: New Software, and An Analytics-Ready Mainframe

This Week in Big Data: New Software, and An Analytics-Ready Mainframe

There were a few major developments this week, three of which were product launches. The most significant of these may have been Pervasive’s DataRush debut, a software solution that could help enterprise boost Hadoop efficient for a reasonable price. On its own Hadoop skirts 20 percent server utilization.  This is extremely low in comparison to the excess of 50 and 60 percent that can be achieved with virtualization. Users have the option of amending this by using vSphere, but right now one license is required per node – an expense that not many enterprises are willing to accommodate.  This week, however,... more »
This Week in the Cloud: VMworld, Cloud Lockers and OpenStack

This Week in the Cloud: VMworld, Cloud Lockers and OpenStack

This week’s biggest highlight by far was VMworld, one of the most popular trade shows in the industry. The big emphasis this year was on the software-driven data center and simplicity, and both VMware and the other vendors that exhibited at the event managed to deliver big time. VMware itself debuted the newest version of vSphere. The complicated and fairly detested vRAM-based pricing model has been taken out of the loop, and the web-based client for the software has replaced the Windows version.  V5.1 centralizes backup and replication for the first time, and doesn’t require customers to buy a Windows license... more »
AI On The Rise: Defeating CAPTCHA, Combating Fruit Flies, Traffic Control Teaching Assistants

AI On The Rise: Defeating CAPTCHA, Combating Fruit Flies, Traffic Control Teaching Assistants

Artificial intelligence is on the road to breaking the whole CAPTCHA system. The question that follows is: how are we going to prove we are humans then? According to a Forbes.com article, hackers who are trying to defeat CAPTCHAs are essentially creating programs to think like humans. To counter this, companies will tend to generate and invest on more sophisticated Turing tests in order to secure their sites to being invaded by bots. Although playing like antagonists, hackers and companies are pushing forward to the evolution of AI. CAPTCHA which stands for "Completely Automated Public Turing test to tell Computers and Humans Apart" is the system... more »
Cloud Foundry Panel Says Software Defined and Automated Data Centers Will "Rock the Economic House" [VIDEO]

Cloud Foundry Panel Says Software Defined and Automated Data Centers Will "Rock the Economic House" [VIDEO]

John Furrier continues SiliconANGLE’s exclusive VMworld coverage with a panel on Cloud Foundry. James Watters, VMware Director of Cloud Foundry and Lucas Carlson, Appfog CEO, discuss their experiences and perspectives on how the DevOps world changed with the changing demand of cloud, big data’s impact on the cloud,  top uses cases for PaaS clouds, whether platform as a service is really a “race to zero,” and the overall value of multi-cloud. The panelists conclude by discussing their biggest surprises and prediction for future disruptions in the industry. Noting excitement for the public cloud, Furrier, asks how big data has changed the... more »
Yet Another LulzSec Member Arrested Over Sony Hack

Yet Another LulzSec Member Arrested Over Sony Hack

A second person believed to be a member of LulzSec, a notorious hacker group allegedly involved in several high profile cyber attacks like the Sony Pictures breach last year, was arrested. Days after a federal grand jury returned an indictment charging Raynaldo Rivera of conspiracy and hacking, he surrendered to the authorities.  If convicted, he could be facing up to 15 years imprisonment. The indictment accuses Rivera and co-conspirators of using “SQL injection” attack to steal information from Sony Corp's Sony Pictures' computer systems in May and June 2011.  They claim to have stolen over 1,000,000 user accounts containing personal information such... more »
Developers Worry "It’s Expensive To Do Business With Facebook," Jump Ship to Mobile Games

Developers Worry "It’s Expensive To Do Business With Facebook," Jump Ship to Mobile Games

The community of developers is being scared away by the high cost of putting their games on Facebook. According to a statement posted in Los Angeles Times, Facebook gets 30% shares from game developers and 20% is dedicated for high marketing costs. This clearly snatched 50% revenue for developers. "Facebook is still a viable platform for independent developers looking to make money on a game," said Mitch Lasky, a venture investor at Benchmark Capital who specializes in game companies. "However, companies with aspirations to be larger publishers - Kabam, Kixeye, even Zynga - are moving aggressively off the Facebook platform to... more »
Super Computers Help New Orleans Prepare for Hurricane Isaac

Super Computers Help New Orleans Prepare for Hurricane Isaac

For those living in New Orleans, we have a relatively good thing to share, as researchers at university supercomputing centers in Texas and Louisiana are working on Big Data-driven supercomputers that will quickly map mapped the weather data changes and how the storm surge will invade coastal regions and neighborhoods. These researchers are working to inform emergency planners about what will happen once the hurricane sends water into canals and levies. Rice University is doing a very similar thing with their Risk Calculator that also uses big data analysis of past events and current civic structures combined with knowledge about the... more »
No thumbnail available

Apache Drill to Provide SQL-Like Fast Answers to Specific Questions from Hadoop Databases

In what he terms “yet another example of the remarkable innovation occurring in the open source Big Data Community,” Wikibon Big Data Analyst Jeff Kelly writes that a small group of committers is developing an open source SQL-like query tool for Hadoop databases called “Apache Drill”. Designed after BigQuery, Google's Big-Data-Analytics-as-a-Service technology that it made publicly available in May, Apache Drill is meant to compliment MapReduce, allowing business people to get answers to specific questions such as “what time of day is most popular for app downloads” from Apache Hadoop Big Data databases directly in seconds. MapReduce, by contrast, is a... more »
SQL Injections: How To Avoid Getting a Dose

SQL Injections: How To Avoid Getting a Dose

Anytime a value is placed on something, one has to note that at some point in time others may want it. Not only will someone want it, but someone might use covert methods to obtain it. This of course not foreign to the web and the vast amount of valuable information it contains. A malicious hacker may be trying to obtain passwords, pin numbers, credit card information, and the like. While there are various methods that these hackers can use, one that has a noted increase is SQL injection. Put simply, a SQL injection is an injection of code into a... more »
Paranoid Russians Develop Home-Grown Tablet Device Powered By RoMos

Paranoid Russians Develop Home-Grown Tablet Device Powered By RoMos

Fed up with having Americans spying on their every move, the Russians are now going the way of North Korea, developing their very own tablet device that boasts a high level of encryption, an Android-like OS,  and a home-grown global position system. The device, which was unveiled yesterday at the IFA in Berlin, was developed by a team at Moscow’s National Nuclear Research University, was developed in response to concerns from Russian defense chiefs that data collected by Google (as happens with all Android-powered devices) could find its way into the hands of US government officials, exposing some of their most... more »

Premium Research

- David Floyer

Cataloging and automated policy management are the key enablers of a virtual flash world, where storage snapshots are both King and Knave. Combining cataloging and automated policy management is the only solution to enabling storage copy reduction in harmony is risk management and compliance. This enables and justifies an all-flash data center, enables data to be available quicker to the business and other IT functions, and drives greater business and IT productivity and responsiveness. CIOs and senior management should create a small team of the best and brightest, create an optimized all-flash virtual environment with a programmatically integrated catalog in a subset of the datacenter, and demonstrate the practicality and benefits of this environment to the business and IT.

- Stuart Miniman

VMworld has grown to be one of the largest and most important technology industry events. Wikibon has attended this event for many years and will have its largest presence this year as part of a double-set of theCUBE. Coverage will examine the broad and diverse ecosystem including storage, cloud, networking and much more.

- David Floyer

Wikibon believes latency storage vs. capacity storage is a key storage dimension, with different functional requirements and different cost profiles. Latency storage is found within the datacenter supporting more active applications, and in general has a high read bias. Latencies can vary from 1 millisecond down to a few microseconds; the lower (better) the latency the closer to the processor resources it is likely to be. It is also found for the metadata layer for capacity data. The boundary for latency storage will reduce down to 500 microseconds over the next three years. Capacity storage is found in archive, log, time-series databases for the Internet of things and many other similar applications. In general it is write-heavy. Latencies are generally above 1 millisecond, do not have to so close to the processor, and are suitable for remote private, public and hybrid cloud storage. Some parts of the capacity market place will have latencies as low as 500 microseconds over the next three years. Wikibon has added this dimension to the other storage dimensions projected, which include HDD vs. Flash, Hyperscale Server SAN vs. Enterprise Server SAN vs. Traditional SAN/NAS storage, Physical Capacity vs. Logical Capacity and SaaS Cloud vs. IaaS Cloud vs. PaaS Cloud. All these dimensions are projected for both Revenue and Terabytes. There is a strong correlation and interaction between the latency/capacity dimension and HDD/Flash dimension. Wikibon provides detailed breakdown of the storage projections for Premium clients.

- Brian Gracely

With the EMC Federation in transition, VMware needs to take a greater leadership role in delivering cloud services. VMware's ability to lead their customers transitions to Hybrid Cloud requires them to deliver a more robust, more agile vCloud Air platform.

- Brian Gracely

While the majority of Enterprise CIOs continue to have Hybrid Cloud near the top of their priorities, the solutions in the marketplace often fall short of expectations. Wikibon analysts look at the state of Hybrid Cloud from a C-Suite perspective.

- Ralph Finos

Maturity by industry is a function of customer and prospect skills, competitive drivers within the industry, the nature of the data in question as well as the complexity of the analytics required, and most importantly the problem that the prospect or customer is trying to solve. Identifying where customers are in their journey and helping them to reach the next level is key to vendor success.

- Ralph Finos

Both customers and vendors need to prioritize how they address adoption barriers. As with all emerging technologies, a full solution will often require extensive 3rd party participation, such as “data wrangling” and SQL data access tools. SQL data analysis offerings are maturing rapidly in the areas of application performance under greater user and data volume loads both from the Hadoop distribution vendors as well as 3rd parties. Other barriers, such as a skills gap across many roles, are more intractable. Smaller customers with fewer specialized practitioners in each role should include in their evaluations cloud-based solutions that are fully managed services.

- George Gilbert

Across all the primary roles involved in adopting Big Data applications, there are basic gaps in product maturity. However, IT leaders and practitioners should keep in mind that Big Data databases are part of a relatively immature ecosystems that requires advanced skills and integration technology in order to operate successfully. The ecosystem is evolving and maturing rapidly and there is a tremendous proliferation of technologies to augment early products.

- Brian Gracely

Wikibon Research has forecasted Public Cloud revenues from 2015 through 2026; with the expectations that 33% of all IT spending ($500B) will move to Public Cloud services within the next decade. The impact this will have on IT vendors and IT strategy will be significant as more applications focus on mobile and real-time data analytics.

- David Floyer

The premise of this research is that NAND flash storage will replace the majority of traditional magnetic drives as the primary storage media in enterprise data centers and hyperscale cloud services over the next 10 years. Flash Capacity shipped is projected to grow from 1,000 times less than HDD in 2012, be about equal in 2018, and grow to be about 1,000 more than HDD in 2026. CIO and senior storage executives should be planning to move from HDDs to NAND flash storage over the next few years, and plan completely different organizational and operational environments. The ability to provide multiple logical views of the same physical data will be a key capability that will significantly simplify data movement and significantly reduce costs. Most magnetic storage for enterprises will be found in distributed cloud services for mainly archive-type applications.