Big Data and Other Technologies

 

Currently Big Data is  synonymous with technologies like Hadoop, and the “NoSQL” class of databases like Mongo (document stores) and Cassandra (key-values).  Today it’s possible to stream real-time analytics with ease. Spinning clusters up and down is a (relative) cinch, accomplished in 20 minutes or less.

Now there are new untapped open source technologies out there.

STORM AND KAFKA

Storm and Kafka are used at a number of high-profile companies including Groupon, Alibaba, and The Weather Channel.

Storm and Kafka is said to  handle data velocities of tens of thousands of messages every second.

Drill and Dremel said to  put power in the hands of business analysts, and not just data engineers.

R

R is an open source statistical programming language. It is incredibly powerful. Over two million (and counting) analysts use R. R works very well with Hadoop

GREMLIN AND GIRAPH

Gremlin and Giraph help empower graph analysis, and are often used coupled with graph databases like Neo4j or InfiniteGraph, or in the case of Giraph, working with Hadoop.

SAP HANA

SAP Hana is an in-memory analytics platform that includes an in-memory database and a suite of tools and software for creating analytical processes and moving data in and out, in the right formats.