Posts Tagged ‘Big Data’

The SEC’s Office of Compliance Inspections and Examinations (OCIE) is responsible for protecting retail investors and assessing market-wide risks, but now is shifting its attention also toward figuring out how to leverage data analytics to identify potential for illegal trading activities, conflicts of interest or other misconduct, according to a recent article by ThinkAdvisor, Compliance Data Analytics: Do […]

It is no secret that Big Data is involved daily with social engagement, advertising, mobile applications, and business intelligence in today’s enterprise. As much data that an enterprise would like to receive from customers, even more data needs to be ingested from the cloud, commerce sites, transactions, social feeds, geo-locations and on. In between the […]

IBM plans to pour more of its technical wisdom into the world’s second largest and second most-populous continent. The multinational tech company has announced it will spend $60 million over three years on expanding its technical training efforts in Africa. Central to this expansion will be a special partnership between IBM and an online education […]

In some aspects, the Spark engine is similar to Hadoop because both of them will do Map & Reduce over multiple nodes. The important concept in Spark is RDD (Resilient Distributed Datasets), by which we could operate over array, dataset and the text files. This example gives you some ideas on how to do map/reduce […]

Data modeling in Cassandra is a little tricky and requires a combination of science and art.  Think of the Cassandra column family as a map of a map: an outer map keyed by a row key, and an inner map keyed by a column key. Both maps are sorted. To maximize Cassandra’s capabilities and for long […]

From commerce to personalization to cybersecurity to the customer experience, the consumer markets industry is experiencing a huge transformation this year driven by these types of trends. Organizations must transform complex data into seamless and simple operations all while gaining customer insights and services responses. Consumers are more connected than ever due to mobile, social […]

As More companies’ debate on adopting a Big Data Solution. Some of the discussion that comes across is whether to use Hadoop or Spark, NoSQL database or continue using their current RDBMS. The ultimate question is “is this technology for us?”  NoSQL database are highly scalable, provide better performance, designed to store and process a […]

Exponential growth of data is a common trend across all industries, along with the need for insights from that data. We’re seeing a large portion of data growth and complexity from the prevalence of devices, mobile, Internet of Things and cloud. Data management and analysis is no longer a competitive advantage, it’s a business necessity […]

Big Data is one of the enabling technologies for companies to digitally transform either their operations and/or customer  interactions.  However the open source world can be complicated, especially in the red hot Big Data arena. There are a myriad of technologies; some compete with one another, others overlap, some are complementary, and worse of all, […]

Previously, I reviewed why Spark will not by itself replace Hadoop, but Spark combined with other data storage and resource management technologies creates other options for managing Big Data.  Today we will investigate how an enterprise should proceed in this new, “Hadoop is not the only option” world.  Hadoop, Spark, Cassandra, Oh My!  Open source Hadoop and […]

Yesterday, IBM threw its weight behind Spark. This announcement is significant because it is a leading indicator of a transition from IT-focused Big Data efforts to business-driven analytics and Big Data investments. If you are interested in learning more about this announcement and what it means in the bigger picture, I wrote a blog entry on our […]

  Right after I posted my blog on Spark and Hadoop, I came across this article. IBM made a big announcement that they are putting their weight behind Spark.  They are committing more than 3,500 developers and programmers to help move Spark forward. This combined with significant support from the Big 3 Hadoop distributors (HortonWorks, Cloudera, […]