Posts

Implementing Enterprise Data Lake using Amazon (AWS) S3

Image
Introduction & Background In the modern digital world, many of the smaller to medium sized organizations (even some good sized organizations) still stumble upon the problem of having ever growing data and strive hard to become a truly data driven organization while their underlying architecture for this purpose is not strong enough to help them achieve their mission. In this post, I would try to focus on that topic and thus the beneficiaries of this post will be all those Engineers and organizations who are just beginning to think of moving towards a solution that takes them away from their traditional data warehousing models while staying in the big data platform. In other words, who still use a lot of traditional DWH principles while they either already started adopting big data frameworks and technologies or just thinking of going in that direction and more specifically who are on the AWS platform. But it is not too difficult to safely rethink the whole approach in terms of

Installation of Apache Cassandra

Image
Cassandra is a massively scalable NoSQL database from the house of Apache which is widely used in several real-time implementations off-late due to its high performance capabilities. Thus, I would like to document a few simple steps on the installation of Cassandra in a Unix server. Cassandra can be installed by using multiple ways like, Using the RPM packages Using the tarballs of the binaries shipped Using the Debian packages We will focus on each of them briefly. Before we begin the installation, let's understand the prerequisites to install Cassandra. On your Unix machine, you will need the following packages installed. Java JDK 1.8 or later (Open JDK 8 is also absolutely fine) Python 2.7 or later (Even the latest update of 2.6 would give you trouble running Cassandra later) Once you have the above prerequisites installed on your machine, you can choose one of the above methods of installation.  Further, as Cassandra is mostly used in conjunction with Bi