Abstract:
The purpose of this paper is to delve into the evolution of the data paradigm in this information age, where data has truly exploded to Terabytes and Petabytes. From an enterprise perspective, this is both a challenge & an opportunity to tap into the new data sources. These data sources are referred to as Big Data. The existing data warehouse technologies cannot handle this data glut and will require adaptation.
Therefore, data warehousing and big data technologies complement each other to derive maximum use from the hitherto untapped area of unstructured and semi-structured data getting generated endlessly in the Internet, sensor technologies etc. We will see the basic Big Data architecture around Hadoop and also the testing approaches in a Hadoop system.
