The intersection of Cloud Computing and Big Data

• The two biggest trends of data centers today are cloud computing and big data, and this article will go into depth to verify the intersection between them. For users, big data uses large datasets from new and diverse sources to provide useful and practical information about how things in the world work.
• For example, Netflix can use customer data to produce featured programs tailored to each audience. For manufacturers, though, big data is an indispensable technology for handling large, diverse data sets. The manufacturer describes the characteristics of big data in terms of intensity, various forms and speed. How much amount of data is there, what kind of data is it, and how long will it take us to get there? 

Macro trends of big data 

Similar to the cloud that tends to macro behind it's service-oriented approach, big data also has some macro trends. 

• The first trend is Consumption. We consume data as part of our personal and everyday activities. From flight booking, finding a partner, diagnosing illness, data is driving more and more decisions than ever before. We live in a constantly changing social context where people always want to make decisions based on data.
• The second trend is Instrumentation. We always collect data in each of our operations, and this is done in large part by machines, rather than humans. From supply chains to Fitbits, we collect information about our own activities for the purpose of measuring and analyzing them.
• The third trend is Exploration. The relatively simple access to this huge data warehouse means we can use it to build, test, and conduct experiments that were previously impossible.

Finally, Big data brings a new point in the relationship between us and data, and according to the specific idea in this article, that new point is seen compared to cloud technology. 

The relationship between Big Data and cloud computing 

• So what is the relationship between big data and the cloud? Big data comes from the cloud. Apache Hadoop, one of the most popular big data technologies today, is built on a research basis from Google and first deployed at Yahoo. Initially, Google invented this technology because indexing Web pages was impossible with the system at the time. Now companies using Hadoop are bringing cloud architecture into their data centers.
• The simultaneous rise of both cloud and big data is not exactly a coincidence. In fact, they support and perfect each other. The expansion of the cloud is constantly promoting the creation and operation of new big data technologies through saving and simplifying access to storage systems and computer resources. Big data architectures also play an important role in this trend. A specific example of the recent improvements in the Apache Hadoop ecosystem has allowed a large amount of work to be shared and executed on the same cluster. Users will be able to run multiple types of architectures on the same Hadoop cluster, and this cluster will be launched on a cloud architecture. As big data architectures are becoming more and more similar, cloud architecture will add more specialized services for data storage, processing and analysis.
• The combination of big data, cloud computing and new algorithms in information rendering makes convergence analysis - conducting analysis on data from different sources possible. These new technologies that support data transport and management also enable the development of cloud-based Analytics as a service (AaaS).
• From the security and privacy models to the pricing model, the combination of big data and cloud computing also has a significant impact on non-technological aspects of life. There is a contradiction between the desire to focus on convergence and cloud computing, because the cloud is more about sharing more data and computing resources more about the access, and the need to control security. personal data and data privacy more closely. The usage-based pricing model is leading us to think differently about how to produce and use technology. Future research will look at applications in the economic and political fields developed from modern advances in this technology.
• Not only that, the next research will test how people use these trends together, the development of big data on the cloud, and the way we are using data to improve. cloud pros.