Data systems are the infrastructure that collects, stores, and allows access to data that is used by organizations. Data systems can include the database system (DBMS), warehouses, specialized platforms like NoSQL databases, and alternative storage models for data such as file systems and cloud object services. They could also include master data management, which creates a common set of reference data for an organization and its products, customers or other assets.
Volume along with variety and velocity are the key features of a data management system. Volume refers the amount of data being processed, typically in huge and complex data sets that cannot be handled by one computer. Variety refers to the various types of data being gathered from sensors as well as feeds from social media and other sources. Velocity refers to the speed that data flows into and out of the data about his system.
These four characteristics have led to the development of innovative and new data systems. Alongside the traditional databases and DBMS technologies there are now a variety of new data platforms that can handle a large range of data.
A big sensor data systems, for example is a networked system comprising devices and sensors that collect a vast variety of information from physical sensors, such as smartphones or wearable medical sensors. The sensor data readings contain location, signal or image information as well as timestamps. The data is stored on the device before being sent to the central server. The data is then subjected to preprocessing to ensure that the resulting data is accurate and reliable for analysis and processing.