Scalability and Realtime for Data Warehouses and BigData: 2nd Edition

The amount of data recorded, processed and managed has augmented at huge rates as the web age progressed, and as organizations became increasingly sophisticated and shifted from slow reaction times to acting quickly and proactively. The web increased dramatically the number of transactions and the speed at which transactions are done. Technologies and mechanisms evolved to handle the scalability and realtime requirements of the new context. There were advances in hardware and software, but also in the way data processing systems are designed. Data warehouses are the large repositories of historical data that needs to be processed, managed and analysed efficiently. This book describes data warehouse solutions to handle scalability and realtime needs of modern contexts. The mechanisms that should be used for scalability are studied, including foundations and most recent approaches that are also covered in the book. The topics of bigdata and the use of bigdata technologies in the context is also introduced. The book can be used as part of a Graduate Course Curriculum, as a reference for researchers working on the theme or by practicing engineers in both integrators and companies commercializing systems for efficient and scalable data management. It can also be used as a reference on parallel/distributed databases in an undergraduate course. It assumes basic familiarity with computer and software systems, databases and SQL, the kind of knowledge that would be acquired in introductory courses in those subjects.