This post will focus on how we shall design a cloud system inside Azure and AWS that needs to handle objects with the state changing very often. Proposition I want to have a system that can store objects in a storage with a flexible schema. A part of the objects are updated every day and queries are per object. Aggregation reports are done inside a data warehouse solution, not directly inside this storage. Requirements Let’s imagine a client that needs a cloud solution with the following requirements: 500M objects stored 1M new objects added every day 10M objects state are changed every day Update operation shall be under 0.3s Query per objects shall be under 0.2s 30M queries per day that check the object state Dynamic schema of the objects Except for object state, all other attributes are written one time (during insert operation) ...
DREAMER, CRAFTER, TECHNOLOGY ENTHUSIAST, SPEAKER, TRAINER, AZURE MVP, SOLVING HARD BUSINESS PROBLEMS WITH CUTTING-EDGE TECHNOLOGY