> We run into very interesting problems due to scale (billions of requests per month for our main public apis) and the large amount of data we deal with.
So, if you are handling 10 billion requests per month, that would average out to about 4k per second.
Are these API calls data/compute intensive, or is this more pedestrian data like logging or telemetry?
Any time I see someone having a rough time with a distributed system, I ask myself if that system had to be distributed in the first place. There is usually a valuable lesson to be learned by probing this question.
So, if you are handling 10 billion requests per month, that would average out to about 4k per second.
Are these API calls data/compute intensive, or is this more pedestrian data like logging or telemetry?
Any time I see someone having a rough time with a distributed system, I ask myself if that system had to be distributed in the first place. There is usually a valuable lesson to be learned by probing this question.