Scaling problems
We’ve spent the last month (or more) working on scaling our architecture. The site would be slow a lot, and we’ve turned off generating thumbnails for the past 3 weeks. Butt after a lot of hard work, we’re finally confident that we’ve resolved 99% of the problems.
Soon we’ll hav thumbnail generation back, and the site is (and has been for a few days) zippy again. We learnt a lot. It turns out that if you create an aggregator, you run into scaling problems. I ended up reading a lot about how Bloglines, Technorati and others approached this. I bought the excellent book “Building scalable websites” by the Flickr guy.
On we go!
See more in:No Tags
