Stats and logs from external sites

[garnercx]

Would the current issues described in the locked announcement "Stats and logs from external sites" explain why the "top caches by find" stats graph for Victoria for all sources works, but the same stats graph for Australia for all sources does not?

Specifically, these:

http://geocaching.com.au/stats/graphs/a ... s_by_finds - works
http://geocaching.com.au/stats/graphs/a ... s_by_finds - doesn't work

[caughtatwork]

Capacity is the simple answer. There are some 10+million logs to collate and the machinery runs out of memory. If you have a spare $15K we can fix that problem:-) On a more serious note, we do know about these and we're waiting until the situation declines a bit more before spending our hard earned (and donated) monies on new equipment. We will be up for about $15K for new equipment which is not a small sum.

[mtrax]

Sorry is it memory or CPU or both?
Or architecture eg 32/64 bit etc..
Or another box to split off these large queries?

I remember Groundspeak spent a lot of money optimising there SQL, is it possible here too?
I don't mean the spending part .. The research into database systems

[caughtatwork]

Fundamentally the issue is RAM. We exhaust it when running very large queries. We end up writing a lot to disk and I/O wait time to the disk is, on some days, appalling. More RAM and faster disk will resolve the issue. A RAM upgrade on our current architecture won't work as we're on a 32bit architecture and the machine will only handle 6GB of RAM in the slots on the motherboard.