Category
ruby/rails
-
04.28.10Detecting anomalous spikes in a line graph via sub-sampling and standard deviationWoah, what a title... What I want to talk about isn't as complicated as it sounds. Basically, in collecting daily site specific metrics for the purposes of SEO, you sometimes get some bad data from your third-party sources. These bad data points can skew your graphs and make it almost impossible to visually derive any useful information from them. For example: The graph above (click to expand) shows the number of pages for a 6 month date range. In early January the data spikes dramatically upwards. This is clearly an anomaly, as the day after, the data is back in its normal range. The ...
-
08.11.09Amazon S3 bucket limitSo, today I learned that Amazon S3 limits the amount of buckets you are allowed to have at any one time. This was a HUGE pain in the ass for me, as I just rewrote my S3 caching libraries to separate my caching into daily buckets. The idea I had was that I would keep 30 days worth of buckets before automatically shuffling all those buckets into long term archival at the end of each month. You see, Amazon S3 doesn't allow for folders within buckets (not technically, I'll get to that later), and I think it's bloody ridiculous for me to ...
-
05.28.09Rails: Mysql::Error: Lost connectionOne of my in development projects was getting triggering a ton of "Mysql::Error: Lost connection" errors recently, and I couldn't figure out the root cause of it. There are many of different reasons why this error can occur, and in my case, it was a reason that no one else has written about (that I could find), so I figured I'd post up the cause of my problem (and the solution). This application was on a shared development server with a few other applications. They all used the same mySQL server. One of my other applications had a corruption in a few ...
recent posts
- Detecting anomalous spikes in a line graph via sub-sampling and standard deviation
- Always question the numbers
- Quick and painless geo-location
- building a personal web dashboard
- Introducing STAT – Search Tracking & Analytics Tools
- Amazon S3 bucket limit
- Survey Says: Ipsos Reid presentation to BC Hydro on Social Network Marketing
