Super short version: it's a combination of individual user taxonomy (organizing your account's contents) and global/site-wide discovery ("find people talking about X") and the two functions are very very different (and have very different needs), so the conflation of the two means that it doesn't work well for either purpose and it results in viciously pitched social battles between the two camps of how people use them ("don't tag ur hate", etc).