Well without its uploaders using multiple video sharing services or some massive amount of mirroring, you have to go there to get the content that was hosted only on Youtube. Not strictly because "everyone else goes there", but because everyone else goes there, it's necessary in order to find the content you're looking for, or to have a larger pool when searching for content.