That doesn't seem that great of an idea since you can just pick Rek'sai, do the same thing starting at level 3, and still have the ability to efficiently farm your own jungle if gank opportunities aren't showing themselves. 30 gold per camp is a pretty significant amount to be giving up by having your laners take the jungle farm instead of the one holding a machete, and you'll probably just continue to fall behind if you don't clear your jungle while waiting for a decent opening to affect your lanes.
That said, maybe Bard really is a jungler at heart. I'm just not a fan of the idea of ignoring your own jungle in the name of continuous gank attempts.