Now you are getting tricky, Big V!
I have had a pretty rugged life where many people who loved me (and I loved) let me down. Proved not worthy of my trust but I loved them for what they were. They did what they thought was best.
Now I try to love or have compassion for "many" but am aware that only "few" are really trustworthy in regard to me.
Hence the "paddling of my own canoe" = I go my own way, not someone else's.
Which means, kind Sir, if you came aboard,you would paddle while I would steer
