I agree that welfare should only be given to those who truly need it. I think it harms the recipient far more than it harms society as a whole.
On the other hand, don't count on fixing welfare to make a big dent in your tax dollars (in the US). Do a google search for "government spending pie chart" and/or "government spending welfare".
I found
this interesting. I know they have a bias, but it's certainly not hidden. They also supply the sources for their figures.