I'm 6'2" and have big hands. The Note4 looks like a normal phone in my hand.
We have a Vietnamese guy here that is 104lbs. (I think my legs weigh that much each) He's maybe 5 ft tall. He has a new
Samsung that he really likes. It's super light and about the size of an iphone. I have found the Samsung phones to be far superior to any of the motorola, nokia or LG phones I've had.
maybe have a look at that S5 mini.