c'mon, mice are so cute. you aren't going to be setting an example to other mice by killing this one, so i'd suggest you just get rid of him in a nice way. for instance, catching him and driving him 5 miles away, then letting him go outside.
mice are too cute to kill intentionally. besides, you know when you picked up his poor little lifeless body, you'd feel terrible about it.