If your handles are of a very good hard wood ( IE Oak) you can tap the wood itself. Go slow and use soap as your lubricant.
I know, it sounds strange, but I did it several years ago and it they're holding strong. Obviously, over torquing will ruin your day.