Personally, I think color matched handles look much better. Some cars pull of the black trim very well but painted black and unpainted are not going to have the same look. If that's the look you're going for I would just replace them with unpainted pieces. If you do decide to paint them, you'll have to sand and primer just like any other paint job.