That should actually be ok. As long as you are really gentle and make sure he doesn't struggle and get scratched up by your nails or something like that, that should be ok!!
Every once in a while I like to try and hold my Betta in my hand to feel his scales. I guess I just miss having a pet that I can actually pet, haha!
Oh, and I just noticed some people said to wash your hands before and after you touch him. But, do NOT wash your hands with soap right before you do this! I would just run your hands over very very hot water to get rid of any toxins or bacteria. Even if a tiny bit of soap gets on him, he could get sick! After handling him, then you can wash your hands regularly.
