Recently I've been holding my gaffs with a wooden clothes pin. I just shortened the ends and smoothed the ends with sandpaper. Then I wrapped some electrical tape (you could use masking tape) around one of the ends so you could distinguish with your hand in your pocket which side the shell was on the coin in the clip. It's easy to reach in your pocket, push the coin through the clip with your finger, then remove it from your pocket with some other ordinary change.
For instance, I might put a copper/silver coin in the clip with the copper side facing the taped side of the clip. Small metal binder clips from the office store seem to work too. I like the wood because it won't scratch the coins or click too loudly when the coins are removed. That's all, just trying other methods besides containers or purses. Besides, coins look more ordinary when I take them from my pocket with some other change.