I found that learning about how they were implemented under the hood really helped. Actually it was studying languages and compiler design that I first encountered regexes. Knowing where they come from, and how they relate to grammars, DFAs, lexers, etc I think is a real help. It especially helps with debugging, since you can get into the mind of the regex so to speak.
