You should never pay fees on your credit cards; whether it is interest charge, late fee or even annual fee.
Just use common sense and a little discipline. Credit Card Fees are Simply Useless.
Switch To a No Annual Fee Card
You rarely can take advantage of additional features provided by credit cards with annual fee. Just ask your financial institution to switch to a no annual fee credit card.
The only reason you should pay annual fee is if you can get an immediate monetary advantage than is greater like a cash reward program. But remember that many no annual fee cards can still offer you competitive cash rewards.
Beware Additional Card Fee
Also pay attention to additional cards for your spouse or children; they often cause additional annual fee that must be avoided.