Answering calls on QuietComfort?

I'm having a problem answering calls from my QuietComfort headphones. When a call comes in and I press the multifunction button, I hear a tone, but it doesn't pick up the call. If I hold the button down for a couple of seconds, it rejects the call. (So, I know the button is working!)

Any ideas?