How to Remove Previous Audience Members from Campaign?

Hi,

I started a campaign with one audience, then stopped the campaign and added a different audience before starting it again.

However, in both the Campaign and Bulk Email audience tabs, I can still see the previous audience members along with the new audience.

Is this the expected behavior? If not, how can I remove the previous audience members so that only the current audience is included?

Thank you