My cat has anal bleeding.?

I noticed that my female cat has been bleeding from her anus. Not major bleeding, but it seems like it only happens when she goes poop. Is this something I should be worried about?