Charlie and the Fish Sandwich

I just ate leftover fish...on a sandwich. My cat YOWLED at me the entire time I was heating, assembling, and consuming said sandwich. He is now sitting with his back to me (which he NEVER does) as if to say, "I didn't want your fish anyway!" Should I give him a piece?