Have a Bone to Pick with Someone

Definition: something that you say when you want to talk to someone about something he/she has done that has annoyed you 
 

Example:

I have a bone to pick with you. Did you eat that chocolate mousse I was saving for my tea?