I would remove the peel and the seeds. You have no idea what has been sprayed on the lemons unless they come from your backyard or are 100% organic and you are positive about that. I've never given lemons to my birds, though, and I have a lemon tree in the backyard. I just feel they are too acidic.