It is safe, but I choose to only use it where the bird won't be able to chew it (inside a preening toy I make). It breaks down when wet which is a bonus! The other option was Food Grade silicone.
Out of over 400 toy designs I've made, that's the only one I can't get around using an adhesive.