I rescued a feisty female lovebird at age 2 1/2. Sure she was scared at first, but she came to trust me over time. My apt was quiet and peaceful, too, so she wouldn't stress. She would sit on my arm or leg, even in the beginning, but you could tell she was anxious. Your bird will settle down with regular interaction. My bird was out flying around for years, now she's just too old and can't see or fly well. Your bird will bond to you. And it sounds like you have a male bird, since you haven't mentioned feistiness. lol.
You will love lovebirds. They will steal your heart.