Mine love love love oranges and cherries. I slice most fruit in half or smaller so they can get a start on it.
The more varied veggies the better - everything offers different nutrients. I mostly throw all the veggies in the food processor and chop small - the canaries don't need that but the finches do, and canaries are fine with it.