Let's get back to the roots of condyloma:
"Condyloma is an infectious disease, usually transmitted by direct sexual contact, that is characterized by the presence of warts caused by the human papilloma virus (HPV). These warts may be found on the genitals, mucous membranes of the mouth, near the anus, or in the rectum."
Just removing warts is no guarantee. Usually the treatment involves also taking a cream for at least one to two weeks to make sure all (invisible) spots are also treated.
They have a tendency to come back if they are HPV warts. Or you just reinfect each other through unprotected sex. So first of all you should protect yourself if you feel insecure about the warts and surely if both of you are infected until you're totally clean. These warts are very infectious, more than the HIV virus.
You should go to a specialised doc or sexual health clinic together with your bf and get you both checked out and correctly treated.
I know, been there, done that... and from experience it can be long to get rid of and painful when it's anal...