Once you are certain that they are all dead, you have to remove the nest. If it is hanging from a tree or from a roof, knock it down and burn it. However, if the nest is on your siding, it is wise to get a professional to remove it. The chemicals that you could use to get rid of bees are Baygon, MicroCare, or borax dust.