I think I would move the plant rather than try and get rid of the bees for several reasons and the main one being that the bee population has been decreasing over the past years and because of that as
headfullofbees pointed out - most people are trying to attract bees rather than get rid of them - apart from that, bees are extremely hard to deter and moving your plant would definitely be the quickest and be the easiest option.
You didn't say what kind of plant it is that you are considering moving but it doesn't really matter as almost any plant
can be moved whether it is in a pot or not - its only those ones that don't like having their roots disturbed - that are a little more tricky - but if in doubt you could always take a few cuttings beforehand - to make sure that you had a few replacements - just in case anything happens to the plant when you move it

If you were to let us know what type of plant it is that you are considering moving - then I'm more than sure that we would all - be very happy to give you some helpful tips on how to move your plant successfully - which as I said before is most definitely the easiest way of dealing with your bee problem.