Leave it for now so that it can get larger and you can identify it. It can be cut down anytime it truly gets too large.
If you are determined to remove it immediately, at least try to dig it up alive and repot it. Do grow it larger, so you can to identify it.
Removing a plant before identification is a mistake. It could be something very fine and interesting, and in any case, you'll never learn what it was, which retards your own knowledge.