Rosemary will grow indoors, but it usually gets too big for windowsill gardening, and really needs quite a bit of sunlight. Garlic chives will grow anywhere, anytime. A pot of those on a window sill will give you fresh garlic taste, but they aren't to be cooked with. Just chop them and use them as a last-minute addition or topping. Basil needs to be harvested frequently if grown indoors. Otherwise, it tends to get leggy. Oregano, especially the Greek oregano, adapts to indoor growing. It is a somewhat prostrate herb, so you may need to clip it frequently to keep it from crawling all over!