With their small, silvery, gray-green leaves, olive trees make beautiful houseplants — just make sure to give them the right conditions. These Mediterranean plants need a lot of bright, direct sunlight. South and west facing windows are ideal, and grow lights will definitely help in the winter.