Green olives are harvested before ripening and coloring but after they have reached the right size. Color-changing olives are harvested as they ripen and black olives are harvested at full maturity.