While olives are versatile fruit, most recipes call for only a handful of olives. That means there will be leftovers. So you wonder: do olives go bad?