If I decide not to optimize the index, when will the deleted documents actually get deleted?

Document that are deleted really are in deleted. However, the space they consume in the index does not get reclaimed until the index is optimized. That space will also eventually be reclaimed as more documents are added to the index, even if the index does not get optimized.