Yes חשד Or No חשד?

The gemara says that if one has two entrances to his courtyard, he must light in both of them for if he lights in only one entrance, people who pass by the second entrance will [mistakenly] suspect him of not lighting. In order to prevent חשד - suspicion, we require him to light in both places. So we see that we are concerned with חשד - [mistaken] suspicion.

Why then is the halacha that כבתה אין זקוק לה - If the candles extinguish, he is not required to rekindle. Why not? What about the חשד of people who see an unlit menora??