If you have a complete security suite such ESET Smart Security or Kaspersky Internet Security, you don't need to leave Windows Defender turned on. It can help, but it will also eat additional resources.
If you leave UAC enabled and you have a professional security suite, Windows Defender is completely optional.