Your body goes into a fight or flight response when you are stressed. This response causes the production of chemicals like cortisol and adrenaline, which can lead to a reduction in sex drive. Stress can also impact your mood causing anxiety and depression. Practice stress management techniques to help cope better.