It will more than likely be a contributing factor in some way, Its not until you start getting back somewhere near well that you realise just how low/bad you have been.
if you can keep of the booze as well it’s certainly won’t be doing you any harm. Another thing I will say is if your confident this doctor has got his finger on the pulse in regards to how you feel then I would stick with him/her.