Why are you minimising protein? It’s essential to recovery, just as much as carbs and fat.
How are your cortisol levels? Matt recently responded to a question on Facebook regarding the morning crash etc. and its association with adrenaline, cortisol and so on.
Have you tried carb timing? Eat protein and fat in the morning, and your carbs later in the day. As I also suffer with (low-carb induced) reactive hypolgycemia and fatigue, I will attempt this this week, paired with some cardio and avoiding stimulants such as caffeine.