Also a short rest should recover a level, maybe limit it to once per day from short rests so you can't spam them.
I think I will do something like this.
Once per day you can recover a level of exhaustion after taking a short rest if you have adequate food and drink.
Lesser Restoration will recover 1 level of exhaustion, and Restoration will recover all of them.