It is really important to enjoy it. If it makes you miserable you will never keep going. But the first year is also the hardest. Once you have cleared thoroughly all the perennial weeds from the whole plot and laid it all out, maintenance is much easier. The only nasty weeds I get come from neighbouring plots (largely neglected) and the odd tiny piece of root I missed (easily uprooted).
You do not need to work a plot every day, but you do need to be consistent and go regularly. I can't be there every day, but I do spend at least one day a week and work very, very hard when I am there - but I like working hard! Life can be made easier by making sure that paths are easy to maintain (who wants to spend their precious time weeding paths? If you can be there everyday, fine, but if not time is better spent on the beds) and that beds are smaller so that you can work on them when the weather is not good. As GYO girl suggests,make good use of weed membrane.
The other thing is to go when you have time whatever the weather. I will do things when it is pouring down or freezing. If you do all those jobs like sorting the compost heaps, tidying, removing rubbish, sorting the green house, building frames, repairing fences etc when the weather is bad you can spend all your time when the weather is okay working the beds.
It is surprising how quickly you forget the rotten weather once you get working, or how often you think it is far too cold to go to the plot and then end up having to strip down to your vest as you get so warm digging!
Hope you get your joy in working your plot back