What if I don't do 'Duke of Ed'?

People keep telling me that if you don't do it, pretty much anyone who has done it will get a job over you and people won't hire you. I've gone to most of the training, but I just don't want to do it anymore. What should I do? I don't want to regret not doing it when I'm older or does it not matter whether or not you do it?