I am currently on holidays, but have been doing interviews. I can't afford to wait around and end up loosing a client because they interviewed someone else and decided since I wasn't willing to interview them for a week or two well I relaxed.

If you are okay with possibly losing out on a client then make them wait well you take your time off. Its your business so it is up to you whether or not to interview during your holidays.