yes i have worked for three agencies, and it was the worst thing i could have done.
To be honest if you are a person who can plan activities, and manage your business then you really have no need to be with an agency. The only reason a person would need to be with an agency is to get their first client in the door.