I know my rights were violated, I just don't know what to do about it!

[Anonymous <no_email@fake.address>]

I am 32 and married. I had a relationship with a married man that lasted a little less than a year.
I ended the relationship and got on with my life (or so I thought).
This married man gave me a position within his company.  After I decided to call of
the personal relationship, the business relationship ended as well.  I was notified via US Mail of my termination.
I received only a week's notice. I am an independent contractor and was not given any formal written contract with his company.
I had one drafted, but it was never signed and he was the acting
GM for this company.  He became angry with me after I told him that I was getting
on with my relationship with my husband and decided to have another child. After he heard I was pregnant he stopped all
communication with me and told me I was making a huge mistake.
He told me I was naive and didn't know a thing about being in business for myself.
He made it clear that if anything were to happen it would be because I am so naive.
There were rumors within this company that I received this position in the first place because of my relationship with this married man.
He denied it and made me feel that I earned this position because of my professional abilities.  
My reputation is ruined (I know I am partially to blame) and I am now out of a job.  I believe it is not because of the reasons stated by this company, but because of me ending the personal relationship
with this married man.  How come I am the only one that loses here.  He had controlled the entire relationship from the start and has now ruined my life.
He has made no effort to contact me or to even apologize and think that I will just
fade away.  He knows that I have no money to speak of and assumes that I am naive.
Is there anything that I can do?  Am I wrong for thinking my rights were violated?
Thank you for allowing me to "vent".  I guess this is the first step in the process.