Should I be worried that I gave out my social to a scam site?

I applied for a loan from something I found on craigslist. I gave them my social security number. I later found out that it was a scam.

Should I be worried? How can I protect myself. I did not give them any bank account information.