Yes there is. You worry about the security of your career almost constantly and realize that any year now, you will have to find other work to do. Whether you get to do your own research or not depends on whether the proposal for grant money you just wrote gets accepted, and there are now so many proposals for research out there that it is harder to get research funding every year. Some years you don't get to do any of your own work at all. During those years, you feel like a computer programmer not an astronomer... and an expensive, old computer programmer to boot!