I’m not saying “stick it to the man” but you kind of hit the nail on the head: if you don’t work out for them they’d let you go, so the same can work for you.
Why not go there, try it for two weeks, and see how it is? I get around to a lot of companies and in my experience co’s that people gripe a lot about are ones I end up really liking. People like/dislike things for many different reasons.