Yes you have the right to film in public but other people also have the right to go about their business with the expectation of a certain extent of privacy.
Thats one of the aspects of illegal prostitution thats almost entirely abolished by making it legal.
Usually this isn't enforced, but what happens now to Ice Poseidon is a good example.
If its private or public property doesn't matter, commercial filming needs a permit anyways.