Walter Williams‘ latest column at Human Events explores some people’s unwillingness to support freedom of association without caveats.

The true test of one’s commitment to freedom of association does not come when he permits people to associate in ways he deems acceptable. The true test comes when he permits people to associate — or not to associate — in ways he deems offensive.

An evangelical Christian baker in Colorado has been threatened with jailing for refusing to bake a wedding cake for a same-sex marriage ceremony. In 2012, for the first time in its 79-year history, the exclusive Augusta National Golf Club was forced to admit female members. At one time, blacks could not use restaurants, bathrooms, water fountains, public parks, beaches or swimming pools on the same terms as whites. In theaters, they could only sit in the balcony or in other racially designated areas. They had to ride at the back of streetcars and buses.

Permitting discriminatory practices in publicly owned facilities — such as libraries, parks and beaches — should not be permitted. That is because they are publicly financed by taxpayers and everyone should have a right to equal access. Denying freedom of association in private clubs, private businesses and private schools violates a human right.

Christian Americans are being hounded for their refusal to cater same-sex weddings. For those who support such attacks, we might ask them whether they would seek prosecution of the owner of a Jewish delicatessen who refused to provide services for a neo-Nazi affair. Should a black catering company be forced to cater a Ku Klux Klan affair? Should the NAACP be forced to open its membership to racist skinheads? Should the Congressional Black Caucus be forced to open its membership to white members of Congress?

Liberty requires bravery. To truly support free speech, one has to accept that some people will say and publish things he finds deeply offensive. Similarly, to be for freedom of association, one has to accept that some people will associate in ways that he finds deeply offensive, such as associating or not associating on the basis of race, sex or religion.