A house in Holly Hill, Fla., that was transformed into an adult swingers' club remains at the center of a controversy even though neighbors got the city to temporarily close it.

The Neverending Bliss Swinger's Club was operated out of the Holly Hill home that accommodates 20 couples and features a dancing pole in the living room.

Club owner Matthew Early told Local 6 News that he is proud to be a swinger and he is fighting to do it.

"It is not about the sex," Early said. "It is about the people. I am doing nothing illegal. I have no complaints, no police calls. We are having parties."

"Those parties have been the topic of conversation on the Internet, in Holly Hill and now at City Hall," Local 6's Louis Bolden said.

"It has nothing to do with the type of business being operated," Holly Hill City Manager Joe Forte said. "It is just the fact that it is a club. It can be any type of club. They are not permitted in residential zoning."

The city has notified Early to stop having the parties until a special magistrate makes a ruling.

On Wednesday, a special magistrate reviewing the case did not make a ruling in the case, saying he needed more time to review the evidence.

Early said there is sexual activity at the parties but it is all legal, Bolden reported.

"I don't understand how it could be possibly be legal to have that sort of thing in a quiet, residential neighborhood," a homeowner said.

"I will fight for the lifestyle," Early said. "This has nothing to do with money. This has nothing to do with anything. It has to do with the lifestyle."

City officials said they will write an ordinance that prohibits swinger's clubs, Bolden said.

Watch Local 6 News for more on this story.