Part Time Youth Minister - Full Time Secular Job

Our youth minister is part time. We have been treating him as an employee withholding SS, State tax, and Fed Tax.
He has a full time secular job where they withhold SS, State taxes, Fed taxes, etc.

He wants to be considered a minister and have a housing allowance. Does he qualify for housing allowance?
If he does, I realize we will no longer withhold SS.