It would be foolish to let the dubiousness of metaphysical dogmas dissuade you from spiritual exercises and the good achievable by their implementation. Don't let the weakness of the three pillars supporting the Buddhist edifice, anatta, anicca, dukkha, keep you from a long and salutary session on the black mat.
Related: A 'No' to 'No Self'