There is also the concept of 'leaning', which means you can be one sect but leaning towards another. For example, a Smarta whose ishta devata is Vishnu could be said to be a Smarta leaning to Vaishnavism.
The temple you go to is a Smarta temple, although in true Smarta tradition, there would be a central shrine with the 5 or 6 all on it.
I think I read something about that, where the Smarta worships 5 but picks one as ishta devata.
I think I struggle a bit with where I 'fit' because I feel so strongly attached to both Krishna and Shiva.