The magnet size is determined by power handling and magnet type. If you aren't planning on using an amplifier then a bigger magnet will just take away from the sound as you won't have enough power to run the speakers correctly.
If you are planning to run an amp then I usually do like 45tt and...