The speaker manufacturer should give you the torque setting. I know on my speakers, it is 3 N/mm2 for the bass driver. Not supposed to touch the M/HF unit, but on my speakers they are rather specialised (BMR units). You usually need a calibrated and fairly specialised torque wrench for those levels of torque.
Devialet 220 Pro, TQ Black Mains & Ultra Black Speaker Cables, Naim Ovators S600, Sonore microRendu (Roon & HQP) with Uptone JS-2
TRNC (North Cyprus)
TRNC (North Cyprus)