Yup, you clean the terminals first, apply the goop, then assemble.
The goop has aluminium dust which fills any microscopic gaps with a conductive material whilst the greasy carrier keeps out the damp and air. You really only need a smear, one tube should last a lifetime.
So, you have to use it during the assembly process or if you strip your pack to re-configure or add cells etc.