This works only for outdated Java versions that are known to be vulnerable (they're blacklisted by Mozilla version-by-version).
If you happen to have the newest Java version which hasn't been publicly announced as exploitable, it will not be blocked unless you enable `plugins.click_to_play` in `about:config`.
Anyway it's still a very good move from Mozilla side to minimize the risks.