The purpose of the Stealth Rule is to prevent users from directly connecting to a Security Gateway. This rule is used in firewall configurations to enhance security by hiding the gateway from unauthorized access attempts, thereby reducing potential attack vectors.