The compare option for a specific rule in the New App Viewer under Policy Optimizer allows an administrator to compare the applications configured in the rule with applications seen from traffic matching the same rule. This helps in identifying discrepancies between the configured applications and the actual applications being used, facilitating better policy optimization.