ORCA Exchange Online Tests
These tests validate Exchange Online security configuration checks from ORCA.
Tests
| Test ID | Title | Severity | Product | Feature |
|---|---|---|---|---|
| ORCA.100 | Bulk Complaint Level threshold is between 4 and 6. | Low | Defender | Anti-spam |
| ORCA.101 | Bulk is marked as spam. | Low | Defender | Anti-spam |
| ORCA.102 | Advanced Spam filter options are turned off. | Low | Defender | Anti-spam |
| ORCA.103 | Outbound spam filter policy settings configured. | Medium | Defender | Anti-spam |
| ORCA.104 | High Confidence Phish action set to Quarantine message. | High | Defender | Anti-spam |
| ORCA.105 | Safe Links Synchronous URL detonation is enabled. | Medium | Defender | Safe Links |
| ORCA.106 | Quarantine retention period is 30 days. | Low | Defender | Anti-spam |
| ORCA.107 | End-user spam notification is enabled. | Low | Defender | Quarantine |
| ORCA.108 | DKIM signing is set up for all your custom domains. | Medium | Defender | Email authentication |
| ORCA.108.1 | DNS Records have been set up to support DKIM. | Medium | Defender | Email authentication |
| ORCA.109 | Senders are not being allow listed in an unsafe manner. | Medium | Defender | Anti-spam |
| ORCA.110 | Internal Sender notifications are disabled. | Low | Defender | Anti-malware |
| ORCA.111 | Anti-phishing policy exists and EnableUnauthenticatedSender is true. | Medium | Defender | Anti-phishing |
| ORCA.112 | Anti-spoofing protection action is configured to Move message to the recipients' Junk Email folders in Anti-phishing policy. | Medium | Defender | Anti-phishing |
| ORCA.113 | AllowClickThrough is disabled in Safe Links policies. | Medium | Defender | Safe Links |
| ORCA.114 | No IP Allow Lists have been configured. | Medium | Defender | Anti-spam |
| ORCA.115 | Mailbox intelligence based impersonation protection is enabled in anti-phishing policies. | Medium | Defender | Anti-phishing |
| ORCA.116 | Mailbox intelligence based impersonation protection action set to move message to junk mail folder. | Medium | Defender | Anti-phishing |
| ORCA.118.1 | Domains are not being allow listed in an unsafe manner in Anti-Spam Policies. | High | Defender | Anti-spam |
| ORCA.118.2 | Domains are not being allow listed in an unsafe manner in Transport Rules. | High | Defender | Mail flow |
| ORCA.118.3 | Your own domains are not being allow listed in an unsafe manner in Anti-Spam Policies. | High | Defender | Anti-spam |
| ORCA.118.4 | Your own domains are not being allow listed in an unsafe manner in Transport Rules. | High | Defender | Mail flow |
| ORCA.119 | Similar Domains Safety Tips is enabled. | Info | Defender | Anti-phishing |
| ORCA.120.1 | Zero Hour Autopurge Enabled for Phish. | Medium | Defender | Zero-hour auto purge |
| ORCA.120.2 | Zero Hour Autopurge Enabled for Malware. | Medium | Defender | Zero-hour auto purge |
| ORCA.120.3 | Zero Hour Autopurge Enabled for Spam. | Medium | Defender | Zero-hour auto purge |
| ORCA.121 | Supported filter policy action used. | Medium | Defender | Zero-hour auto purge |
| ORCA.123 | Unusual Characters Safety Tips is enabled. | Info | Defender | Anti-phishing |
| ORCA.124 | Safe attachments unknown malware response set to block messages. | High | Defender | Safe Attachments |
| ORCA.139 | Spam action set to move message to junk mail folder or quarantine. | Low | Defender | Anti-spam |
| ORCA.140 | High Confidence Spam action set to Quarantine message. | Medium | Defender | Anti-spam |
| ORCA.141 | Bulk action set to Move message to Junk Email Folder. | Low | Defender | Anti-spam |
| ORCA.142 | Phish action set to Quarantine message. | Medium | Defender | Anti-spam |
| ORCA.143 | Safety Tips are enabled. | Info | Defender | Anti-spam |
| ORCA.156 | Safe Links Policies are tracking when user clicks on safe links. | Medium | Defender | Safe Links |
| ORCA.158 | Safe Attachments is enabled for SharePoint and Teams. | Medium | Defender | Safe Attachments |
| ORCA.179 | Safe Links is enabled intra-organization. | Medium | Defender | Safe Links |
| ORCA.180 | Anti-phishing policy exists and EnableSpoofIntelligence is true. | Medium | Defender | Anti-phishing |
| ORCA.189 | Safe Attachments is not bypassed. | Medium | Defender | Mail flow |
| ORCA.189.2 | Safe Links is not bypassed. | High | Defender | Mail flow |
| ORCA.205 | Common attachment type filter is enabled. | Medium | Defender | Anti-malware |
| ORCA.220 | Advanced Phish filter Threshold level is adequate. | Medium | Defender | Anti-phishing |
| ORCA.221 | Mailbox intelligence is enabled in anti-phishing policies. | Medium | Defender | Anti-phishing |
| ORCA.222 | Domain Impersonation action is set to move to Quarantine. | Medium | Defender | Anti-phishing |
| ORCA.223 | User impersonation action is set to move to Quarantine. | Medium | Defender | Anti-phishing |
| ORCA.224 | Similar Users Safety Tips is enabled. | Info | Defender | Anti-phishing |
| ORCA.225 | Safe Documents is enabled for Office clients. | Medium | Defender | Safe Attachments |
| ORCA.226 | Each domain has a Safe Link policy applied to it. | Medium | Defender | Safe Links |
| ORCA.227 | Each domain has a Safe Attachments policy applied to it. | Medium | Defender | Safe Attachments |
| ORCA.228 | No trusted senders in Anti-phishing policy. | Medium | Defender | Anti-phishing |
| ORCA.229 | No trusted domains in Anti-phishing policy. | Medium | Defender | Anti-phishing |
| ORCA.230 | Each domain has a Anti-phishing policy applied to it, or the default policy is being used. | Low | Defender | Anti-phishing |
| ORCA.231 | Each domain has a anti-spam policy applied to it, or the default policy is being used. | Low | Defender | Anti-spam |
| ORCA.232 | Each domain has a malware filter policy applied to it, or the default policy is being used. | Low | Defender | Anti-malware |
| ORCA.233 | Domains are pointed directly at EOP or enhanced filtering is used. | Medium | Defender | Mail flow |
| ORCA.233.1 | Domains are pointed directly at EOP or enhanced filtering is configured on all default connectors. | Medium | Defender | Mail flow |
| ORCA.234 | Click through is disabled for Safe Documents. | Medium | Defender | Safe Attachments |
| ORCA.235 | SPF records is set up for all your custom domains. | Medium | Defender | Email authentication |
| ORCA.236 | Safe Links is enabled for emails. | Medium | Defender | Safe Links |
| ORCA.237 | Safe Links is enabled for teams messages. | Medium | Defender | Safe Links |
| ORCA.238 | Safe Links is enabled for office documents. | Medium | Defender | Safe Links |
| ORCA.239 | No exclusions for the built-in protection policies. | High | Defender | Safe Links |
| ORCA.240 | Outlook is configured to display external tags for external emails. | Medium | Defender | Tenant settings |
| ORCA.241 | Anti-phishing policy exists and EnableFirstContactSafetyTips is true. | Medium | Defender | Anti-phishing |
| ORCA.242 | Important protection alerts responsible for AIR activities are enabled. | High | Defender | Tenant settings |
| ORCA.243 | Authenticated Receive Chain is set up for domains not pointing to EOP/MDO, or all domains point to EOP/MDO. | Medium | Defender | Email authentication |
| ORCA.244 | Policies are configured to honor sending domains DMARC. | Medium | Defender | Anti-phishing |