Yes, the Privacy Rules Checker is able to scan for misconfigured Privacy Rules even when an app’s Data API is turned off (unlike other tools). Even with the Data API is turned off, it is still important to configure Privacy Rules to make sure your app's data is secure.