Does the site admin have the option to review listing submissions before they shown on the directory?

Yes, there is an option to require site admin approve before they are shown on the directory, if enabled new submissions will be inactive, pending for admin approval.

To enable listing approvals, go to Listings ▸ Settings ▸ Listing Submission and check "New Submissions require admin approval"