Most check valves make a sound when they close. First, check that your discharge assembly is attached solidly, and second, that the pump is resting firmly on the bottom of the pit.
If the valve’s clunk isn’t muted by the previous steps, consider replacing your existing check valve with the Basement Watchdog quiet check valve. This check valve is spring-loaded and its angled seat design minimizes noise when the pump shuts off.