Finally got the sump pump installed. Hardest part was digging the hole which was 22" of mostly rock with a little clay mixed in. No more leaky basement!
Original post:
That's actually the check valve. The store had those and more permanent PVC ones. I saw the rubber one and thought I would be really glad I went with that one whenever the pump has to be replaced.