To deselect all segments and points, click in an empty area of your document with the Direct Selection tool, or press the Esc key.
You can also Shift+click on more than one segment or point, or click and drag a marquee, to select many things at the same time.
