Yes, a drill press can drill a square hole. Mortise and tenons have been used in woodwork for centuries, a mortise chisel is a part of this process.
A drill press and mortise chisel and jig drills square holes for mortise and tenon joints easily and quickly. The auger in the mortice chisels is positioned just below the tips of the chisel, and drills a hole with the square corners of the chisel then removed the rest of the timber creating a square hole.
This chisel will drill from 5/8" in one pass
, and has a 3/4" chisel shank