I will focus on PC - Windows first, since that is the only machine/OS I can personally test on at home.
Can I use Controller?
Yes. Main controls in the game are handled by mouse, WASD and space. Controller is X for jumping and both thumb-sticks for camera control and movement.