I think it has to be a congressional act. Not that I think people are stupid but they won't be armed with all the facts (secret intelligence for example, that can't be in the public domain).
No I believe in elections having consequences. they should be appointed by the seated President and vetted by the Congress and other Supreme Court Justices.
Do you think you would make a better president that Any in the past?