Section 3 of the Fourteenth Amendment prohibits individuals who have engaged in insurrection or rebellion against the United States from holding public office if they previously took an oath to support the Constitution.

It doesn't say a conviction is needed