Mitochondria are energy-producing organelles in eukaryotic cells considered to be of bacterial origin. The mitochondrial genome has evolved under selection for minimization of gene content, yet it is not known why not all mitochondrial genes have been transferred to the nuclear genome. Here, we predict that hydrophobic membrane proteins encoded by the mitochondrial genomes would be recognized by the signal recognition particle and targeted to the endoplasmic reticulum if they were nuclear-encoded and translated in the cytoplasm. Expression of the mitochondrially encoded proteins Cytochrome oxidase subunit 1, Apocytochrome b, and ATP synthase subunit 6 in the cytoplasm of HeLa cells confirms export to the endoplasmic reticulum. To examine the extent to which the mitochondrial proteome is driven by selective constraints within the eukaryotic cell, we investigated the occurrence of mitochondrial protein domains in bacteria and eukaryotes. The accessory protein domains of the oxidative phosphorylation system are unique to mitochondria, indicating the evolution of new protein folds. Most of the identified domains in the accessory proteins of the ribosome are also found in eukaryotic proteins of other functions and locations. Overall, one-third of the protein domains identified in mitochondrial proteins are only rarely found in bacteria. We conclude that the mitochondrial genome has been maintained to ensure the correct localization of highly hydrophobic membrane proteins. Taken together, the results suggest that selective constraints on the eukaryotic cell have played a major role in modulating the evolution of the mitochondrial genome and proteome.