West Virginia's top corrections official led a troubled state agency and will now head a federal bureaucracy plagued with problems of its own.

The portrait of Mr. Obama, which was unveiled in the East Room during the administration of President Joseph R. Biden Jr., ...