Well, he knew.

May 27, 1961

“There’s no question that in the next thirty or forty years, a Negro can also achieve the same position that my brother has as President of the United States, certainly within that period of time.” – Robert F. Kennedy to Voice of America, while he served as U.S. Attorney General