Rehman Khan was born in Lahore, British India on June 23, 1923 in a Pathan family believed to be the descendants of Afghanistan's King Amanuallah. His family subsequently re-located to Jabalpur where he attended the Robinson College. After completing college he joined the Indian Air Force as a Pilot.