Rolfe then spent the 1960–61 and 1961–62 season with the Portland Buckaroos of the Western Hockey League. Rolfe then moved to the AHL where he spent the next season with the Hershey Bears and the following four seasons with the Springfield Indians. In the 1967–68 season, he returned to the NHL, playing for the Los Angeles Kings. He played for the Kings until he was traded to the Detroit Red Wings on February 20, 1970. Rolfe stayed in Detroit for the remainder of the 1969–70 season and the majority of the 1970–71 season before being traded to the New York Rangers for Jim Krulicki where he would spend the rest of his professional career, retiring after the 1974–75 NHL season.