A wicketkeeper-batsman, Pandit began playing first-class cricket in 1946 and represented Kathiawar, Kerala and Travancore-Cochin. He was a wicketkeeper for Kathiawar in the match against Maharashtra, in December 1948, when Bhausaheb Nimbalkar scored an unbeaten 443 runs, the highest first-class score by an Indian batsman. In a Ranji Trophy match in 1959 against Andhra, his 14th for Kerala, Pandit scored an unbeaten 262, which was the record individual score for Kerala before Sreekumar Nair hit a triple century against Services in 2007. As a wicketkeeper, he completed 35 catches and three stumpings during his first-class career. As an administrator, Pandit was a member of India's junior selection committee and was also the chairman of Kerala's selection committee. He also served as vice-president of Kerala Cricket Association.