Samuel Lipman, a pianist and critic who was the publisher of The New Criterion, a conservative journal of the arts, died yesterday at Memorial Sloan-Kettering Cancer Center in Manhattan. He was 60 and lived in Manhattan.