I'd look at the intensity of each pixel in the gray scale image before and after the filter and apply this ratio to the intensity of each pixel in the rgb image.

Only a suggestion but I believe it would work...