Setting particular pixel to specified color in the output of segmentation map

Ok so the second image was obtained by running a semantic segmentation algorithm on the first image(ADE_val0004) .this was done using the below link

As for the second part of your answer,if I wanted to get the binary mask of only the sky and then set all pixels corresponding to the sky ,how would I go about that.
thanks