I love working with the Color by Layer. I do siteplans. I use real texture for rendering purpose but for technical drawing, we always need lighter smooth color, so I use ColorByLayer for this purpose. (You don't want to see asphalt texture and black shingle roof on an emergency evacuation plan!)
But the color swatch in CbL is really limited. I would like 3 things:
1- a PICKER so we could pick any to match color on the screen.
2- Can edit the color of multiple layer at once.
3- Can choose color from a library. Ideally, the InModel Material library.