At the moment you cannot custom individual colors. You can only pick from the color sets.
You can customize the text size of all text on a chart. In the chart setup, click on the "Styles" tab and, near the center, it says "Chart Text: Automatic". Change that to custom, and many more options open up. There you can change the color, font, and size of each piece of text in the chart.
Thanks for this Jeremy