It does say in the book that Rue is dark skinned - basically it says she's black - as all the people from her district, but I didn't catch on to that...
Ditto, I think I assumed she was a little blond girl because Katniss was comparing her to Prim, and my mental image of Prim was already set from the start of the book.