Someone on IRC pointed me at dircolors. But since my problem is that the primary colors are too strong and clash with the background, I ended up editing the profile in gnome-terminal and assigning a pastel RGB value to each primary color in the Color palette provided to the terminal applications. Thus ls thinks it is using Red but it comes out pink. Works great. Adam