I read on a low memory install site that I could save some space by removing language-pack-en-base. Great! I did it but now I’m getting all kinds of errors on locale not configured.
To fix this problem it was rather simple from the terminal I ran:
sudo dpkg-reconfigure locales
It creates errors while reconfiguring but afterwards it seems to fix the problem.
Other links:
https://help.ubuntu.com/community/Installation/LowMemorySystems
http://www.myscienceisbetter.info/repair-perl-locale-errors-on-ubuntu-server.html