When shouldn't I program in Perl?
When your manager forbids it--but do consider replacing them :-).
Actually, one good reason is when you already have an existing application written in another language that's all done (and done well), or you have an application language specifically designed for a certain task (e.g. prolog, make).