The people most adversely effected by illegal immigration tend to be BIPOC people, those without education, single parents, service industry workers, etc. In other words, vulnerable people. The artificial pressure put on wages by competition from illegal immigrants hurts them.
Hence the need for a strong border and aggressive enforcement of labor laws.