I'm feeling that do not be afraid is meaning...

1. That if we love our enemies, do not be afraid that God will deal with them, or that He will deal with them in a way that you may not like. God is in control, don't be afraid.
2. That if we love people, helping the poor, as Jesus commands, means we may help people that we don't feel deserve it. This especially applies to helping people with our hard earned money. Some will abuse it, see the first thing above.
3. That is we are to love God, we are to love people, and people are people. There is no us vs. them, there is only proud and humble. When you make it about us vs. them, then you don't see people as people, but as non-humans. See the first thing above.