Guilt cannot imagine being met with anything but attack. A mind that remembers its own wrong is certain of punishment, and so it invents an enemy who will surely strike back, when the only accuser is itself. With the shelter of the father gone, the brothers' fear is nakedly their own guilt turned outward, painting a threatening face on one who holds none.
What they dread in another is simply what they have not forgiven in themselves. The hatred they expect is a mirror, and until they look at the guilt directly, they will keep meeting it wherever they turn.
Brethren: the parts of one mind that carry unforgiven guilt and expect the world to avenge it
Father: the protecting presence whose felt absence lets buried guilt rise into fear
Joseph: the aspect of the mind seen through the lens of guilt, mistaken for a judge and enemy when he is only love