In charlottesville, the right side was full of odinists and neonazis, and they took a life that day. That is just the simple fact of the matter. What rioting and terrible behavior was being exhibited on the left hand side that day in charlottesville?
Don't get me wrong, I don't disagree that it's been framed by the left to make trump look bad; it has. That said, people like Richard Spencer and David Duke said that on that day, Trump showed his support for them when he spoke kindly of their men and took no action against them; so it's the white nationalists themselves that have said that this particular event had that kind of impact on them.
Now, since that event he did condemn them, but white nationalists know they aren't popular. They expect people fighting for them to publicly "condemn" them. In interviews and tweets, they have said exactly this. What they hope for, is to be left alone though, which trump has largely done. Not saying I believe that trump is supporting white nationalists, because I don't believe that, but this is why many on the left believe the way they do in thinking he is a racist.
Now, during that time antifa was doing some screwed up stuff; I stumbled upon a riot in Seattle that antifa was involved with while I was sight seeing in Seattle not long after charlottesville. The left has also been violent, now more than ever, but as far as I am aware they were mostly absent in charlottesville on that fateful day.