Many times people that look different attract each other. I have blue eyes and when I was young both the black and white ladies kept me company. Most people were nice.
I do find that poor black children are more likely to say something to me regarding my gender than wealthy white children. I volunteered in a poor black elementary school and was in the library and a young black boy sitting with a young black girl pointed at me. I went over to them and started chatting with them. They were first graders. The little girl outright asked me, "Are you a girl?" I said yes. The little boy explained, "No you are not!" Then he asked me, "Are you a boy?" I said yes. They were very happy with those answers and had no more questions.
Not long ago I taught in a poor black high school. The black boys would ask me if I was gay. The white teenagers in my neighborhood do not ask me that question.
As a general rule most of the people in the big city area are nice and many from the rural areas are mean.
I have found black people tended to be more muscular than white people.
In conclusion cultural and genetic differences may make someone feel more comfortable with a white person or a black person.