Please help...i really don't know what to do....?

I have a six month old baby and me and her father haven't been together seance i was perg but i fell like i can't really let him go because every time i do i fell really bad for my baby even though i don't love him and he lives 4 hrs away from us....but now i have meet a really nice guy and me and him wanna give things a go but i don't know how to get rid off my baby's father once and for all...by that i mean let him know that i don't wont to be with him i just want us to be friends and him to be a father to our baby...but everything i do this i fell really bad how can i stop felling bad?