Why is breaking up so hard to do?

So like I said I have been having some serious lower back pain/pelvic pain since Milo has been born. I decided to go to the chiropractor about it. He is a nice guy but I am just not feeling much relief and honestly I feel like I am now in pain in places where there wasn't really pain before. Like for instance he was pulling on my head to realign my neck and since then my ears feel like they do when you go on an airplane and my jaw hurts. Then last time I went he was pulling on my leg to try and realign my hip and my ankle cracked and it hurt to walk for the rest of the night. I would like to stop going but I am not sure how to break off the appointments. I am also having some issues from my past that is making this difficult.

When I was 20 I was in a pretty bad car accident. I got t-boned and was having some lower back pain and jaw pain. The pain was mostly when I sat down for too long and although painful it wasn't debilitating either. I simply wanted to live a life where there was no pain. I decided to go see a pain management Dr. He made me come to see him every other day including weekends. He put me on some heavy narcotics and did some types of therapy. None of the narcotics seemed to help. He kept changing my prescription to different types of meds and nothing helped with the pain. Honestly looking back I can't even remember what exactly he did for therapy because all I can remember is that with all the drugs I was on was I could not lead a normal life. I was going to him for about 2 months with my parents paying his ridiculously expensive bills that insurance would only partly cover and me having to pay $20 co-pays 4 times a week(I was a broke college kid at the time.) Well one weekend I was watching TV and I was going to get ready for bed and I literally couldn't get myself out of the chair. It took about 30 minutes of me trying to get my body to do what my brain was telling it. This would happen to me often and it was making me feel overwhelmed so he prescribed me some anti-anxiety meds. So I thought I was doing better until one day I missed a dose of my medicine and went through withdrawal just like a junkie. It was awful. I realized my body had become addicted to these drugs and that was something I didn't like. I decided to start lowering my own dosage over the next week in hopes of getting off them even though the Dr. said it was important that I take them. Many times I spent hours on the bathroom floor trying to recover. One one of these days my parents were home and as I lay on the floor huddled in the fetal position my mom was in there talking to me and suddenly I just laid out everything I was feeling. I wasn't feeling better, the drugs were making me feel like I couldn't handle my life, and overall I was just stressed. She called my Dr. and explained what was happening and his response was that I needed to get a higher dose of drugs and come in immediately to see him. My mom explained to him that the drugs were making me worse and he started yelling at her. My mom explained that his services were no longer needed and he became irate with her. I could hear him yelling at her through the phone. She hung up on him and after a weekend of hell I was off the drugs and feeling like a normal person again. I still had back pain so at the referral of my regular Dr. went and saw a physical therapist and healed up real nice. Crazy ass Dr. lost his licence shortly after I stopped seeing him because he treat other patients even worse than me. So I have Dr. issues and I kind of feel like going to the chiropractor has a lot of similarities to seeing Dr. Crazy.

1. I am not feeling any better and when I do feel a little relief it is short lived.
2. I am going to see him at least twice a week at $35 a pop. That is $70 a week, $140 every two weeks, $280 a month. That is a lot of money to me especially when I am still in pain. I think about all the nice things I could do with $280 a month and it sickens me.
3. My pain is in one very specific spot and it seems to be the spot that he spends the least amount of time working on. He does all of my lower back but it is specifically just to the left of my tailbone very deep in the joint that hurts.

So I want to stop seeing him and perhaps go to physical therapy instead. It is a really small office with just his wife as the receptionist and him. (another similarity to Dr. Crazy) and I feel bad because they are nice people and I know he feels like chiropractors don't get the credit they deserve and that he really wants to help me but it just isn't working out for me. I know I just need to call and cancel my appointment but I am having a hard time with it.