Should I get back with a polar opposite-giving second shot to love?

I was really close friends with a guy but we are complete opposites. One main difference being he was into casual dating while I'm the serious one man woman sorts. I liked him and thought he was serious about getting into a relationship too. But the differences were too much and we started arguing over everything, though still never actually dated, just went out a couple of times.
So, I wasn't sure where things were going and the differences took a toll. I thought I'd distance myself and see how things go but that was probably the worst decision. He did ask once what was wrong but then seems to have forgotten about me. Not sure if he even wants me back. We barely talk but what gives me hope is that he seems to have shed his casanova tag and hasn't dated anyone since we stopped talking. I really miss him but don't know if we can build something concrete inspite of the differences. Is it worth a second shot?