Can we have a religious legal marriage in France?

No, you can only have a religious blessing. A civil marriage is mandatory in France. Religious and non-religious ceremonies (which are optional) are not legally binding in any way.