Minute of agreement

My wife and I separated over 2 years ago. Last June my wife's solicitors instigated a minute of agreement where basically it was agreed an amount of money to give to my girls aged 19 and 17
She stipulated that the money was to be paid direct to her and not to them directly as i later found out is normally the case.
She also wanted to keep the matrimonial home and was going to take over the mortgsge herself
on the minute of agreement it says this will be completed in 8 weeks
This never happened as my wife could not get a mortgage as there was a secondary loan on the mortgage
I therefore took my pension out early and paid off the loan and i also paid off significant credit card debt
My wife insisted that she was the sole beneficiary of our house thst i had paid a mortgsge on for almost 20 years
Wanting to just get out of the marriage and not wanting the girls to suffer by parents going through courts i in hindsight stupidly signed the agreement
This was signed in June but the house remortgage was not done till january 8 months later
I am now in a situation where i can't afford to live because of my monthly payments to my ex wife and will get nothing from our home
I have tried to discuss but she will not snd just says she will take me to court if i don't honourvthe minute of agreement
This is causing me considerable financial and emotional strain and any advice would be greatly appreciated
Thank you