Hi Dee. Unfortunately, a spousal visa is only available to legally married spouses. The best way to handle your situation would be for you and your spouse to obtain proper divorce papers from your previous marriages. I understand the difficulties you are facing, however most (all?) countries including Indonesia provide for divorces where the other spouse disappears.
In Indonesia for other than Muslims, you can apply for divorce after your spouse leaves after 2 years. (Law no 1, 1974, article 39).
For Muslims you can apply for divorce at your local religious court (pengadilan agama) and are subject to Law no 3, 2006 and the Islamic Law Compilation (Kompilasi Hukum Islam). I believe the waiting period for this is 6 months of disappearance, then 4 months before being able to marry again (not 100% sure of these time-lines, but prob. somewhat similar).
As for an alternative visa, the next best thing is what is often called a social cultural visa (Sosial Budaya), which is a 2 month (60 days!) visa, extendable 4 times for a total stay in Indonesia of 6 months maximum. After which, you will have to leave the country and apply for a new visa.