It does seem like your problem is due to uncorrected cystocele probably because of pelvic floor weakness due to which there was rectocele, cystocele and increased mobility of the vagina which you are trying to describe. There are certain devices like ring pessary which may be used for low grade prolapses in old individuals but are not so good to use in your case. It would be advisable to get it properly evaluated by an Urologist by a good physical examination and get the treatment done. Your case does not look like it can be managed without surgery