Legal Question in Elder Law in California

One solution would be to seek a conservatorship. A conservatorship can be over just finances or over the person (for care related decisions) or both. Obtaining a conservatorship is complicated. There are many forms and disclosures. Being a conservator is a thankless job, so you need to decide first if you really want the responsibility. Also, the court will appoint an attorney to represent your gather and it sounds like your father, when lucid, will object. Also, you already have a POA and the Court may feel that is sufficient to manage his affairs, although technically the POA is void whenever your father objects or acts inconsistent with it. I recommend you consult with an attorney to go over all of your options in greater detail.

If you need to protect him against his own foolishness, stick to your guns. No one is going to seriously believe you are 'abusing' him if he complains, as long as you ethically and fully account for his money, and don't put yourself in a position where you could be accused of mismanaging it. IF he is actually 'incompetent' to manage his own money, as it seems, then you might have to seek guardianship or conservatorship over his assets. Tough call, but sometimes necessary. If serious about doing so, feel free to contact me.