Well, my thoughts are that a psycho-analyst would appreciate your rambling, because that's the way they like it - it's called stream of consciousness. But even the great stream-of-consciousness writers like Joyce and Woolf censored their writing, and had the reader in mind.
It really depends on why you are writing at all. If it's for your own pleasure, then you can write how you like. Now, this might not apply to you, but I'll make some observations. A person who has little empathy with others, say a psychopath or an autistic person, or someone with Asperger's Syndrome, might have trouble putting their words into a form that others can appreciate, because you need to empathise with the person reading.
If you say you're not interested in conversing with a reader, why are you worried about this non-problem? Has someone said something to you about it? Do you think you would lead a richer life if you could communicate more effectively? But if you say you're not interested in conversing or communicating, what is the real problem? There is no existential reason that a person has to be a good writer if they aren't even interested in writing to others.
Perhaps I'm missing something. What is your motivation to write better?