It's interesting that the user-friendlier/mass-market open-source AI tools (notably LLaMA inference and various Stable Diffusion frontends) seem to mostly be for generative tasks. I think there's a possible niche for more "boring" software for things like smarter search (e.g. I have search over my meme library using clip-retrieval, but it's somewhat out of reach of the average user's knowledge), although it might also be the sort of thing which gets commoditized and incorporated into OSes and such.