Apple MLX is a game changer for what is possible in Local LLM development for everyone. Getting this to work as a single application that "just works" across platforms has been one of the hardest engineering problems we've ever worked on, but we're determined to get it right.
Smart assistants should be more than just heavily commercialized products, we need private, conversational assistants that can genuinely help us get things done. All the pieces seem to be there right now if we put them together...