Clio

Cliobot is an open-source bot framework for generative AI on various chat platforms like Telegram, Discord, and WhatsApp. It allows users to create and run AI agents that can handle various types of media, including audio, video, text, and images.

Key Features:

• Modular Design: Cliobot utilizes a modular structure, allowing for easy customization and extension.
• Multi-Platform Support: It provides native support for Telegram and can be adapted for Discord and WhatsApp.
• Generative AI Capabilities: It integrates with popular generative AI services like Stable Diffusion, OpenAI, and Replicate.com.
• Command Mode and LLM Mode: Users can interact with the bot using slash commands (command mode) or engage in conversational interactions (LLM mode).
• Built-in Commands: Cliobot offers a range of built-in commands for tasks like image generation, text description, audio transcription, and question answering.
• Flexible Configuration: It provides a configuration file (config.yml) for customizing settings, API keys, and model preferences.
• OpenAI API Support: The framework supports OpenAI APIs for models such as DALL-E, GPT-3, GPT-4, and Whisper, including Azure deployments.
• Ollama Integration: Users can leverage Ollama for running various LLM models, including image-to-text models.
• Replicate.com Support: Cliobot allows users to interact with any model hosted on Replicate.com.
• Multi-user Support: It enables multiple users to interact with the bot simultaneously.
• File Storage: Offers both local and S3 file storage for persistent data and generated content.
• Automatic Translation: The bot supports automatic message translation using Google Translate API.

Planned Features:

• Discord and WhatsApp Integration: Future plans include support for Discord and WhatsApp.
• Stable Diffusion and StableHorde Processing: The framework will incorporate Stable Diffusion and StableHorde capabilities.
• RAG Mode: Plans include the implementation of retrieval-augmented generation (RAG) mode.
• Chat History: The ability to maintain and utilize chat history is under development.
• LLM Mode Enhancement: Improvements to the LLM mode are ongoing.
• Image and Upload Saving: The bot will enable the saving of generated images and uploaded files.
• Internationalization (i18n) Support: Localization and internationalization are planned features.
• Img2Txt Commands: Image-to-text commands are in the roadmap.
• Llama Implementation: Support for the Llama language model is under development.

Cliobot is a promising framework for developers and users seeking to create and deploy generative AI bots on various platforms. Its modular design, flexible configuration, and integration with popular AI services make it a valuable tool for building powerful and creative AI applications.