First private generative AI RAG chatbots
for companies

What is BlueBox AI?

BlueBox AI is a hybrid Retrieval Augmented Generation system integrated with top-tier Large Language Models.

The system offers a comprehensive solution for mass synchronization, vectorization, and indexation of large volumes of a company's unstructured data. BlueBox AI seamlessly connects to any data lakes to execute search queries. The search results undergo analysis, verification, and ranking to ensure the highest quality of answers. After refinement, the results are transmitted to Large Language Models (LLMs) for final interpretation and responding to the user's queries.

BlueBox AI is designed to operate either on-premise or in a hybrid architecture. It can function on client servers or on a predefined hardware platform optimized for its components, delivered as the BlueBox AI appliance.

Generative AI platform for any type of Chatbot

Build human-like intelligent Customer Chatbots, Company Chatbots, AI Copilots - On Premise!

Your private AI Lawyer, Analyst, Helpdesk Consultant

Predefined BlueBox AI Chatbots: Lawyer, Analyst, Helpdesk

  • Lawyer Chat conducts comprehensive analyses of public legal acts and internal documents, such as contracts, regulations, and norms, ensuring a high level of legal security for the company.

  • Analyst Chat performs data analysis through natural conversation in chat, enabling managers to make strategic decisions with exceptional quality.

  • Helpdesk Chat drastically reduces workload by swiftly addressing reported issues and providing timely solutions.

By enhancing collaboration through an intuitive chat interface, these chatbots not only save thousands of working hours but also elevate users to a new level of expertise, supporting productivity and innovation.

No data leaves your company!
Everything is computed on premise

Applications and use cases

Customer Chatbots

  • Integrate BlueBox AI API with your preferred third-party Chatbot. Harness the power of BlueBox AI API to empower your Chatbot with intelligent capabilities, enabling it to autonomously respond to customer inquiries without the necessity of human intervention.

  • Leverage our Chatbot as your primary customer-side interface integrated with Livechat.com. Tailored to your specific needs, it responds using curated data collection designed for each individual customer. This ensures a personalized and effective interaction, enhancing the overall customer experience by providing accurate and contextually relevant responses.

  • Empower your customers with the ability to compare your offerings against others effortlessly through our innovative Comparison Chat feature. This specialized tool accommodates up to 300 pages of text, allowing users to thoroughly evaluate and contrast different options. Whether analyzing product specifications, pricing details, or service features, the Comparison Chat ensures a comprehensive and user-friendly experience for informed decision-making.

  • In certain situations, a robust search engine is all that's required to meet customer needs. Our Total Search Chatbot empowers users to conduct contextual searches and interpret the results independently. This not only addresses potential AI compliance concerns but also provides a self-service solution for customers to access and understand relevant information on their own terms.

  • Elevate customer service by leveraging your Customer Chatbot as the central hub for self-service. Through seamless integration with BPM, workflow, ERP, and RPA systems, the chat becomes a powerful tool for customers to independently manage their needs. This comprehensive solution not only enhances customer autonomy but also ensures a streamlined and efficient experience, allowing users to navigate and fulfill their requirements with ease and efficiency. Embrace the future of customer service with a self-service portal that maximizes convenience and empowers users.

Company Chatbots

  • A specialized chat service committed to resolving customer issues through human operators in a Contact Center. Operating on extensive data collections meticulously curated to address diverse customer queries, the Customer Center Chat seamlessly integrates with workflow systems. This integration enables the conversion of customer queries into streamlined tasks and processes for efficient resolution.

  • A tailored chat platform designed for specific employee groups within a company. Leveraging targeted data collections pertinent to distinct user groups, this solution facilitates the resolution of various issues such as HR matters, incentive concerns, onboarding processes, technical support, general inquiries, and legal questions.

  • The Comparison Chat is specifically crafted to handle analytical queries, offering the ability to compare and extract knowledge from sets of documents with ease.

  • A dedicated helpdesk chat service designed to address and resolve internal employee concerns within an organization. Staffed by human operators in a centralized support system, this platform utilizes comprehensive data collections tailored to meet the varied needs of employees. Integrated seamlessly with workflow systems, the Employee Helpdesk Chat converts inquiries into efficient tasks and processes, ensuring prompt and effective resolution of HR-related issues, technical support, onboarding, and other internal queries.

  • The Cybersecurity Chat is meticulously crafted to analyze system logs and log sequences, actively identifying anomalies and exploring potential theoretical avenues for system infrastructure attacks.

BlueBox AI Copilots

  • Integrate your IBM FileNet system seamlessly with BlueBox AI to access all the necessary documents for your chat. The Copilots retrieve the page you are currently on, using it as contextual information for more effective and relevant conversations.

  • Integrate your IBM QRadar system seamlessly with BlueBox AI to access all the necessary documents for your chat. The Copilots retrieve the page you are currently on, using it as contextual information for more effective and relevant conversations.

  • Integrate your IBM Maximo system seamlessly with BlueBox AI to access all the necessary documents for your chat. The Copilots retrieve the page you are currently on, using it as contextual information for more effective and relevant conversations.

  • Integrate your IBM Business Automation Workflow system seamlessly with BlueBox AI to access all the necessary documents for your chat. The Copilots retrieve the page you are currently on, using it as contextual information for more effective and relevant conversations.

  • Integrate your O365 or on-premise SharePoint seamlessly with BlueBox AI to access all the necessary documents for your chat. The Copilots retrieve the page you are currently on, using it as contextual information for more effective and relevant conversations.

See it live

Key software components

  • BlueBox AI offers a selection of on-premise Large Language Models (LLMs) that are ready to use right out of the box, including:
    - Mistral 7B,
    - LLAMA 2 7B, 13B, 70B,
    - IBM watsonx.AI LLMs.

    .

  • At the heart of BlueBox AI lies the Total Search mechanism, a robust system comprising a Vector Database and Lucene index searching system.

    This powerful combination empowers BlueBox AI to perform comprehensive and intelligent searches, leveraging the efficiency of vectorized data storage and retrieval processes.

  • Every search query and its corresponding response are locally cached within company databases, facilitating accelerated query processing for recurrent questions and answers. The framework leverages the inherent structures of both queries and answers to fine-tune the parameters of the Total Search mechanism embedded within BlueBox AI. This strategic optimization enhances the efficiency and responsiveness of the system, ensuring that the platform continuously evolves to deliver faster and more accurate results based on the patterns and structures identified in previously cached interactions.

  • BlueBox AI serves as a robust backend system for a myriad of applications, including third party Chatbots, ERP apps, and BPM apps. The system boasts the capability to expose secure APIs, providing access to a range of microservices specifically designed for human-like chatting, text creation, summarization, and comparisons.

    This versatility allows seamless integration of BlueBox AI into diverse applications, enhancing their functionalities with advanced natural language processing capabilities.

  • The graphical user interface (GUI) stands as an independent component, open to modification, development, and adaptation according to the specific needs of each customer. Powered by React as its primary technology and utilizing Chakra UI components, the GUI provides a flexible and customizable interface that can be tailored to meet the unique requirements of diverse users.

  • BlueBox AI seamlessly links up with any data lake, a repository housing millions of unstructured file data, and conducts synchronization at predetermined intervals. The files undergo a comprehensive process, including reading, conversion, OCR (Optical Character Recognition), verification within permission contexts, and subsequent placement into BlueBox AI storage.

    Leveraging sophisticated systems such as IBM watsonx.data, Presto, and Spark, BlueBox AI establishes integration with both structured and unstructured data lakes, ensuring a harmonious and efficient data management experience.

  • The system is meticulously scaled to accommodate a range of 100k-10 million documents, with storage capacity extending up to 10TB. Utilizing SSD discs and employing the fastest available mechanisms for input/output (IO) operations, the storage system is engineered to deliver optimal performance and efficiency.

  • In cases where local data proves insufficient for addressing complex queries, the system incorporates a component capable of accessing publicly available internet data or private data repositories provided by companies offering data access services. The search results obtained from these sources are seamlessly integrated with Total Search mechanisms, systematically ranked, and refined to deliver the most optimal answers for the given questions.

Hardware Partner

Hardware architecture

  • This specific component of the system is dedicated to OnPrem Large Language Model (LLM) processing, representing a pivotal aspect of its functionality. The efficiency of this processing unit varies in accordance with factors such as the type of LLM utilized, its specific configuration, and the extent of quantization applied. For instance, the system exhibits the capacity to concurrently serve 8 users for the more resource-intensive LLAMA2 70B, extending up to an impressive 120 concurrent users for the 3B LLMs. This adaptability ensures that the machine can effectively handle a spectrum of processing requirements, catering to diverse user needs and accommodating varying LLM specifications.

  • In order to efficiently manage extensive vectorization processes and facilitate real-time query embeddings, the system leverages the cutting-edge capabilities of Nvidia V-100 GPU cards. These high-performance graphics processing units play a pivotal role in accelerating the computation of complex vector operations, ensuring swift and seamless handling of large-scale data processing tasks. The incorporation of Nvidia V-100 GPU cards represents a strategic investment in the system's computational prowess, enhancing its capacity to deliver rapid and accurate results for a diverse range of vectorization processes and real-time queries.

  • In the context of conducting similarity analysis within the Vector Database, a meticulous process involves configuring millions of document chunks for comparisons with the query. This demanding task necessitates substantial RAM memory and a high-speed CPU for optimal performance. To effectively support large-scale similarity analysis processes, a robust system with 3TB of RAM is deemed suitable, ensuring both the storage capacity and computational speed required for the intricate comparisons performed within the Vector DB.

  • 2x 1.92TB NVMe SSDs

    6x 7.68TB NVMe SSDs

What creators say

  • Ernest Syska - Solution Architect

    BlueBox AI is a groundbreaking Generative AI system designed to process data in a manner that minimizes the exposure of corporate data to cloud services, while ensuring the scale and computational quality required by large enterprises.

  • Robert Izdebski - Automation Visionary

    BlueBox AI is a bold Generative AI project, revolutionizing possibilities in the automation of business operations and redefining the boundaries of our understanding.

  • Mikołaj Kujawa - Hardware Architect, Vernity

    BlueBox AI has received state-of-the-art hardware solutions from Nvidia, pushing the boundaries of computing for LLM models, vector databases, and embeddings.

  • Maciej Wrzeszcz - Software Engineer

    Thrilled to contribute to a pioneering Generative AI project, pushing boundaries and shaping the future of AI innovation!

  • Izabella Gacka - Project Manager

    I am delighted to lead a generative artificial intelligence project, guiding a team of specialists with such exceptional skills.

BlueBox AI is being created and delivered by IBPM S.A.

IBPM S.A., joining the global artificial intelligence revolution, has created BlueBox AI - a large-scale generative AI system intended for data processing in the client's infrastructure.

IBPM S.A. uses technological experience in various IT fields: AI, BPM, EAI and applies it in the configuration of advanced language models, process automation, integration, mass synchronization and analysis of unstructured data.

IBPM S.A. was the first company on the Polish market to build a technologically advanced RAG class system, based on its own and IBM watsonx.ai software components.

Schedule a live demo