Kravet Internal AI: From 60% to Nearly 90% Accuracy in AI Outputs

*Structured data refers to information that can be neatly organized into tables, typically involving clear-cut data types like numbers, short text, and dates. On the other hand, unstructured data is more complex and doesn't fit neatly into a table due to its size or format — for instance, audio and video files, or lengthy text documents.

Kravet Inc. owns Kravet, Lee Jofa, GP & J Baker, Brunschwig & Fils and Donghia — high end fabric houses that specialize in style, luxury and exceptional design. 

A 5th generation family business, Kravet Inc. with locations in North America and worldwide, has become the world's largest purveyor of luxury fabrics, furniture, wall coverings, trimmings, carpets, and accessories, boasting the most extensive and revered design archive dating back to the 1760s. GP & J Baker proudly supplies exquisite fabrics to the Royal households, gracing the halls of Buckingham Palace, Windsor Castle, and Sandringham.

Kravet, a distinguished global leader in home furnishings with a workforce of nearly 1,000 employees worldwide, aimed to harness AI to streamline knowledge retrieval and optimized internal processes across various sectors, including:

— Sales & Marketing

— Supply Chain

— Operations

— HR.

However, Kravet was quite skeptical that an off-the-shelf solution, with no flexibility to tweak AI settings or make customizations, could handle their data. Their data included unreadable formats and content, outdated and conflicting information, and thousands of product pages each with unique product specs.

We suggested a strategic approach — a zero-risk pilot that would include training AI on their data 'as is'. This stage would allow us to determine the key knowledge areas contributing to misleading AI responses and develop distinct strategies to tackle those challenges.

We started off with the Pilot aiming to build a proof-of-concept prototype trained on Kravet's data with minimum effort to determine the key AI challenges.

BotsCrew Enterprise Platform with in-built RAG (retrieval augmented generation) infrastructure was ideal for this purpose as it allowed us to deliver the first version of the prototype in 3 weeks.

What was added to the assistant's knowledge base:

With this data, the prototype was transferred to the client for the initial testing. And it revealed that:

Moreover, we realized that the internal AI assistant could be helpful to the Kravet employees beyond knowledge retrieval.

With these findings, we regrouped with the client and suggested different approaches to handling these problem areas, which included utilizing the tools that existed in their ecosystem to better inform the AI answers.

Our proposed strategy is better described with this infographic:

Additionally, we made the following tweaks:

✅ Adjusted the temperature setting to control the language model's output, balancing creative randomness and predictable accuracy.

✅ Switched to the GPT model with the largest context window (128k tokens).

✅ Increased the number of sources used in Retrieval Augmented Generation.

✅ Conducted data cleansing by removing outdated files and sources.

After each iteration, we tested the AI with the same questions to measure the impact of our updates. Our client’s active involvement was invaluable, offering detailed feedback that shaped our next steps and kept the process on track.

Knowledge sources:

Pinecone — vector database (knowledge uploaded into BotsCrew Chatbot CMS — URLs, PDF, doc, and other files are stored here)

Algolia — a system that stores product information in a structured format and offers advanced search tools for querying data through API calls.

Kravet Inventory system — returns product inventory status via API calls.

OpenAI GPT-4

Large Language Model (LLM) for AI-smart response generation based on the knowledge provided from sources above.

Managing inquiries about a vast product range. The AI assistant is designed to handle inquiries about an extensive range of over 125,000 products, covering specifics like product features, color options, fabric types, and the collection each item belongs to. 

Inventory system integration & real-time status monitoring. It can seamlessly provide up-to-date information on inventory status, such as the quantity available in stock and estimated delivery times, acting as a valuable resource for employees seeking quick and accurate information.

Email capabilities. Client's internal AI assistant can choose the right tone of voice and content based on previous interactions. For instance, if an employee asked the AI agent about a fabric collection, it would tell him the composition, check the inventory status, and then, if needed, draft an email to a client to finalize an order.

Feedback from the client

Our client’s main concern was the accuracy of the AI's output, given the unique nature of their data. We concluded that the most important metric to track during the pilot was AI Reply Accuracy.

To be able to measure that, we put a list of test questions together with the client. After each improvement iteration or change in AI logic, we marked AI output as correct, partially correct, or incorrect.

It was this data-driven strategy that helped us realize the substantial progress we've made, achieving nearly 90% accuracy.

That's a significant stride considering that we started at less than 60% AI accuracy.

The successful launch of the internal AI assistant marked a significant milestone, and it's fair to say that it was well-received, garnering substantial positive feedback from Kravet employees.

Our main focus now is driving adoption of the solution. Also, we recognize the importance of guiding non-technical employees through their first experiences with AI. Our robust support system, built on a strong partnership with the client, ensures BotsCrew is actively engaged in:

We are confident that in a year, the AI agent's functionality will grow to meet the evolving needs of Kravet's team.

Stay tuned!

An internal chatbot or AI agent bring a host of advantages to the table:

✅ Boosts Productivity and Efficiency: Employees can quickly find information and submit requests directly within their business communication platform, significantly reducing time spent on routine tasks. Those using AI internal agents completed tasks 12.2% more frequently, 25.1% faster, and with 40% greater accuracy compared to non-users. Extra time can then be redirected to more critical tasks that require their specific expertise.

✅ Delivers Time and Cost Savings: Automating repetitive tasks with AI assistants saves both time and resources. Chatbots Magazine reports that agents for automation can help businesses cut up to 30% of the $1.3 trillion spent on operational costs.

✅ Enhances Data Security: An internal AI agent ensures that employees only access data and functionalities that align with their permission levels, keeping sensitive information secure and maintaining compliance with data privacy regulations.

✅ Provides Data-Driven Insights: By analyzing interactions, these AI agents can offer valuable insights that help refine and improve business processes. 

Schedule a call or fill out a quick form to bring your AI assistant vision to life. We'll dive into potential KPIs, budgets, and outcomes, and create a free prototype for you to test, giving you hands-on experience before making your final decision.