Indianapolis, IN - April 27, 2023 - Leadmatic, an Indianapolis-based AI startup, has announced the launch of tinyChat, a large language model (LLM) that is less than 1% the size of ChatGPT (GPT 3.5). tinyChat is capable of performing a variety of natural language processing tasks, including summarization, text generation, question and answering, and text classification.
tinyChat is an open-source project, released under the Apache 2.0 license. This new model aims to complement larger LLMs like ChatGPT by serving as a co-agent, handling smaller, repetitive tasks which could result in efficiencies and cost savings.
The development of tinyChat was motivated by the belief that smaller language models can play a significant role in generative AI. Smaller models like tinyChat can provide compute efficiencies and cost savings by offloading repetitive tasks from larger models. Additionally, researching smaller architectures and novel datasets could lead to more efficient artificial intelligence systems in comparison to the large language models of today.
tinyChat was developed by fine-tuning Google's Flan-T5-large model using the open-source databricks-dolly-15k dataset from Databricks and Microsoft's Low-Rank Adaptation of Large Language Models (LoRA) training method. In terms of performance, tinyChat either outperforms or is comparable to other open-source models depending on the task.
Potential applications for tinyChat include mobile and embedded devices where compute resources are limited, and enabling developers to use tinyChat for smaller tasks while reserving larger LLMs for more complex tasks. More information on tinyChat can be found on Leadmatic's blog.
Kishan Bhoopalam, Founder and CEO of Leadmatic, said, "This finding is significant because what it shows is that a model that is 0.1% the size of chatGPT can exhibit similar qualities to chatGPT which could mean in the near future many of the use cases of chatGPT could be run on local devices resulting in decentralization of the technology." Bhoopalam added, "While chatGPT is great, at scale it can be prohibitively expensive for companies to use. We think a small open-source model will enable all kinds of new possibilities. It’s still early days and tinyChat is still in its research phase, but we hope other companies will benefit from it as well.”
About Leadmatic
Leadmatic is an AI startup based in Indianapolis that specializes in helping B2B companies get more meetings with their prospects. Leadmatic can identify decision-makers within organizations, mine the web for intent signals, and extract key insights from that information. The platform's team of copywriters then create personalized messaging for each decision-maker with the help of machine learning, resulting in personalized messaging at scale. With Leadmatic's platform, companies book more meetings with their prospective customers.
For more information, please visit the tinyChat website at https://www.withleadmatic.com
Contact:
Kishan Bhoopalam
Founder @ Leadmatic
press@withleadmatic.com
Companies with the following characteristics are best suited for working with Leadmatic:
