Kazakhs launched a chatbot in the USA and entered the top 10 most profitable AI applications! Here's how they did it

GoatChat.ai is not your typical startup. It doesn't address obvious pains, but it became profitable in the first few months, reaching the top of the App Store download charts in various countries. The GoatChat app is based on large language models (LLM), similar to Chat GPT, allowing it to create digital avatars, images, stories, and more. Before establishing the company in the USA, the startup founders found success in IT outsourcing.


Their first global market project was the ADAPT marketplace builder, after which they transitioned into an AI research company. Co-founder Erbol Kopzhasar shared the story of GoatChat for the joint project of Digital Business and Astana Hub, "100 Startup Stories of Kazakhstan," revealing what GoatChat is capable of, how a startup with 12 team members can compete with Silicon Valley giants, and the direction of the AI industry.

"In total, we tested 50-60 different models, of which we use about 10."

  • Erbol, how did you get into the startup industry?

  • At the age of 16, I went to study in the UK (Newcastle University). I studied there for free until the third year on a scholarship for high performance. By the end of university, I was already a developer in a messenger but decided to return to Kazakhstan.

I initially worked as a mentor at nFactorial. Then I wanted to understand how the public sector functions and joined the MFC. Meanwhile, we received orders for development, but I didn't want to code myself anymore. Eventually, I started delegating tasks and became a project manager. Projects ranged from a shoe store to a Python bot for tracking customer mentions on the internet.

Erbol Kopzhasar

Then I met my business partner, Bakytzhan Dos. We went to Moscow for a year to develop an app for luxury car rentals for the company "Delimobil," which acquired Anytime. When you write software, you rarely encounter real-life situations, but there we had to solve problems from parking payment to stopping a sports car engine on the highway. After returning to Kazakhstan, we decided to work on our own projects.

  • Earlier this year, you and your co-founder worked on the ADAPT startup, which attracted $500,000 in investments. What's happening with it now?

  • Its development required more attention and vertical focus on specific markets with deep systemic integrations, which didn't quite align with scaling priorities. Also, customer acquisition costs in this business are quite high. Even though we worked not only in the USA but also in Brazil, where this indicator is lower. The service is still available for subscribers, but we limited app downloads.

At the same time, considering the growing demand for AI, there was no doubt about the direction to move forward. A technological breakthrough occurred. People immediately started paying for a new user experience, despite technical limitations.

  • Now, let's talk about the startup itself. Tell us how it all started?

Erbol Kopzhasar

  • The idea for the chat came up during a brainstorming session with Bakytzhan. We have a crazy team and ideas that we bring to life, both from a technological and product perspective. Goat is an abbreviation for the greatest of all time.

We thought, if a person can communicate with a neural network, why not have a conversation with Einstein? A speech model can be trained to communicate on behalf of any famous person. We were surprised when people were willing to pay for this. Later, we decided to expand and enhance the functionality.

  • What features are available in your application?

  • Currently, GoatChat offers three main sections. The first is an online assistant with the ability to upload files. We also connected a web browser to it. Opening any page on the internet, our assistant can summarize it and communicate with you based on the learned context. In this case, the language model relies on the provided information rather than a dataset from the latest version of Chat GPT. You can also upload a PDF file using the same principle. However, our model doesn't work as well with the Russian language yet, as it was mainly trained in English.

Erbol Kopzhasar

The second section is "explore." In this section, users have access to various AI chatbots available on the market. With their help, users can generate visual and text content, be it images, illustrations, stories, etc.

There is currently no video generation. It's very expensive, and we don't have enough hardware, although we probably have the largest number of industrial graphics cards in Kazakhstan. Their computing power can be used for model training or content generation. Everyone is talking about AI now, but image and video generation are different technologies.

The third section is creating a digital avatar or any character. Just upload the necessary information to your chatbot, and it can answer various questions. For example, about financial literacy. Other people can also interact with it. If needed, the custom chatbot can always be further developed. Interestingly, people greet and thank avatar bots much more often than just online assistants.

In the free version, you can send 9 messages and generate up to 5 images. The paid version has no restrictions and offers more functionality. Plus, you can chat with a more trained model based on Chat GPT 4. In total, we tested about 50-60 different models, of which we use about 10. Some of them are our own. However, 95% of users only use two - the chatbot and the assistant.

"We currently have almost 5 million downloads on the App Store."

  • How profitable has the subscription model turned out to be?
  • We are a profitable company. The application has been available on the App Store since January. In March, TechCrunch included us in the ranking of the top 10 most profitable AI startups. Currently, we have almost 5 million downloads on the App Store, and the subscription cost varies by country. For example, in the USA, the weekly subscription is $9.99, the monthly is $24.99, and the annual is $99.99. We often conduct AB tests and adjust prices, aiming to understand what keeps users in the app the longest.

Pricing is a crucial aspect in the App Store. What subscription to show to a person first: weekly or monthly? There are many such questions, and everything needs testing. Fortunately, we have an audience on which we can test hypotheses.

  • Which subscription is most commonly purchased, and how many users stay in the app?

  • I think the weekly subscription is the most popular. The active audience is around 1 million people per month. Regular sales started for us at the end of February. Unexpectedly, we became the first app from Kazakhstan to enter the top 10 App Store rankings in France, Germany, South Korea, Poland, and other countries. This requires a large number of daily downloads, not just a one-time spike in downloads.

Erbol Kopzhasar

Another important metric is usage frequency. The problem with many apps is that they are downloaded from social media, but users forget to open them immediately.

  • What is the current valuation of your company?

  • I'm afraid to make a mistake with the figure, but I can say for sure that in the last couple of years, we have raised $1.2 million in investments. This includes funds from 500 Startups, MOST VC, and Murat Abdrahmanov. We are currently preparing for a new funding round and aim to raise $30 million.

"The Valley is structured in a way that only fundamental companies can compete there."

  • In your view, what is the greatest benefit of the application for users?

  • For some, it's the opportunity to quickly get the information they need. For example, how to wash a cat or to hear that everything will be okay. In September, we observed increased activity among students. The chat is also actively used for emails. When we ran ads on TikTok, the most conversion video for a male audience showed how GoatChat helps a guy win back his girlfriend with just one message.

Erbol Kopzhasar

Imagine a service where you can do anything you want. Continuous model development will create new use cases. But an even greater contribution can be made by advancing research direction.

  • Why did research become important to you? The application is already profitable.

  • In reality, there are enough analogs to GoatChat, and many of them initially had their own language models. Silicon Valley is structured in a way that only fundamental companies can compete there. For the same reason, we invest a lot of money in hardware and specialists. In Kazakhstan, we managed to find only three AI researchers.

Currently, in addition to developers and the product team, the company has five researchers. The field of AI research is developing at a rapid pace. 7-8 scientific papers are published daily, each of which theoretically can change an industry. We have already prepared one scientific publication and are working on several more.

  • What topics are you researching?

  • Our first paper addresses the area of censoring responses on forbidden topics such as violence. With the example of GOAT 7, we proved that restrictions lead to a deterioration in the overall quality of any responses. All language models, except GPT 4, face the same problem. No one knows exactly how it is actually structured and how it was trained.

Erbol Kopzhasar

Language models have two more unresolved issues. The first is "hallucinations" or the issuance of false information. The second is context length. When chatting, there is a word limit in messages or one session. Currently, the limit for language models is 32 thousand tokens or 16 thousand words. Developers still need to create a model capable of writing a high-quality "War and Peace 2."

We are writing books even now. Our new model generates stories on 128 pages in 5 minutes. In the future, we want to create movie scripts using it. The test version has already been downloaded by 10,000 people. Just specify the plot and main character, and the model will write everything itself.

"Where collecting data in a simple and structured form is not possible, changes will take a long time."

  • Will neural networks eventually leave screenwriters and other specialists without work?

  • This is a significant danger for the entire AI industry. OpenAI allocated about $10 million for the security of its developments. But this amount is nothing compared to how much the company spends on hardware.

In areas where it is not possible to collect data in a simple and structured form, changes will take a long time. AI optimists believe that neural networks will become more of an auxiliary tool rather than a complete replacement. However, I disagree with them. As soon as McDonald's installed self-checkout machines, the company reduced the number of cashiers. Capital will always strive for increased labor efficiency. Accordingly, you need to look for areas where your competencies cannot be replaced by any language or other model.

For example, in California, Cruise already offers driverless taxi services. There is no time for jokes there now. People are going on strike. And this is happening in the country with the most developed economy in the world. All of this does not inspire optimism, but I think many new professions will emerge. Conditional screenwriters will spend more time editing scripts and coming up with ideas for them than writing from scratch.

  • Share your company's near-term development plans?

  • We would like our research and models to be usable by others. OpenAI, for example, is primarily a research company that managed to monetize its research. We will continue to release new B2C products or update existing ones with new technologies.

We also plan to fully relocate the team to San Francisco soon. Bakytzhan is already there, and some team members have also moved. We registered in the USA three years ago because we initially wanted to develop in a market where thousandfold growth is possible. By the way, we were offered to buy the Goat.ai domain for a hundred thousand dollars. We never thought that it would be the most profitable investment in our lives.

"In AI, all basic consulting will disappear, especially surface-level questions."

  • There are many different LLMs available on the market. How do you understand which language model is the best?
  • I approached our ML engineer with this question. The open-source community evaluates models using tests that include thousands of different questions. Their results show how well the model constructs a logical chain of information. For Chat GPT, this score is around 70 points, and for Lama 2, it's 68. The second one, by the way, is open-source, and enthusiasts can fine-tune it, engaging in competitions among themselves. We also played this game. Our Goat-7B received good ratings, and it was downloaded about 10,000 times.

  • Share your predictions for the development of the AI industry?

  • First and foremost, it's frame-by-frame video generation. Once models can create videos without distortions, people will simply stop trusting information. Imagine that in three years, scammers will send you a video message from your mother, generated by a neural network. Basic deepfake technologies appeared about 5 years ago, but they continue to improve, reaching a 95% similarity of images. On the plus side, using the same logic, you'll be able to create animation.

Also, all basic consulting in AI will disappear, especially some surface-level questions. If the issue of context limitation is resolved, programmers will have to code less. Already now, we don't hire junior developers because there are plugins that write code for developers. But in any case, it needs to be checked, debugged, etc.

Erbol Kopzhasar

Everything will change precisely with the advent of so-called Self-play. Currently, we train neural networks ourselves, but separate models may emerge for this task. In simple terms, one program will train and evaluate another program. New articles on this topic appear every week, but so far, all attempts have failed.

  • What about the regulation of the AI industry? Developers have already been urged to slow down the development of artificial intelligence.

  • Regulation of AI in the United States will work as capital desires. Let's say Warner Bros. decides to protect its copyrighters, pays $10 million to some senator, and he goes to defend the necessary law. The law is extortion, and if the Democrats come to power, supported by AI companies, there will be corresponding legislation.

  • Recently, there has been talk in Kazakhstan about the importance of developing artificial intelligence technologies. In your opinion, how realistic is this?

Erbol Kopzhasar

  • To do this, you need to go to Taiwan and ask them to supply at least NVIDIA DGX H100 100 graphics cards to universities. One such card costs $300,000. To conduct research, you need 64 of them. But even if you decide to purchase the hardware, the provider will ask you to stand in line or pay a lot of money. Owning such resources is currently a political and elitist issue.

https://digitalbusiness.kz/2023-11-24/kazahstantsi-zapustili-chat-bot-v-ssha-i-voshli-v-top-10-samih-pribilnih-ai-prilozheniy-vot-kak-im-eto-udalos/ 

 

Comments 0

Login to leave a comment