Be quick, CYBER MONDAY deals! Galaxy Watch 7, Samsung TV, Galaxy Buds 3 Pro and Galaxy S24 Ultra.

SamMobile has affiliate and sponsored partnerships. If you buy something through one of these links, we may earn a commission.

News For You
News For You
Notifications

Nvidia Chat with RTX lets you run LLMs locally on RTX 30 and 40 series GPUs

Tech
By 

Last updated: February 15th, 2024 at 20:45 UTC+01:00

Nvidia has released the Chat with RTX application for Windows. It can run two large language models (LLMs), Llama 2 and Mistral, right on RTX 30 series and RTX 40 series graphics cards and answer your queries about the content, such as documents, photos, and videos, that you connect to the app. It can also load transcriptions of a YouTube video and using that, it can answer your queries about the video.

Basically, Chat with RTX allows you to run LLMs locally on your PC without the need for the internet, which, according to Nvidia, should get you “fast and secure results.” The company says that it is a “demo” app, and by that, we assume that the brand means that it is a beta version of the app. Fortunately, the app is available for free. Its size is 35GB and you can download it right from Nvidia’s official website.

Chat with RTX is the first app of its kind and it makes LLMs more accessible and opens up a whole new world of possibilities. Nvidia could roll out many other features to the app and make it useful in ways unimaginable. It has been only one and a half years since OpenAI launched ChatGPT, and we are already seeing so many innovations in the world of GenAI. The future of GenAI is going to be very interesting.

Tech Nvidia Buy Samsung Galaxy Book 3
Scroll for more related content
News For You

You might also like

Samsung joins Jeff Bezos to put $700 million in an AI chipmaker taking on NVIDIA

Samsung joins Jeff Bezos to put $700 million in an AI chipmaker taking on NVIDIA

Everybody wants to get in on the artificial intelligence action. A literal boatload of chips will be required to powerful current and future AI applications. Some companies like NVIDIA have already profited immensely from this gold rush while others are gearing up to get their piece of the pie in the future. Tenstorrent is one […]

  • By Adnan Farooqui
  • 4 hours ago
NVIDIA might soon put Samsung’s HBM3E chips out of their misery

NVIDIA might soon put Samsung’s HBM3E chips out of their misery

NVIDIA needs all the high-bandwidth memory HBM3E it can get. There's insatiable demand for its AI accelerators and it can't make them fast enough. It's primarily sourcing HBM3E chips from SK Hynix and even though Samsung has been in the running for some time now, its chips haven't yet been able to meet NVIDIA's requirements. […]

  • By Adnan Farooqui
  • 1 week ago
Samsung hints its flagship HBM3E chips being approved by Nvidia

Samsung hints its flagship HBM3E chips being approved by Nvidia

Samsung announced its earnings for the third quarter earlier today. A large part of its earnings call was spent discussing memory chips since those are considered the company's biggest source of profit. However, the company had problems getting its high-bandwidth memory (HBM) chips approved by Nvidia, the world's biggest AI chip firm. Now, the company […]

  • By Asif Iqbal Shaik
  • 1 month ago
Nvidia could get some of its gaming chips made by Samsung

Nvidia could get some of its gaming chips made by Samsung

Over the past couple of years, Samsung has lost two big-name chip clients—Nvidia and Qualcomm—to TSMC due to power consumption issues. However, Nvidia could come back to Samsung Foundry in the future, as it doesn't want to rely too much on TSMC for its future chips. This is great news for Samsung. Nvidia's future GPUs […]

  • By Asif Iqbal Shaik
  • 2 months ago
NVIDIA open to having its GPUs made by Samsung

NVIDIA open to having its GPUs made by Samsung

NVIDIA is the leading designer of AI and graphics chips. The company doesn't have its own foundry so it needs to get the chips it's designed manufactured by a foundry. The bulk of NVIDIA chips are made by TSMC and Samsung has long been trying to steal some market share away from the dominant player […]

  • By Adnan Farooqui
  • 3 months ago
Samsung’s HBM3E chips reportedly clear Nvidia’s tests, crossing major milestone

Samsung’s HBM3E chips reportedly clear Nvidia’s tests, crossing major milestone

Samsung has been having problems getting its HBM chips cleared by Nvidia. A few weeks ago, the company's HBM3 chips received Nvidia's certification for the Chinese market. Now, Reuters is reporting that Samsung's HBM3E (fifth-generation HBM) chips have received Nvidia's certification, clearing a major milestone. Samsung's 8-layer HBM3E chips reportedly receive Nvidia certification A new […]

  • By Asif Iqbal Shaik
  • 4 months ago