Financial Digest

Nvidia banking on TensorRT to expand generative AI dominance

  • 📰 verge
  • ⏱ Reading Time:
  • 20 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 11%
  • Publisher: 67%

Finance Finance Headlines News

Finance Finance Latest News,Finance Finance Headlines

Nvidia is looking to provide the software on the inference side of generative AI through TensorRT-LLM and help run AI models faster.

Nvidia looks to build a bigger presence outside GPU sales as it puts its AI-specific software development kit into more applications. Nvidia announced that it’s adding support for its TensorRT-LLM SDK to Windows and models like Stable Diffusion. The company said in a blog post that it aims to make large language models and related tools run faster.

” In other words, Nvidia hopes that it will not only provide the GPUs that train and run LLMs but also provide the software that allows models to run and work faster so users don’t seek other ways to make generative AI cost-efficient. The company said TensorRT-LLM will be “available publicly to anyone who wants to use or integrate it” and can access the SDK on its site.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 94. in FİNANCE

Finance Finance Latest News, Finance Finance Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Netflix and Nvidia have been crossed off this firm's list for quality stocks.Critical information for the U.S. trading day
Source: MarketWatch - 🏆 3. / 97 Read more »

Stocks making the biggest moves midday: Nvidia, Goldman Sachs, Lockheed Martin and moreThese are the stocks posting the largest moves in midday trading.
Source: CNBC - 🏆 12. / 72 Read more »