Articles by Tag #nvidia

Browse our collection of articles on various topics related to IT technologies. Dive in and explore something new!

First Look at NVIDIA Jetson Orin Nano Super - The Most Affordable Generative AI Supercomputer

Table of Contents Comparing Jetson Nano Vs Jetson Orin Nano Super How powerful is NVIDIA...

Learn More 152 11Feb 16

Exploring NVIDIA’s Llama 3.1 Nemotron 70B Instruct Model: A Breakthrough in AI Language Models

The latest buzz in the AI community is NVIDIA's Llama 3.1 Nemotron 70B Instruct model, a...

Learn More 41 0Oct 18 '24

Running Ollama and Open WebUI containers on NVIDIA Jetson device with GPU Acceleration: A Complete Guide

NVIDIA Jetson devices are powerful platforms designed for edge AI applications, offering excellent...

Learn More 32 0Nov 30 '24

How to Install NVIDIA Parakeet TDT 0.6B V2 Locally?

Parakeet-TDT 0.6B V2 is a high-performance speech-to-text model developed by NVIDIA for English...

Learn More 23 0May 11

GPUs In Kubernetes: Installation And Configuration

GPUs are nothing new. We’ve seen them for countless years in servers for various jobs that have to do...

Learn More 21 2Oct 13 '24

How to deploy Llama-3.1-Nemotron-70B-Instruct on a Virtual Machine in the Cloud?

NVIDIA has developed a large language model called Llama-3.1-Nemotron-70B-Instruct, which aims to...

Learn More 20 0Oct 21 '24

RedLM: My submission for the NVIDIA and LlamaIndex Developer Contest

RedLM is an AI-powered application for the study of China's greatest classical novel: Dream of the Red Chamber"

Learn More 16 0Nov 14 '24

Nitro Card, Why AWS is best!

One of my interesting area is a virtualization. It is very complicated area in computer science and...

Learn More 13 1Jun 28 '24

How to run for inference Llama-3_1-Nemotron-51B-Instruct?

The large language model (LLM) Llama-3_1-Nemotron-51B-Instruct provides an excellent balance...

Learn More 11 0Nov 3 '24

Using Nvidia GPUs With Docker In 5 Minutes

Containers have been around for a long time starting with Linux Containers (LXC). In 2013, Docker...

Learn More 11 0Oct 22 '24

🦙💬 Building a Next.js Chatbot with NVIDIA Llama 3.1 Nemotron-70B Integration

This project implements an AI chatbot using Next.js, React, and integrates with the NVIDIA Llama 3.1...

Learn More 7 0Oct 17 '24

Debian 12: NVIDIA Drivers Installation

NVIDIA, with the rise in popularity of Large Language Models (LLMs), has firmly secured its position...

Learn More 6 5Dec 1 '24

Choosing Pre-Built Docker Images and Custom Containers for NVIDIA Jetson Edge AI Devices

When planning an edge AI project on NVIDIA Jetson devices, one of the key decisions you will face is...

Learn More 6 0Dec 11 '24

How to Install NVIDIA AceReason-Nemotron-14B Locally?

NVIDIA’s AceReason-Nemotron-14B is a powerful open-source model designed specifically for solving...

Learn More 5 2Jun 4

Flash MLA curated references

Flash MLA Offical Github Repo: FlashMLA - deepseek-ai - Github DeepSeek Official Anouncement of...

Learn More 5 0Feb 27

Real-Time Knowledge Graphs for GenAI – Join Us at NVIDIA's AI Conference

Real-time contextual reasoning is critical for generative AI applications, yet traditional databases...

Learn More 5 1Mar 6

When markets panic: the cost of emotional investing

The recent market reaction to DeepSeek’s announcement was a classic case of short-term panic versus...

Learn More 5 0Feb 3

NVIDIA NIM is mind blowing!!!

Simplifying AI Model Deployment with NVIDIA NIM The deployment of AI models has...

Learn More 5 0Jul 11 '24

Saturating Infiniband Bandwith xiRAID, To Keep Nvidia Dgx Busy

Objectives Modern AI innovations require proper infrastructure, especially concerning data...

Learn More 5 0Aug 7 '24

CUDA Series (1/3)

olcf's CUDA series 01. CUDA C Basics slide Host: The CPU and its memory Device:...

Learn More 4 0Mar 13

🚀 Fine-Tuning GPT-4: Unlocking Custom AI for Developers

Introduction: OpenAI's latest update allows developers to fine-tune GPT-4 models, creating tailored...

Learn More 3 0Aug 24 '24

Building an AI-Optimized Platform on Amazon EKS with NVIDIA NIM and OpenAI Models

Introduction The rise of artificial intelligence (AI) has brought about an unprecedented...

Learn More 3 0Dec 18 '24

Fixing Ollama Installation on Manjaro + NVIDIA

The current Ollama version in Arch is outdated (0.1.44 vs 0.2.1 latest). The official install script...

Learn More 3 0Jul 11 '24

AI in Your Hands: Nvidia’s $3,000 Supercomputer Changes Everything

AI in Your Hands: Nvidia’s $3,000 Supercomputer Changes...

Learn More 3 0Jan 14

Deploying the DeepSeek Model on a Local PC

1. Environment Preparation Hardware Requirements Minimum...

Learn More 3 0Jan 30

JetPack 6.2 on Jetson Orin Nano with UTM on M3 Mac

I needed to set up my Jetson Orin Nano from scratch with a fresh OS. Unlike other Jetson models with...

Learn More 3 0Mar 2

torch.compile()

Introduction to torch.compile torch.compile이란? torch >= 2.0이후에 pytorch code의 speed를...

Learn More 2 0Feb 25

Running Nvidia COSMOS on A100 80Gb

Video Example https://youtube.com/shorts/9dOihUzSSho How to run Nvidia Cosmos on Ubuntu...

Learn More 2 0Jan 13

Selling Shovels in the Gold Rush 💳

Introduction Hey Fellas, Welcome Back. Do you know what the image below is known...

Learn More 2 1Jun 13

Docker-in-Docker (DinD): Run Containers Inside Containers Like a Pro! 😏

Ever wondered if you could run containers inside other containers? Welcome to Docker-in-Docker...

Learn More 2 0Jan 24