Migrating Vector Database to the Cloud
Timothy Spann.   🇺🇦

Timothy Spann. 🇺🇦 @tspannhw

About: I am a Developer Advocate at Streamnative. I work with Apache Pulsar, Apache Flink, Apache NiFi, Apache Spark, IoT, MXNet, DLJ.AI, Deep Learning, Machine Learning, Streaming... 🇺🇦

Location:
hightstown, nj
Joined:
Nov 20, 2019

Migrating Vector Database to the Cloud

Publish Date: Oct 22 '24
6 0

MILVUS-LITE BACKUP / EXPORT
milvus-lite dump -d XavierEdgeAI.db -p /home/nvidia/nvme/AIM-XavierEdgeAI/backup/ -c XavierEdgeAI

Dump collection XavierEdgeAI’s data: 100%|████████████████| 33/33 [00:00<00:00, 188.54it/s]

Dump collection XavierEdgeAI success

Dump collection XavierEdgeAI’s data: 100%|████████████████| 33/33 [00:00<00:00, 127.16it/s]

Milvus-Lite to the Cloud
For many use cases we will want to distribute our local data to another computer, cluster or cloud. We could do that at the same time, in a batch, on a delay or at some other time.

Milvus-Lite Dump/Export to Cloud Import at some interval
Dual Ingest to local and other location concurrently
Switch to Cloud Only
Send JSON via Kafka / Pulsar / MQTT
Unstructured Data to MinIO, S3 or Cloud Object Storage

Comments 0 total

    Add comment