← 全部快讯
AI
kaifaai.app AI 快讯 · 2026-10-20

英伟达推企业级开源模型,支持私有部署AI代理

英伟达发布新系列开源模型,专为在企业数据中心和PC端运行AI代理设计,强化本地化、隐私化AI能力。

英伟达明确将企业私有部署与终端设备AI代理列为战略重心,新发布的开源模型支持在客户自有数据中心运行,同时适配PC端轻量部署场景。此举并非单纯开源权重,而是配套了NIM(NVIDIA Inference Microservices)和RAG-ready架构,使企业能快速构建带知识库、审计日志和权限控制的AI代理系统。官方强调模型已在多个金融、医疗客户环境中完成POC验证,延迟<300ms,吞吐达120 tokens/sec(A10规格)。 这对AI应用创业者意味着:第一,无需自研模型即可获得经工业验证的、开箱即用的企业级Agent底座;第二,模型与NVIDIA硬件深度绑定,但API层完全开放,创业团队可用标准HTTP接口接入,大幅缩短MVP开发周期。建议将NIM作为首选推理后端评估对象,尤其适用于需满足GDPR、HIPAA等合规要求的垂直SaaS产品。

Nvidia launches open models for enterprise and PC AI agents

Nvidia’s new open models are purpose-built for enterprise deployment — supporting RAG, audit logging, and role-based access control out of the box, and optimized for low-latency inference (<300ms) on A10-class hardware. They ship with NVIDIA Inference Microservices (NIM), enabling plug-and-play integration into existing IT infrastructures without model customization. Early adopters include banks and healthcare providers running validated PoCs at production scale. For AI application startups, this lowers the barrier to building compliant, auditable agent systems: no need to train or fine-tune base models, and minimal DevOps overhead to deploy. The NIM API is RESTful and vendor-agnostic in interface design — meaning startups can prototype and launch faster, especially in regulated verticals like finance or health. Evaluate NIM not as a chip lock-in, but as a time-to-revenue accelerator with built-in governance hooks.

来源:TechCrunch AI — Nvidia launches new open models to run agents in the enterprise and on PCs
© 2026 kaifaai.app — AI 产品技术开发 · 28 个方向明码标价