Nvidia sees itself as a hardware overlord of the “metaverse” and dropped some hints about the operation of a parallel 3D universe in which our cartoon selves can work, play and interact.
Podjetje s čipi je dodalo novo opremo v Omniverse – osnovni motor strojne in programske opreme, ki deluje kot jedro planeta, ki združuje virtualne skupnosti v alternativnem 3D-vesolju. Omniverse se uporablja tudi za ustvarjanje avatarjev za izboljšanje resničnih izkušenj v avtomobilih, bolnišnicah in robotih.
“We’re not telling people to replace what they do, we are enhancing what they do,” said Richard Kerris, vice president of the Omniverse platform, during a press briefing.
The Omniverse announcements came during the company’s Konferenca o tehnologiji GPU ta teden. Generalni direktor Nvidia Jensen Huang bo govoril o mnogih od teh objav v torek.
jensen as you’ve never seen him before. Source: Nvidia. Click to enlarge
Ena takšnih objav je Avatar Omniverse, ki lahko ustvari interaktivne, inteligentne avatarje z umetno inteligenco za stvari, kot je pomoč gostom pri naročanju hrane ali pomoč vozniku pri samostojnem parkiranju ali boljši navigaciji po cestah.
Nvidia gave an example of a conversational avatar to replace servers in restaurants. When ordering food, an AI system – represented by an on-screen avatar – could converse in real time using speech recognition and natural intelligence techniques, and use computer vision to capture a person’s mood, and recommend dishes based on the knowledge base.
Za to bo moral avatar izvajati več modelov umetne inteligence – na primer govor, prepoznavanje slike in kontekst – hkrati, kar je lahko izziv. Podjetje je ustvarilo ogrodje Unified Compute Framework, ki modelira AI kot mikrostoritve, tako da lahko aplikacije delujejo v enem ali hibridnem sistemu.
Nvidia že ima osnovne sisteme AI kot je model Megatron-Turing Natural Language Generation – monolitni transformatorski jezik, razvit skupaj z Microsoftom. Sistem bo zdaj na voljo na svoji strojni opremi DGX AI.
Omniverse Avatar je tudi osnovna tehnologija v Drive Concierge – an in-car AI assistant that is a “personal concierge in the car that will be on call for you,” said Deepu Talla, vice president and general manager of Embedded and Edge Computing.
AI systems in cars represented by interactive characters can understand a driver and the car’s occupants through habits, voice and interactions. Accordingly the AI system can make phone calls or offer recommendations of nearby places to eat.
Using cameras and other sensors, the system can also see if a driver is asleep, or alert a rider if they forget something in the car. The AI system’s messages are represented through interactive characters or interfaces on screens.
Stari pes, novi triki
The metaverse concept isn’t new – it has existed through Linden Lab’s Second Life, or games like The Sims. Nvidia hopes to break proprietary walls and create a united metaverse so users to theoretically jump between universes created by different companies.
Med sestankom Nvidia ni omenila pomoči Facebooku pri izpolnjevanju njegove vizije prihodnosti okoli metaverzuma, ki je v središču njegove preoblikovanja v Meta.
But Nvidia is roping other companies into bringing their 3D work to the Omniverse platform through its software connectors. That list includes Esri’s ArcGIS cityEngine, which helps create urban environments in 3D, and Replica Studio’s AI voice engine, which can simulate real voice for animated characters
“What makes this all possible is the foundation of USD, or Universal Scene Description. USD is the HTML of 3D – an important element because it allows for all these software products to take advantage of the virtual worlds we are talking about,” Kerris said. USD was created by Pixar to share 3D assets in a collaborative way.
Napovedala je tudi Nvidia Omniverse Enterprise – naročniška ponudba s skladom programske opreme za pomoč podjetjem pri ustvarjanju 3D delovnih tokov, ki jih je mogoče povezati s platformo Omniverse. Ponudba s ceno 9,000 USD na leto je namenjena industrijskim vertikalam, kot sta inženiring in zabava, in bo na voljo prek preprodajalcev, ki vključujejo Dell, Lenovo, PNY in Supermicro.
The company is also using the Omniverse platform to generate synthetic data on which to train “digital twins,” or virtual simulations of real-world objects. The ISAAC SIM can train robots through synthetic data based on real-world and virtual information. The SIM allows the introduction of new objects, camera views and lighting to create custom data sets on which to train robots.
Avtomobilski ekvivalent je Drive SIM, ki lahko ustvari realistične prizore s pomočjo simuliranih kamer za avtonomno vožnjo. SIM upošteva podatke iz resničnega sveta za usposabljanje modelov AI za avtonomno vožnjo. Modeli objektivov fotoaparata so simulirani in zajemajo pojave iz resničnega sveta, kot so zamegljenost zaradi gibanja, zaklop in utripanje LED.
Nvidia is working closely with sensor makers to replicate Drive SIM data accurately. The camera, radar, lidar and ultrasonic sensor models are all path-traced using RTX graphics technology, according to Danny Shapiro, Nvidia’s vice president for automotive.
Podjetje je v celotno pripoved Omniverse prepletlo nekaj napovedi strojne opreme.
Pridružite se novi generaciji
Razvijalna plošča Jetson AGX Orin naslednje generacije bo izdelovalcem na voljo v prvem četrtletju prihodnjega leta. Ima 12 CPU jeder, ki temeljijo na zasnovah Arm Cortex-A78, 32 GB LPDDR5 RAM-a in zagotavlja 200 TOPS (Tera operacij na sekundo) zmogljivosti.
O Vozite Hyperion 8 je računalniška platforma za avtomobile, ki ima dvojni pogon Orin SoC in zagotavlja zmogljivost do 500 TOPS. Platforma ima 12 kamer, devet radarjev, en lidar in 12 ultrazvočnih senzorjev. Vključen bo v vozila, izdelana leta 2024, in ima modularno zasnovo, tako da lahko proizvajalci avtomobilov uporabljajo samo funkcije, ki jih potrebujejo. Avtomobile s starejšimi računalniki Nvidia je mogoče nadgraditi na Drive Hyperion 8.
Nvidia je napovedala tudi Kvantni-2 InfiniBand switch, which has 57 billion transistors and is being made using Taiwan Semiconductor Manufacturing Co’s 7nm process. It can process 66.5 billion packets per second, and has 64 ports for 400Gbit/sec data transfers, or 128 ports for 200Gbit/sec transfers, we’re told.
Oglasilo se je tudi podjetje Morpheus – okvir umetne inteligence, ki ga je razkril v začetku tega leta, ki prodajalcem kibernetske varnosti omogoča prepoznavanje in opozarjanje podjetij na nepravilno vedenje v omrežju ali podatkovnem centru. Ogrodje prepozna subtilne spremembe v aplikacijah, uporabnikih ali omrežnem prometu za prepoznavanje anomalij in sumljivega vedenja.
Morpheus draws the data it needs from Nvidia’s BlueField SmartNICs/Data Processing Units, which have been imbued with new powers thanks to an upgrade to the DOCA SDK that is to Bluefield DPUs as CUDA is to Nvidia’s GPUs.
The DOCA upgrade – version 1.2 – can also “build metered cloud services that control resource access, validate each application and user [and] isolate potentially compromised machines.” DOCA 1.2 also lets Bluefield devices authenticate software and hardware authentication, apply line-rate data cryptography, and support distributed firewalls that run on the SmartNIC. Nvidia told Register Palo Alto je opazil 5-kratno izboljšanje delovanja požarnega zidu pri zagonu orodij v porazdeljenem načinu na SmartNIC.
Ko že govorimo o AI, tudi o velikanu GPE razširiti its Launchpad program, where it will offer short-term access to AI hardware and software through Equinix data centers in the US, Europe, Japan and Singapore. The latter three locations are Launchpad’s first presences outside the USA, giving Nvidia hope that its function as an AI on-ramp might be more widely adopted.
Druga nova ponudba je nova različica pogovornega orodja RIVA AI, ki je rečeno to be capable of creating a custom human-like voice in a day, based on just 30 minutes of sample speech. Nvidia thinks that’s just the ticket for orgs that want to offer custom speech interfaces. ®
Vir: https://go.theregister.com/feed/www.theregister.com/2021/11/09/nvidia_metaverse/
