NEUROVERSE

NEUROVERSE

A new way to interact.

“Your hands are the interface.”

Neuroverse turns an ordinary webcam into a precise input device. It reads 21 points on each of your hands in real time, so you can pick up light, wield an energy blade and shape thousands of particles without touching a thing.

Enter experienceExplore technology
landmarks per hand
21landmarks per hand
hands at once
2hands at once
frames uploaded
0frames uploaded
labs to explore
4labs to explore
01 / Technology

How a webcam becomes an instrument.

No glove, no controller, no cloud processing. The whole pipeline runs in your browser, from the first camera frame to the last particle.

01234567891011121314151617181920
Fig. 1, hand topology21 points per hand
  1. 01

    Capture

    Your webcam streams into a model that runs inside this browser tab. Nothing is sent anywhere, and the camera only starts when you press the button.

    Webcam, 30 fps, on device

  2. 02

    Landmarks

    MediaPipe Hand Landmarker finds up to two hands and places 21 joints on each one, in three dimensions, every frame.

    21 joints, x y z, two hands

  3. 03

    Gestures

    Finger curl, thumb distance and palm speed become open palm, fist, pinch, point and swipe. A One Euro filter removes jitter without adding lag, and hysteresis stops a held gesture from flickering.

    One Euro filter, hysteresis, cooldowns

  4. 04

    Scene

    Three.js renders the room in real time. Every lab reads the same input, so a pinch means the same thing everywhere.

    WebGL 2, custom shaders

Model
MediaPipe Hand Landmarker, float16, 7.8 MB. WebAssembly, GPU accelerated where available.
Input
Any built-in or USB webcam. 640 by 480 by default, HD on request.
Filtering
One Euro filter on every joint, confirmation delays and per-gesture cooldowns.
Rendering
Three.js through React Three Fiber. Up to 40,000 particles on the GPU.
Privacy
Frames never leave the tab. No recording, no upload, no account.
Fallback
Mouse, trackpad, touch and keyboard controls in every lab.
02 / Labs

Four labs. One vocabulary.

Each lab gives the same few gestures a different character. Learn them once in the playground, then pick up light, cut the air or rebuild a galaxy.

  1. 01

    Energy Lab

    Hold a living core of light.

    A charged core floats in the room, wrapped in thousands of particles that answer to your hand. Pick it up, throw it, drain it, set it off.

    • Pinch near the corePick it up. Carry it, let go to throw.
    • FistPull the particles into your hand.
    • Open palmRelease a burst of energy.
    • Point, then open or close the thumbResize the core.
    Open lab
  2. 02

    Sword Lab

    An energy blade that follows your wrist.

    A machined hilt and a blade of light. Close your hand to ignite it, turn your wrist to aim it, swipe to cut the air.

    • FistIgnite the blade.
    • Open palmRetract it.
    • Move your handMove the sword.
    • Turn your wristRotate the blade.
    Open lab
  3. 03

    Particle Lab

    Thousands of points, one gesture away.

    Tens of thousands of particles hold a form until your hand passes through them. Gather them, spin them, reshape them.

    • Move your handPush the particles aside.
    • FistGather them into a vortex.
    • Pinch and dragRotate the formation.
    • Swipe left or rightChange the form.
    Open lab
  4. 04

    Object Lab

    Two hands, one object.

    Sculptural objects you turn, stretch and roll with both hands, the way you would handle something real on a table.

    • Pinch and dragRotate the object.
    • Pinch with both hands, pull apartScale it up.
    • Pinch with both hands, push togetherScale it down.
    • Turn both hands like a wheelRoll it.
    Open lab
03 / Vocabulary

Six gestures run everything.

Each one is measured from finger curl and thumb distance as ratios of your own palm, so it adapts to any hand size and any distance from the camera.

  • 01

    Open palm

    • Energy: release a burst
    • Sword: retract the blade
    • Objects: swipe to the next one
  • 02

    Fist

    • Energy: pull the particles
    • Sword: ignite the blade
    • Particles: gather a vortex
  • 03

    Pinch

    • Energy: pick up the core
    • Particles: rotate the form
    • Objects: turn the object
  • 04

    Point

    • Energy: resize with the thumb
    • Particles: poke a hole
  • 05

    Swipe

    • Sword: slash
    • Particles: next form
    • Objects: next object
  • 06

    Two hands

    • Particles: scale the form
    • Objects: scale and roll
04 / Begin

Raise a hand.

Open the playground, allow the camera and run the seven-step calibration. No camera? Every lab also works with a mouse, a trackpad or a touch screen.

Enter experienceGo straight to Energy Lab
Camera
Any built-in or USB webcam.
Browser
A recent Chrome, Edge, Firefox or Safari on a laptop or desktop.
Light
Even light in front of you. Avoid a bright window behind.
Distance
Hands about an arm’s length from the screen.