A gesture-based authentication system that replaces frustrating CAPTCHAs and 2FA with simple hand gestures — AI-driven, password-less security that feels human.

Passwords, CAPTCHAs, and 2FA make logging in exhausting — security that frustrates the people it protects.
Every fix adds friction or fragility. Nothing proves you're human in a way that's fast, private, and human.
GestureCAPTCHA: verify identity with intuitive hand gestures, recognized locally by on-device AI.
A working ML model + a flow designed around five real user mental models around trust and consent.
We verify our identity constantly — work accounts, university portals, even recipe sites. Each time we hit the same gatekeepers: passwords, CAPTCHAs, and Two-Factor Authentication. Whether it's hunting for your phone to enter a six-digit code or squinting at a CAPTCHA that can't decide if there's a motorcycle in the image, the process feels exhausting. Security has become a chore we resent.
Of users get frustrated by the elaborate, time-consuming process of logging into a simple website.
Of CAPTCHA attempts need a second try — and many users just close the browser and give up.
Lost or dead, and your entire digital life is locked — banking, social, even laundry machines.
I combined user interviews, sentiment analysis of Reddit forums, and observation studies during real login sessions. Affinity mapping the frustration surfaced five emerging themes — and one central tension.
Repeated codes, frequent logouts, and "remember me" that never does turn logins into a constant chore.
A lost or dead phone locks people out of everything — 2FA ties identity to a single fragile object.
Seen as outdated and ineffective — and AI is making them harder for humans while easier for bots.
The core tension: convenience vs. security. Users want strong protection but hate friction — especially when it feels irrelevant.
"AI's role becomes one of contextual intelligence — learning when to trust, while humans stay in charge of final consent."Insight from my Cognitive Offloading Map
CAPTCHAs are obsolete and infuriating. SMS 2FA is fragile and slow. App-based 2FA adds steps. None of them prove "I'm human" in a way that's fast, private, and actually pleasant. That was the opening.
Mimic a personalized vibration pattern like a rhythm game — a tactile password.
Auto-login from trusted locations, network patterns, and behavioral biometrics.
Verify with intuitive hand gestures recognized by on-device computer vision.
Why gestures? Gen Z communicates with them constantly — peace sign, thumbs up. They're playful and familiar, yet bots can't perform human gestures convincingly. So they solve the security problem and the frustration problem at once. The user performs a short sequence; on-device AI verifies it locally and never stores the image.
Gesture input is novel, and novelty in a security flow breeds anxiety. I designed each decision against how users actually think about being watched, surprised, and asked to act.
A clear local-only disclaimer: "GestureCAPTCHA verifies your gesture locally and never stores your image."
An opt-in "Start Gesture Check" button instead of automatic detection — giving the user agency and consent.
Pair every gesture name with a visual demo, and let users pick gestures they already recognize.
Keep the entire verification embedded in the same tab to preserve continuity and trust.
A brief splash screen prepares the user for what's expected, removing disorientation.
Interviews, Reddit sentiment analysis, and login observation, synthesized through affinity and cognitive-offloading maps to define where AI helps and where the human stays in control.
Mapped the splash → consent → gesture sequence → verified flow, dividing clearly what the AI does from what the human decides.
Designed the embedded, single-tab experience with end-to-end-encryption cues, step counters, and gesture demos baked into each step.
Trained a gesture-recognition model in ML5.js and connected it to the flow — a functional proof that the concept runs in a real browser.
A functioning gesture-recognition model in ML5.js, proving the flow works end-to-end in a real browser — not just in mockups.
Every interaction decision maps to a documented user belief about privacy, consent, and control — design grounded in evidence.
Removes the device-dependency that locks people out — verification needs only a camera the user already has.
Human gestures are hard for bots to fake convincingly, addressing the AI-vs-CAPTCHA arms race head-on.
In security, perceived safety matters as much as actual safety. The disclaimer and opt-in mattered as much as the model.
The cognitive-offloading map kept the human in charge of consent while AI handled the repetitive verification — a balance worth defending.
Gestures aren't universal. The next round needs gesture alternatives and testing with users who can't perform standard hand signs.