MyMatrix - Your AI powered 2nd brain
🧠 What is MyMatrix?
MyMatrix is a free, open-source personal knowledge management system that acts as your second brain. It helps you capture, organize, and retrieve ideas from anywhere—using your voice, photos, videos, or text—and makes your knowledge searchable, shareable, and secure.
Think of it as your personal AI assistant that:
- Captures everything: ideas, articles, videos, meetings, photos
- Organizes automatically: AI-powered tagging and connections
- Retrieves instantly: semantic search finds what you need
- Shares securely: share knowledge with granular access control
- Costs nothing: built on free and open-source tools
🎯 Why MyMatrix?
The Problem with Current Tools
Most knowledge management systems force you to choose:
| Problem | Typical Solution | Trade-off |
|---|---|---|
| Expensive | Notion, Roam ($8-15/mo) | Subscription fatigue |
| Limited Capture | Desktop-only apps | Miss ideas on-the-go |
| Privacy Concerns | Cloud-based services | Your data on their servers |
| Weak Security | Password-protected links | No real access control |
| Vendor Lock-in | Proprietary formats | Can’t leave without losing data |
The Real Problem: Organizing Fatigue
The most painful problem isn’t the tools—it’s the mental burden of organization.
Here’s what happens to most people:
Day 1: See interesting YouTube video
→ Bookmark it (or copy link to notes)
→ "I'll organize this later"
Day 7: Read great article, discover GitHub repo
→ Save links somewhere
→ "I'll tag these properly later"
Day 30: Have brilliant idea during commute
→ Voice memo on phone
→ "I'll transcribe this later"
Day 90: Want to share insights with colleague
→ Can't find that video
→ Can't remember which article had that quote
→ Voice memo lost in 100+ recordings
→ Give up: "I'll look for it later"
Result: 1000+ bookmarks, 500+ notes, 200+ voice memos
All unorganized, unfindable, unshared
Knowledge captured but effectively lost
Why traditional tools fail:
-
Manual organization is exhausting - After absorbing tons of information, who has energy to tag, categorize, and structure everything?
-
Search fails with minimal context - You saved a link with just “interesting video” - now what? Traditional search can’t find it.
-
Ideas evolve, but re-organizing is work - That idea from 3 months ago is now refined, but updating all connections and tags? Too much effort.
-
Sharing requires polish - Can’t share raw notes with colleagues. Need to reorganize, add context, make it presentable. Result: You don’t share.
-
The death spiral - More you capture → more to organize → less energy to organize → more lost → less motivation to capture
This is the core problem MyMatrix solves.
The MyMatrix Solution
MyMatrix eliminates organizing fatigue by making AI do the heavy lifting.
Here’s how the same scenario works with MyMatrix:
Day 1: See interesting YouTube video
→ /youtube-note <link>
→ AI extracts transcript, summarizes, auto-tags
→ Stored in searchable vault
✅ Done in 5 seconds
Day 7: Read great article, discover GitHub repo
→ /capture <link> "useful for authentication project"
→ AI analyzes content, tags, suggests related notes
✅ Done in 5 seconds
Day 30: Have brilliant idea during commute
→ Voice record on MyMatrix mobile app
→ Auto-transcribed, AI-tagged, synced to vault
✅ Done in 5 seconds
Day 90: Want to share insights with colleague
→ Search "authentication security"
→ Semantic search finds ALL related content
→ Video, article, repo, voice note—all connected
→ Click /share → choose access level (private/team/public) → get link
✅ Found and shared in 30 seconds
Result: 1000+ notes, fully organized, instantly findable
Zero manual organization required
Always ready to share
Knowledge captured AND accessible
Core Principles:
✅ Zero-Effort Capture: Drop a link, speak a thought, snap a photo—that’s it ✅ AI Does the Work: Automatic tagging, summarization, connection-building ✅ Smart Search: Find things even with minimal context (“that authentication video”) ✅ Always Share-Ready: Notes are always organized enough to share ✅ Auto-Evolution: AI updates connections as your knowledge grows—no manual re-organization
Additional Benefits:
✅ Free Forever: Built on open-source tools ✅ Capture Anywhere: Mobile app for voice, photo, video, audio ✅ Privacy First: Your data stays on your devices ✅ Enterprise Security: Role-based access control (RBAC) ✅ Future-Proof: Open standards, portable data ✅ Remote Access: SSH tunneling to access from anywhere
🏗️ How MyMatrix Works
Core Architecture
Here’s how MyMatrix works from input to output:

Key Workflow:
- Capture Layer (Blue) - Desktop and mobile inputs processed by Claude AI
- Organization Layer (Purple) - Obsidian acts as your knowledge base with AI-powered automatic organization
- Discovery Layer (Orange) - Semantic search via vector database enables natural language queries
- Sharing Layer (Green) - Secure sharing through GitLab with access control
The Core Principle: AI performs the heavy lifting of organization, tagging, and connection-building—so you don’t have to.
📱 Mobile Capture: Your Ideas, Anywhere
Introducing the MyMatrix Mobile App
Never lose an idea again. The MyMatrix mobile app transforms any moment into a capture opportunity:
🎤 Voice Capture
Walking to work? → Press record → Speak your idea
→ Auto-transcribed → AI-tagged → Saved to vault
Time: 5 seconds from thought to note
Use cases:
- Morning shower thoughts
- Commute insights
- Exercise breakthroughs
- Meeting follow-ups
📸 Photo Capture
See interesting content? → Snap a photo
→ OCR extracts text → AI analyzes → Creates note
Supports: Books, whiteboards, presentations, receipts
Use cases:
- Book highlights
- Whiteboard sessions
- Conference slides
- Visual inspiration
🎥 Video Capture
Record a moment → AI extracts key frames
→ Transcribes audio → Creates multimedia note
Supports: Lectures, demos, tutorials
Use cases:
- Educational content
- How-to demonstrations
- Video notes from courses
- Visual documentation
🎵 Audio Recording
Long conversation? → Record it
→ Auto-transcribe → Extract action items → Create notes
Supports: Meetings, podcasts, interviews
Use cases:
- Team meetings (+ action items)
- Podcast episodes (+ summaries)
- Interviews (+ key quotes)
- Lectures (+ study guides)
📝 Quick Text
Got a second? → Type a few words
→ AI expands → Tags automatically → Syncs instantly
Use cases:
- Quick reminders
- URLs to read later
- Contact info
- Random thoughts
Mobile App Features
Core Capabilities:
- ✅ Offline Mode: Capture without internet, sync later
- ✅ Background Recording: Keep capturing while using other apps
- ✅ Auto-Sync: Seamless sync with desktop vault
- ✅ Cross-Platform: iOS + Android (Flutter-based)
- ✅ Privacy-First: All processing on your device or server
- ✅ Free Forever: No in-app purchases, no subscriptions
Smart Features:
- AI suggests tags while you capture
- Related notes appear automatically
- Voice commands for hands-free operation
- Batch processing for multiple captures
- Smart folders (auto-organize by type)
🌐 Remote Access: Your Brain, Everywhere
SSH Tunneling for Secure Remote Access
Access your knowledge base from anywhere, securely:
# From any device with internet
ssh -L 8080:localhost:8080 user@your-server.com
# Access Obsidian vault via web interface
# Your data never touches third-party servers
Use cases:
- Working from coffee shop
- Traveling without laptop
- Using library computer
- Emergency access from phone browser
Security:
- End-to-end encrypted tunnel
- No cloud intermediary
- Your server, your rules
- Audit logs for all access
💡 What Makes MyMatrix Different?
Comparison with Alternatives
| Feature | Notion | Obsidian Publish | Roam Research | LogSeq | MyMatrix |
|---|---|---|---|---|---|
| Cost | $8-15/mo | $8/mo | $15/mo | Free | $0 |
| Auto-Organization | ❌ Manual | ❌ Manual | ❌ Manual | ❌ Manual | ✅ AI-powered |
| Mobile Capture | Limited | ❌ No | Limited | Basic | 🎤📸🎥🎵📝 |
| Voice Input | ❌ No | ❌ No | ❌ No | ❌ No | ✅ Full |
| AI Tagging | Basic | ❌ No | ❌ No | ❌ No | ✅ Advanced |
| Semantic Search | Basic | ❌ No | ❌ No | ❌ No | ✅ Full |
| Self-Hosted | ❌ No | ❌ No | ❌ No | ✅ Yes | ✅ Yes |
| RBAC | Basic | Basic | Basic | ❌ No | ✅ Enterprise |
| Remote Access | Cloud | ❌ No | Cloud | ❌ No | ✅ SSH |
| Data Privacy | Their servers | Their servers | Their servers | Local | ✅ Your servers |
| Open Source | ❌ No | ❌ No | ❌ No | ✅ Yes | ✅ Yes |
Unique Value Propositions
- Zero Organizing Fatigue: AI does the heavy lifting—you just capture, it organizes
- Capture Everything, Everywhere: Desktop (text), Mobile (voice/photo/video/audio), Remote (SSH)
- Find Anything with Minimal Context: Semantic search works even when you barely remember the details
- Always Share-Ready: Notes are automatically organized enough to share—no manual polish needed
- Zero Cost: No subscriptions, ever
- True Privacy: Your data, your servers, your rules—local AI processing
- Enterprise Security: RBAC + audit logs + SSO for secure sharing
- Future-Proof: Open standards, portable markdown, no vendor lock-in
💰 Cost Analysis
Current PKM Solutions (Annual Costs)
Typical Setup:
- Notion/Roam subscription: $144-180/year
- Smart Connections (Obsidian): $120/year
- GitHub Pro (private repos): $48/year
- Mobile OCR app: $24/year
- Cloud storage (extra): $60/year
- Total: ~$400-450/year
MyMatrix Total Cost (Annual)
Core Components:
- Obsidian: $0 (free, optional $25 one-time for mobile sync)
- Claude Code/Desktop: $0 (free with Claude Pro, which you might already have)
- ChromaDB (semantic search): $0 (open-source)
- GitLab CE (publishing): $0 (self-hosted)
- MyMatrix Mobile App: $0 (open-source)
- SSH remote access: $0 (built-in)
Optional Costs:
- Hardware (one-time):
- Budget: Raspberry Pi 4 (8GB) = $75
- Performance: Mini PC (16GB RAM) = $300-500
- Electricity: ~$20-30/year (mini PC 24/7)
- Domain name (optional): $12/year
Total Annual Cost: $20-80/year Savings: $350-430/year (87-95% reduction)
🚀 Development Roadmap
Philosophy: Use what we have NOW, make it accessible EVERYWHERE, then gradually replace with free alternatives.
Phase 1: Desktop Foundation ✅ COMPLETE
Status: Fully operational (current state)
What’s Working:
- Claude Code/Desktop integration
- Obsidian vault as knowledge base
- AI-powered capture (/capture, /idea, /youtube-note, /study-guide)
- Repository analysis (/gitingest)
- Semantic search (Smart Connections)
- GitHub Pages for sharing (basic password protection)
Current Capability: Desktop-only, powerful capture & organization
Phase 2: Remote Access via P2P VPN 🚧 IN PROGRESS
Timeline: 4-6 weeks Goal: Use Claude Code from anywhere via mobile browser
Why This First? You already have a powerful desktop setup. Before building new tools, make what you have accessible on-the-go. Peer-to-peer VPN lets you access your desktop’s Claude Code from your phone’s browser—no server hosting needed.
Technical Approach:
Option A: Tailscale (Recommended - Easiest)
# On desktop (your "server")
curl -fsSL https://tailscale.com/install.sh | sh
tailscale up
# On mobile browser
# Visit: http://100.x.x.x:PORT (your Tailscale IP)
# Access Claude Code web UI
Pros:
- ✅ Free for personal use (20 devices)
- ✅ Zero-config P2P VPN (NAT traversal automatic)
- ✅ Works on cellular data
- ✅ Encrypted by default
- ✅ 5-minute setup
Cons:
- Relies on Tailscale service (though P2P data transfer)
Option B: WireGuard + DDNS (Full Control)
# On desktop
# Set up WireGuard server
# Configure DDNS (DuckDNS, No-IP)
# Mobile connects via WireGuard app
Pros:
- ✅ Fully self-hosted
- ✅ No third-party service
Cons:
- More complex setup
- Requires dynamic DNS
- May not work on some networks (CGNAT)
Features to Implement:
- P2P VPN setup guide (Tailscale + WireGuard options)
- Claude Code web UI optimization for mobile browsers
- Quick capture form (mobile-optimized)
- Voice input via browser Web Speech API
- Connection status monitoring
- Auto-reconnect on network change
- Bookmark/home screen shortcut guide
Deliverable: Access your desktop Claude Code + Obsidian vault from phone browser anywhere
User Experience:
Morning commute → Open Safari/Chrome on phone
→ Visit your Tailscale URL
→ Voice capture: "Capture: idea for meal planning app"
→ AI processes on your desktop
→ Note appears in vault
→ Total time: 10 seconds
Phase 3: Native Mobile App (Web Replacement) 📱 PLANNED
Timeline: 8-12 weeks after Phase 2 Goal: Replace mobile browser with dedicated app for better UX
Why After P2P VPN? Phase 2 proves the concept with minimal effort. Once validated, build a native app for:
- Better voice capture UX
- Background operation
- Offline-first capture (sync later)
- Native photo/video capture
- System integration (share sheet, widgets)
Mobile App Features:
Capture Modes:
- 🎤 Voice notes (instant transcription via Whisper)
- 📸 Photo capture (OCR + AI tagging)
- 🎥 Video notes (scene extraction + transcript)
- 🎵 Audio recording (meetings, lectures, podcasts)
- 📝 Quick text capture
- 🔗 URL capture (article analysis)
Smart Features:
- Offline mode (capture without internet, sync later)
- Background recording (continues when screen off)
- Batch processing (bulk capture → AI processes overnight)
- Auto-sync with desktop vault
- Voice commands (“MyMatrix, capture this idea…”)
- Smart suggestions (AI suggests tags while you capture)
Technical Stack:
- Framework: Flutter (single codebase → iOS + Android)
- Speech-to-text: Whisper API or local model
- OCR: Tesseract (local, free)
- Sync: Git-based or custom API to desktop
- Storage: SQLite (local-first)
Deliverable: Native iOS + Android app, better than mobile browser UX
My Recommendation: Consider Progressive Web App (PWA) first before native app:
- Installable from browser (like native app)
- Push notifications
- Offline support
- Share sheet integration
- 90% of native features, 10% of development time
- No App Store approval delays
Phase 4: Component Alternatives (Freedom Options) 🆓 PLANNED
Timeline: 6-8 weeks after Phase 3 Goal: Provide free alternatives to replace paid/proprietary components
Why Now? You have a working system (desktop + mobile). Now give users choice to replace expensive components with free alternatives based on their priorities.
Replacement Strategy: Modular Options
Users choose which components to replace based on their needs:
Option 1: Replace GitHub Pages → GitLab CE (Better Sharing)
Priority: High (security + RBAC)
Why Replace:
- GitHub Pages: Basic password protection only
- GitLab CE: Enterprise RBAC, user management, audit logs, SSO
Implementation:
- GitLab CE self-hosting guide (Docker Compose one-command)
- Jekyll/Hugo static site generator
- One-command sharing workflow:
/share note.md --access team - Role-based access control setup
- User/group management
- Audit logging (who accessed what, when)
Deliverable: Secure sharing with granular access control
Option 2: Replace Claude Code → Gemini + Ollama (Cost Reduction)
Priority: Medium (save $20/mo, but quality trade-off)
Why Replace:
- Claude Code: $20/mo, excellent quality
- Gemini Free Tier: 1,000 req/day, 90% quality
- Ollama (local): Unlimited, 80% quality, offline
Implementation:
- Gemini API integration (free tier)
- Ollama local setup guide
- Hybrid routing: Gemini (primary) → Ollama (fallback/offline)
- Quality comparison dashboard
- Easy toggle: Claude ↔ Gemini ↔ Ollama
My Recommendation: Keep Claude as default, offer Gemini+Ollama as “budget mode”:
mymatrix config --ai-provider gemini # Save $20/mo
mymatrix config --ai-provider claude # Best quality
mymatrix config --ai-provider ollama # Offline/privacy
Deliverable: Users choose: Pay for quality (Claude) vs. Free (Gemini/Ollama)
Option 3: Replace Smart Connections → ChromaDB (Free Semantic Search)
Priority: Low (Smart Connections is already affordable)
Why Replace:
- Smart Connections: $120/year (if premium)
- ChromaDB: Free, open-source, fast
Implementation:
- ChromaDB local setup
- Embedding model selection (sentence-transformers)
- Auto-index vault on save
- Semantic search UI
- Related notes suggestions
Deliverable: Free semantic search, fully local
Option 4: Advanced Voice Features (Whisper Local)
Priority: Medium (improve Phase 3 mobile app)
Why Add:
- Phase 3 uses browser voice (limited)
- Whisper (local): Better accuracy, works offline, multilingual
Implementation:
- Whisper model integration (local or API)
- Conversation transcription (long recordings)
- Meeting notes with action items extraction
- Speaker diarization (basic: you vs. others)
- Podcast/lecture summarization
Deliverable: Professional-grade voice transcription
Phase 4 Summary: Modular replacements—users pick based on priorities:
- Save money: Replace Claude with Gemini/Ollama
- Better sharing: Replace GitHub with GitLab RBAC
- Full freedom: Replace all proprietary components
- Keep hybrid: Mix and match (e.g., Claude + GitLab)
Phase 5: Security Enhancement (SSO + Advanced Auth) 🔒 PLANNED
Timeline: 4-6 weeks after Phase 4 Goal: Enterprise-grade authentication and access control
Why Now? Phase 4 gave you GitLab for sharing. Now add enterprise auth:
- SSO (Google, Microsoft, Okta)
- Multi-factor authentication (MFA)
- Session management
- API key rotation
Features:
SSO Integration:
- Google Workspace SSO
- Microsoft 365 SSO
- Okta integration
- SAML 2.0 support
- OAuth 2.0 providers
Advanced Security:
- Multi-factor authentication (TOTP, WebAuthn)
- Session timeout policies
- IP allowlisting
- API key management
- Audit log exports (compliance)
- Encryption at rest (optional)
Access Control:
- Per-note permissions (who can view/edit)
- Time-limited share links (expire after 7 days)
- Watermarking (track leaks)
- Download restrictions
Deliverable: Enterprise-ready security for teams
My Recommendation: This is critical for enterprise adoption. Add compliance features:
- GDPR compliance (data export, right to deletion)
- SOC 2 readiness (audit logs, access controls)
- HIPAA considerations (if healthcare users)
Phase 6: Team Vault (Collaboration) 👥 PLANNED
Timeline: 8-12 weeks after Phase 5 Goal: Multi-user knowledge base with real-time collaboration
Why Last? Collaboration is complex. Build it after security (Phase 5) is solid.
Team Features:
Multi-User Vault:
- Shared team vault (separate from personal)
- Real-time sync (operational transform)
- Conflict resolution (Google Docs style)
- User presence indicators (“Alice is editing…”)
- Version history (who changed what, when)
Collaboration Tools:
- Comment threads on notes
- @mentions and notifications
- Task assignments (“@Bob, review this”)
- Team chat (in-app messaging)
- Approval workflows (draft → review → published)
Team Analytics:
- Most active contributors
- Knowledge coverage map
- Search analytics (what people look for)
- Sharing metrics (most viewed notes)
- Team growth over time
Deliverable: MyMatrix for teams (2-50 users)
My Recommendations:
A. Start with “Team View” (Simpler) Before full collaboration, add read-only team sharing:
- Personal vault stays private
- “Team” folder syncs to shared space
- Others can view/search, but not edit
- Easier to build, 80% of value
B. Add Async Collaboration (Not Real-Time) Real-time sync is hard. Start with:
- Comments (not live editing)
- Suggested changes (PR-style)
- Scheduled merges (sync once per day)
- Reduces complexity, still useful
C. Consider Team Size Tiers:
- Small Team (2-5 users): Simple shared folder
- Medium Team (5-20 users): Role-based access
- Large Team (20+ users): Full enterprise features
Phase 7: Ecosystem & Integrations 🌐 ONGOING
Timeline: Continuous after Phase 6 Goal: MyMatrix as your knowledge hub—connected to everything
Browser Extension (High Priority)
- Quick capture from any webpage
- Highlight text → save to vault
- Automatic URL + content extraction
- Right-click context menu
- Keyboard shortcut (Alt+M)
- Chrome, Firefox, Safari support
Email Integration
- Forward emails to vault (email-to-note@mymatrix.ai)
- Parse email → structured note
- Attachments handling
- Calendar event extraction
Third-Party Integrations:
- Slack/Discord bots (search vault from chat)
- Zapier/IFTTT connectors
- Calendar sync (meetings → notes)
- Task manager integration (Todoist, Things)
- RSS feed reader (auto-capture articles)
- Pocket/Instapaper import
Advanced Features:
- Multi-vault support (work, personal, projects)
- Advanced graph views (filter by tags, time)
- AI-powered insights (“You haven’t reviewed these in 30 days”)
- Spaced repetition (Anki-style learning)
- Export formats (PDF, EPUB, presentation slides)
- Full text search across attachments (PDF OCR)
- Voice commands via Siri/Google Assistant
- Smart watch quick capture
Deliverable: Complete knowledge ecosystem
My Recommendations:
Priority Order:
- Browser extension (high impact, easy to build)
- Email-to-vault (huge value for knowledge workers)
- Slack bot (team adoption driver)
- RSS feed reader (content aggregation)
- Everything else (based on user requests)
📊 Roadmap Summary
| Phase | Focus | Timeline | Status | Investment |
|---|---|---|---|---|
| Phase 1 | Desktop Foundation | Done | ✅ Complete | $0 (using Claude Pro) |
| Phase 2 | P2P VPN Remote Access | 4-6 weeks | 🚧 Next | $0 (Tailscale free) |
| Phase 3 | Native Mobile App | 8-12 weeks | 📱 Planned | $0 (self-built) |
| Phase 4 | Component Alternatives | 6-8 weeks | 🆓 Planned | $0 (open-source) |
| Phase 5 | SSO & Security | 4-6 weeks | 🔒 Planned | $0 (self-hosted) |
| Phase 6 | Team Vault | 8-12 weeks | 👥 Planned | $0 |
| Phase 7 | Ecosystem | Ongoing | 🌐 Continuous | $0 |
Total Time to Full Product: ~9-12 months Total Cost: $20-80/year (after initial hardware investment)
🎯 Recommended Priority Adjustments
Based on typical user needs, I suggest this parallel development approach:
Quick Wins (Can Build in Parallel):
- Browser extension (Phase 7) - Build during Phase 2
- High value, low effort
- Increases capture frequency
- Independent of other phases
- GitLab sharing (Phase 4) - Build during Phase 3
- Critical for professional users
- Can start before mobile app
- Solves security pain point early
Strategic Sequencing:
- ✅ Your Plan is Solid: P2P VPN first makes perfect sense
- 💡 Recommendation: Add browser extension in Phase 2 (parallel)
- 💡 Recommendation: Move GitLab to Phase 3 (before component alternatives)
- 💡 Recommendation: Add “Team View” (read-only) before full collaboration
Revised Priority:
- P2P VPN (your Phase 2) ← Start here
- Browser Extension (parallel with #1) ← Quick win
- GitLab Sharing (your Phase 4) ← Move up
- Native Mobile App (your Phase 3) ← After proving VPN works
- Component Alternatives (your Phase 4) ← Keep as-is
- SSO Security (your Phase 5) ← Keep as-is
- Team Vault (your Phase 6) ← Keep as-is
This gives you:
- Remote access NOW (Phase 2)
- Better capture NOW (browser extension)
- Secure sharing SOONER (GitLab before mobile)
- Mobile app AFTER validating remote workflow
🎨 Design Philosophy
Local-First Software
Your data should live on your devices, not in someone else’s cloud.
- Offline-first: Works without internet
- Sync when ready: No forced cloud dependency
- Full control: Delete anytime, no vendor lock-in
- Fast: No network latency
- Private: No one can see your data
Privacy by Design
Privacy isn’t a feature, it’s the foundation.
- Local AI: Processing on your hardware
- Encrypted transit: SSH tunnels only
- No tracking: Zero telemetry or analytics
- Self-hosted: You control the servers
- Audit logs: See who accessed what
Open-Source Ethos
Code you can trust, tools you can modify.
- Transparent: Audit the entire codebase
- Forkable: Don’t like something? Change it
- Community-driven: Contributions welcome
- No vendor lock-in: Standards-based
- Forever free: No rug pulls, no price increases
🛠️ Technology Stack
Core Components
| Layer | Technology | Why? | Cost |
|---|---|---|---|
| Capture | Claude Code/Desktop | Best AI quality, slash commands | $20/mo (Claude Pro) |
| Mobile | Flutter | Cross-platform, single codebase | Free |
| Storage | Obsidian + Markdown | Future-proof, portable | Free |
| AI Brain | Claude API (primary) | Highest quality tagging/analysis | Included in Pro |
| AI Fallback | Gemini (free tier) | 1,000 req/day, no cost | Free |
| Local AI | Ollama + Llama 3.1 | Privacy, offline capability | Free |
| Search | ChromaDB | Fast vector search | Free |
| Sharing | GitLab CE + Jekyll | RBAC, secure links | Free |
| Remote Access | P2P VPN (Tailscale) + Web UI | Secure, anywhere | Free |
| Transcription | Whisper (local) | Speech-to-text, audio analysis | Free |
Why Claude + Obsidian?
Claude Code/Desktop for Capture:
- Industry-leading AI quality
- Natural language slash commands
- Great for complex content analysis
- Already installed and familiar
- Worth the $20/mo for quality
Obsidian for Organization:
- Markdown = future-proof format
- Local-first architecture
- Powerful plugin ecosystem
- Graph view for connections
- Free forever, yours to keep
The Perfect Combination:
- Capture: AI-powered (Claude Code)
- Organize: Human-friendly (Obsidian)
- Retrieve: Semantic search (ChromaDB)
- Share: Secure with access control (GitLab RBAC)
👥 Who is MyMatrix For?
Ideal Users
1. Information Absorbers with Organizing Fatigue
- Consume tons of content daily (articles, videos, repos, podcasts)
- Save links everywhere but never organize them
- Can’t find things when needed: “I know I saved that video somewhere…”
- Ideas improve over time but re-organizing feels like too much work
- Want to share knowledge but notes aren’t “ready” enough
- This is YOU if: You have 1000+ bookmarks, 500+ untagged notes, and feel guilty about the mess
Real-world scenario:
You: "Hey team, remember that authentication approach I mentioned?"
Colleague: "Yeah! Can you share that video?"
You: *scrolls through 200 bookmarks*
You: "Uh... I'll send it later" *never does*
With MyMatrix:
You: "Hey team, remember that authentication approach?"
→ Search "authentication video security jwt"
→ Finds it in 3 seconds (with GitHub repo and article too)
→ /share --access team → get shareable link
Colleague: "Wow, this is thorough!"
2. Privacy-Conscious Professionals
- Don’t want notes in corporate clouds
- Need audit trails and compliance
- Require data sovereignty
- Value security over convenience
3. Students & Researchers
- Can’t afford multiple subscriptions
- Need to organize massive amounts of content
- Want AI-powered study guides
- Capture lectures, research papers, ideas
4. Content Creators
- Manage research for articles/videos
- Capture inspiration on-the-go
- Organize sources and references
- Build personal knowledge graphs
5. Software Developers
- Document learning and projects
- Capture code snippets and solutions
- Build personal wiki
- Self-hosted infrastructure preference
6. Knowledge Workers
- Manage multiple projects
- Capture meeting notes and action items
- Share knowledge with teams
- Need powerful search
7. Entrepreneurs
- Business ideas and strategies
- Market research and analysis
- Customer insights
- Cost-conscious, need free tools
⚠️ Challenges & Trade-offs
Be Realistic
MyMatrix is NOT for everyone:
❌ If you want zero setup: Use Notion (pay for convenience) ❌ If you need mobile-first NOW: Wait for Phase 2 (weeks 5-12) ❌ If you have no technical skills: Current version requires some CLI comfort ❌ If you need real-time team collaboration: Wait for Phase 6 (weeks 21-24)
✅ MyMatrix is for you IF:
- You value privacy and ownership
- You’re comfortable with some technical setup
- You want to save $400/year
- You prefer open-source tools
- You’re willing to invest time for long-term benefits
Setup Complexity
Time Investment:
- Initial setup: 2-4 hours
- Learning curve: 1-2 weeks
- Customization: Ongoing
Technical Requirements:
- Comfortable with command line (basic)
- Can install software on Mac/Linux/Windows
- Optional: Basic server administration (for self-hosting)
Support:
- Documentation: Comprehensive guides
- Community: Discord + GitHub Discussions
- Examples: Video tutorials
- Help: Issue tracker for bugs
🔬 Validation & Testing
Proven Concepts
Already Working (Phase 1):
- ✅ Claude Code integration (thousands of users)
- ✅ Obsidian vaults (millions of users)
- ✅ AI-powered tagging (tested on 500+ notes)
- ✅ Semantic search (ChromaDB in production)
- ✅ GitLab RBAC (enterprise-proven)
Need Validation (Phase 2-3):
- 🔬 Mobile app UX (beta testing planned)
- 🔬 Voice capture accuracy (Whisper benchmarks)
- 🔬 SSH remote access UX (user testing)
- 🔬 Cross-platform sync reliability
Quality Metrics
Technical:
- Tagging accuracy: >85% vs manual
- Search relevance: >90% precision@10
- Sync speed: <5s for typical note
- Uptime: >99% (self-hosted)
- Mobile capture: <10s thought-to-note
User Experience:
- Setup time: <2 hours (technical users)
- Daily captures: 10-30 per active user
- Retention: 90%+ after 30 days
- Satisfaction: 4.5+/5 average rating
🚀 Getting Started
Quick Start (Phase 1 - Available Now)
Prerequisites:
- Claude Pro subscription ($20/mo)
- Obsidian installed
- Basic command line familiarity
Step 1: Set up Obsidian vault (10 min)
# Create vault directory
mkdir ~/MyMatrix
cd ~/MyMatrix
# Initialize git (for version control)
git init
# Open in Obsidian
# File → Open vault → Select ~/MyMatrix
Step 2: Install Claude Code (5 min)
# Download from https://claude.ai/code
# Or use Claude Desktop with slash commands
Step 3: Configure slash commands (15 min)
# Create .claude/commands/ directory in vault
mkdir -p .claude/commands
# Add custom slash commands for capture
# (Templates provided in documentation)
Step 4: Test capture workflow (5 min)
# In Claude Code/Desktop:
/capture Build a chrome extension for article summarization
# Check Obsidian vault - note should appear with AI tags
Step 5: Set up semantic search (30 min)
# Install Smart Connections plugin in Obsidian
# Or set up ChromaDB (documentation provided)
Total setup time: ~1 hour You’re now ready to build your second brain!
What’s Next?
Join the Community:
- 📖 Read the full documentation: docs.mymatrix.ai
- 💬 Join Discord: discord.gg/mymatrix
- 🐛 Report issues: github.com/mymatrix/issues
- 🌟 Star on GitHub: github.com/mymatrix
Stay Updated:
- Phase 2 (Mobile App): Coming in 8-12 weeks
- Phase 3 (Remote Access): Coming in 9-12 weeks
- Beta testing: Sign up for early access
Contribute:
- Code contributions welcome
- Documentation improvements
- UI/UX feedback
- Feature suggestions
- Bug reports
📚 Resources
Documentation
Tutorials
- Video: Getting Started (15 min)
- Video: Mobile Capture Workflow (10 min)
- Video: Advanced AI Tagging (20 min)
- Video: Secure Sharing with GitLab RBAC (25 min)
Community
Technical
🎯 Vision
MyMatrix aims to be the standard for personal knowledge management:
- Free: No subscriptions, ever
- Open: Transparent code, community-driven
- Private: Your data, your servers
- Powerful: AI-enhanced organization
- Universal: Desktop + mobile + remote
- Secure: Enterprise-grade access control
- Future-proof: Open standards, portable data
The ultimate goal: Every person should have access to a powerful second brain without sacrificing privacy, paying monthly fees, or vendor lock-in.
💬 Frequently Asked Questions
Q: Is MyMatrix really free? A: Yes. All software is open-source. You only pay for:
- Claude Pro subscription ($20/mo) - which you might already have
- Optional: Hardware for self-hosting ($75-500 one-time)
- Optional: Electricity (~$2-3/mo)
Q: Do I need to be technical? A: Basic technical skills help (command line, installing software), but we’re building detailed guides. If you can use Obsidian, you can use MyMatrix.
Q: When will mobile app be ready? A: Beta launch planned for 8-12 weeks from now. Sign up for early access.
Q: Can I use it without Claude? A: Eventually yes (Phase 5), using free alternatives (Gemini + Ollama). But Claude provides the best quality today.
Q: Is my data private? A: Yes. Everything runs locally or on your servers. Claude API only sees content you explicitly send for analysis. No telemetry, no tracking.
Q: Can teams use it? A: Phase 6 (weeks 21-24) adds team collaboration. For now, it’s single-user focused.
Q: How does it compare to Notion? A: Notion is easier to start but costs $8-15/mo, stores data in their cloud, and locks you in. MyMatrix is free, local-first, and yours forever—but requires initial setup.
Q: Can I migrate from [other tool]? A: Yes. Markdown import from most tools. Guides for Notion, Roam, Evernote, etc.
Q: I have thousands of unorganized bookmarks and notes. Will MyMatrix help? A: Yes! This is exactly what MyMatrix solves. Just import your messy notes, then:
- Run bulk AI tagging on everything (one command)
- Let semantic search index it all (automatic)
- Search naturally: “that video about authentication” works even with zero tags
- AI finds connections between old and new notes automatically
- No manual re-organization needed—ever
Q: What if I just paste links with minimal context? Will it still work? A: Absolutely! That’s the point. Examples:
- You paste: “https://youtube.com/watch?v=abc123 useful”
- AI extracts: Full transcript, summary, tags: [video, tutorial, react, hooks, performance]
- Later you search: “react hooks performance” → Finds it instantly
Even with minimal input, AI creates rich, searchable notes.
Q: My ideas evolve over time. Do I need to manually update old notes? A: No! AI automatically:
- Detects related notes as your knowledge grows
- Suggests connections between old and new ideas
- Updates semantic index so search improves naturally
- Shows you “related notes” without manual linking
Your knowledge graph grows organically—zero maintenance.
Q: I want to share notes but they’re too messy. What should I do? A: MyMatrix notes are always “share-ready” because:
- AI organizes them automatically (tags, structure, summary)
- You can preview before sharing
- Choose access level: private (just you), team (colleagues), or public (anyone with link)
- Recipients see clean, organized content—not your raw dumps
Sharing goes from “I’ll clean this up later” (never happens) to “here’s the link” (2 clicks with /share).
MyMatrix: Your Knowledge, Your Control, Your Future
Document Status:
- Version: 3.0 (Product Introduction + Realistic Roadmap)
- Last Updated: 2025-10-30
- Target Audience: Potential users, investors, contributors
- Reading Time: 35 minutes
- Next Review: After Phase 2 (P2P VPN) completion
Changes from v2.1:
- Emphasized “sharing” over “publishing” - consistent terminology throughout (using
/sharecommand) - Complete roadmap rewrite - matches actual development plan:
- Phase 2: P2P VPN for remote access (Tailscale/WireGuard) - NEXT
- Phase 3: Native mobile app (after validating remote workflow)
- Phase 4: Component alternatives (modular replacement options)
- Phase 5: SSO security enhancement
- Phase 6: Team vault collaboration
- Phase 7: Ecosystem integrations
- Added technical implementation details - P2P VPN setup, mobile app architecture
- Provided recommendations - PWA vs native app, browser extension priority, GitLab timing
- Philosophy shift - “Use what we have NOW, make it accessible EVERYWHERE, then replace”
- Updated technology stack - P2P VPN (Tailscale) as remote access method
Changes from v2.0:
- Added “Organizing Fatigue” as core problem - dedicated section explaining why manual organization fails
- New #1 user persona - “Information Absorbers with Organizing Fatigue” with real-world scenarios
- Enhanced comparison table - added “Auto-Organization” and “Semantic Search” rows
- Updated Value Propositions - prioritized organizing fatigue solution as #1 differentiator
- Expanded FAQ - 4 new questions specifically addressing organizing challenges
- Side-by-side scenarios - showed before/after workflows with concrete examples
Changes from v1.0:
- Repositioned as product introduction (not technical architecture)
- Clarified Claude + Obsidian as core capture/organize stack
- Added comprehensive mobile capture capabilities (voice, photo, video, audio)
- Added SSH remote access to roadmap
- Simplified technical details
- Added user personas and FAQ
- Included realistic timeline and phase breakdown