Screenpipe

ScreenPipe

ScreenPipe is an AI SDK and platform that enables you to capture your computer screen and audio, then install and run hundreds of AI agents that utilize this data. It functions as a context layer for AGI, helping you build, deploy, and manage personal or business AI assistants that leverage your on-device screen and audio context. The project emphasizes openness (open source), B2B usability, and an ecosystem of plugins and apps through an AI App Store.

---

Key Capabilities

• Screen and audio capture from your desktop for AI processing
• Access to a large catalog of AI agents and plugins
• Open-source foundation with commercial-friendly licensing
• B2B support and enterprise options
• AI App Store for discovering and installing plugins and apps
• Options to request custom apps or demos for business needs
• Privacy-conscious architecture designed for on-device context usage
• Documentation and community resources for developers and users

---

How It Works

1. Install ScreenPipe on your computer to enable screen and audio capture.
2. Browse or search the AI App Store to find agents and plugins that fit your workflow.
3. Install selected agents and configure them to access your screen/audio context.
4. Run agents that interact with your desktop data to automate tasks, analyze activity, or augment decision-making.
5. For organizations, request custom apps or demos tailored to specific use cases.

---

Use Cases

• Personal AI assistants that reference your desktop context for decisions
• Workflow automation and productivity enhancements using live screen data
• Data gathering and analysis across apps and windows for research or auditing
• Custom enterprise assistants built from reusable plugins

---

Safety, Privacy, and Compliance Considerations

• Screen and audio capture processes should be enabled only with explicit user consent.
• Data never transmitted without consent; respect on-device processing and privacy policies.
• Enterprises should audit installed plugins and manage access controls for sensitive information.

---

Core Features

• Screen capture of desktop activity (video) and audio recording
• Access to hundreds of AI agents/plugins via an app store
• Open-source platform with community contributions
• B2B and enterprise offerings, including custom apps and demos
• Marketplace for installing and updating plugins and apps
• Developer-friendly documentation and resources
• Privacy-forward design emphasizing local processing and control