{"type":"video","version":"1.0","html":"<iframe src=\"https://www.loom.com/embed/435b418182f143db9a14630e271bbaa5\" frameborder=\"0\" width=\"1708\" height=\"1281\" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>","height":1281,"width":1708,"provider_name":"Loom","provider_url":"https://www.loom.com","thumbnail_height":1281,"thumbnail_width":1708,"thumbnail_url":"https://cdn.loom.com/sessions/thumbnails/435b418182f143db9a14630e271bbaa5-408bd7d9cf121a57.gif","duration":204.11,"title":"Introducing Desktop Use: An Open-Source Framework for Natural Language Interaction with Desktop Applications","description":"In this video, I introduce my open-source framework called Desktop Use, designed to enable natural language interaction with desktop applications, similar to what Browser Use does for web apps. I demonstrate how users can tag UI components to create a comprehensive sitemap, allowing for hands-free navigation and control through voice commands. During the demo, I showcase features like adjusting image settings, undoing actions, and exporting images, all through natural language prompts. I encourage viewers to explore this framework and consider how it can enhance their own desktop applications. Your feedback and thoughts on potential use cases would be greatly appreciated!"}