GUICourse is a group of complete datasets to train visual-based GUI agents from general VLMs, through improving VLMs' fundamental abilities and GUI knowledge. GUICourse is composed of three datasets: ...
Abstract: Graphical User Interface (GUI) based testing is a commonly used practice in industry. Although valuable and, in many cases, necessary, it is associated with challenges such as high cost and ...
No screenshots. No multi-modal LLMs or special permissions needed. 🧠 Bring your own LLMs 🎨 Pretty UI with human-in-the-loop 🐙 Optional chrome extension for multi-page tasks.