All notable changes to AutoFlow are documented here.
- HUD overlay not appearing —
SPI_GETWORKAREAcan return all-zeros on some systems, placing the window at negative coordinates off-screen. Now falls back toSM_CXSCREEN/SM_CYSCREENif the work area is unusable. - Saved overlay position ignored when off-screen — position from a disconnected monitor now validates against
MonitorFromRect(MONITOR_DEFAULTTONULL)and falls back to default if the window would be invisible. - HUD window now properly shown/hidden —
show_recording()/show_playing()callShowWindow(SW_SHOWNOACTIVATE)if the window was hidden;hide_window()(used on browser disconnect) callsSW_HIDEinstead of just changing draw state. - Multi-monitor playback clicks —
move_mouse_absnow usesSM_CXVIRTUALSCREEN/SM_CYVIRTUALSCREENwithMOUSEEVENTF_VIRTUALDESKso clicks on secondary monitors land at the correct position. GetWindowTextWin low-level hook callback — could block the hook and cause Windows to deregister it (~5 s timeout). Foreground HWND is now captured in the hook; title and rect are fetched in the background thread.- Duplicate
last.kind = "double_click"assignment — copy-paste artifact removed. auto_wait_stepnever called — the function existed but was never invoked. Now called before every click, scroll, hotkey, and type burst so automatic wait steps are actually inserted between recorded actions.- Dead
del_workflowfunction — path-param delete handler that was never routed; removed. - Tray icon always showing fallback blue square —
load_icon()was loading from<exe>/static/icon.png(doesn't exist at runtime); now loads from the embeddedAsset::get("icon.png"). Addedstatic/icon.pngto the source. play_stop/play_pause/play_resumenot broadcasting state — browser status indicator didn't update when playback was stopped/paused/resumed via HTTP.- Path traversal in workflow load/delete —
fileparameter from request body was joined to the workflows directory without sanitisation. Addedsanitize_filename()applied to both handlers. - CORS accepting any origin — restricted to
http://localhost:7878andhttp://127.0.0.1:7878. - Schedule export hardcoded past trigger date —
generate_schedule_zipnow computes tomorrow at 09:00 instead of the static2026-07-25T09:00:00. Box::leakper hotkey in keyboard hook — replaced withVec<String>to eliminate per-keystroke allocation leak.- Orphaned doc comment in
recorder.rs— stale comment placed before wrong function removed.
- AI step naming (
✨ AI Namesbutton and/api/ai/describeendpoint) — feature required a separate Ollama installation; removed to keep AutoFlow fully self-contained.
Complete rewrite in Rust. 3.1 MB single EXE, instant startup, no Python or runtime dependencies.
- Rust rewrite — axum + tokio HTTP/WebSocket server replaces Flask + Socket.IO
rust-embedbundles all static assets into the EXE — no externalstatic/folder- windows-rs for all Win32, COM, and UIA calls (no ctypes, no pywin32)
- System tray via
tray-icon; frameless HUD via raw Win32CreateWindowExW - Single-instance guard via
TcpListener::bind— duplicate launch opens browser to existing instance
- F9 global hotkey — start/stop recording from any application without switching focus
- Win32
WH_MOUSE_LL+WH_KEYBOARD_LLhooks for system-wide capture - UI Automation (UIA/COM/STA) element detection with accessible name → help text → AutomationId → child walk fallback
- Consecutive scrolls at the same position merge automatically
- Region screenshot thumbnails captured per click with red target-circle annotation
- Smart new-tab detection: retries context check up to 4 times (400 ms apart) to skip blank/loading pages
- Frameless floating Win32 window always above all apps; drag to reposition, position persisted
- Buttons communicate directly via
std::sync::mpscchannel — no HTTP round-trip - Hides immediately when the last browser tab's WebSocket disconnects
- Smart window-ready check before every click: waits for target window to respond before acting
- Async playback engine with pause/resume/step-through
- Recursive Run Workflow step for chaining workflows
- Adjustable speed: 0.25×–4×; start from any step
- AI step naming via local Ollama (
qwen3:8b) —✨ AI Namesrenames all steps in one click - Two-click delete confirmation — arm (✕) then confirm (red "Delete?" for 3.5s)
- Undo delete:
Ctrl+Zrestores up to 10 steps in sequence
- Task Scheduler export —
⏰ Scheduleproduces a ZIP with Python script + Windows Task Scheduler XML - PDF, Python script, and ZIP package exports retained from v1.0.0
Initial public release (Python / Flask / PyInstaller).
- Record mouse clicks, keystrokes, hotkeys, and scroll events across any Windows application
- Smart cleanup on recording stop: consecutive scrolls merged, navigational preamble collapsed
- Instant thumbnails — per-click screenshots; element detection runs in background
- UI Automation element detection with CDP (Chrome accessibility) and Win32 fallbacks
- Image-based click matching for browser targets without accessibility APIs
- Card view (drag-and-drop) and compact table view
- Disable steps, undo delete, per-step notes, unsaved-change indicator
- Keyboard shortcuts:
Ctrl+Rrecord,Ctrl+Pplay,Ctrl+Ssave,Escstop,Ctrl+Zundo delete
Click, Type, Hotkey, Wait, Scroll, Navigate, Loop, If/Else, Set Variable, Run Script, Comment, Error Handler, Launch Browser, Show Message, Wait for Element/Window, Get/Set Clipboard, Image Click, Read/Write/Copy/Move/Delete File, HTTP Request, Open File/App, Kill Process, Close Window, Play Sound, Screenshot
- PDF report, Python script, ZIP package
- Flask + Socket.IO; single-file EXE via PyInstaller
- System tray, Win32 HUD overlay, portable JSON workflow storage