Ah OK. I'm on 10.11.4. The plugin flyout doesn't show anything for Runner and the hotkey doesn't seem to work.
Super excited for this though. I've switched almost entirely to searching and running programs through spotlight recently. This seems perfect for Sketch :D
There are some known issues with OS X 10.10 Yosemite. Will be fixed in the next update. Stay tuned! :)