Long-form README: https://chunjee.github.io/graphicsearch.ahk

A fast, super powerful, and flexible screen searching library for AHK

Can be thought of as an alternative to native AHK Imagesearch command. The native command requires saved image files, nearly identical image matching, can be difficult to troubleshoot, and performs in a relatively slow manner. GraphicSearch approaches searching differently. Think of ASCII art; GraphicSearch abstracts the screen's image into representative 0's and _'s. Because this is an abstraction, not a bit-for-bit comparison, it allows for faster matching and easier adjustments of fault tolerance. It can also check for several different graphics without recapturing the screen's image every time. Perhaps most useful, it can return all matches unlike AHK ImageSearch which only returns the first match.

In a terminal or command line:

npm install graphicsearch.ahk

In your code only export.ahk needs to be included:

#Include %A_ScriptDir%\node_modules
#Include graphicsearch.ahk\export.ahk

oGraphicSearch := new graphicsearch()
result := oGraphicSearch.search("|<HumanReadableTag>*165$22.03z")
; => [{1: 1215, 2: 407, 3: 22, 4: 10, id: "HumanReadableTag", x: 1226, y: 412}]

You may also review or copy the library from ./export.ahk on GitHub #Incude as you would normally when manually downloading.

finds GraphicSearch queries on the screen

The GraphicSearch query(s) to search. Must be concatinated with | if searching multiple graphics

The options object

the search scope's upper left corner coordinates

the search scope's lower right corner coordinates

Fault tolerance of graphic and background (0.1=10%)

Wether or not to capture a new screenshot or not. If the value is 0, the last captured screenhhot will be used

Wether or not to find all instances or just one.

Join all GraphicsSearch queries for combination lookup.

Set the Max offset for combination lookup

(Array) Return an array of objects containing all lookup results, else false if no matches were found.

optionsObj := {   x1: 0
                , y1: 0
                , x2: A_ScreenWidth
                , y2: A_ScreenHeight
                , err1: 0
                , err0: 0
                , screenshot: 1
                , findall: 1
                , joinqueries: 1
                , offsetx: 1
                , offsety: 1 }

oGraphicSearch.search("|<tag>*165$22.03z", optionsObj)
oGraphicSearch.search("|<tag>*165$22.03z", {x2: 100, y2: 100})

performs the last .search with the last arguments supplied

oGraphicSearch.search("|<tag>*165$22.03z", {x2: 1028, y2: 720})

oGraphicSearch.searchAgain()
oGraphicSearch.searchAgain("|<HumanReadableTag>*99$26.z7z")

finds GraphicSearch queries on the screen

GraphicsSearch queries as strings. Can be multiple queries separated by |

the search scope's upper left corner coordinates

the search scope's lower right corner coordinates

A number between 0 and 1 (0.1=10%) for fault tolerance of foreground (err1) and background (err0)

if the value is 1, a new capture of the screen will be used; else it will use the last capture

if the value is 1, graphicsearch will find all matches. for 0, only return one match

if the value is 1, Join all GraphicsSearch queries for combination lookup

Set the Max offset for combination lookup

(Array) Return an array of objects containing all lookup results, else false if no matches were found. Any result is an associative array {1:X, 2:Y, 3:W, 4:H, x:X+W//2, y:Y+H//2, id:tag}. All coordinates are relative to Screen, colors are in RGB format, and combination lookup must use uniform color mode

oGraphicSearch.scan("|<tag>*165$22.03z", 1, 1, 1028, 720, .1, .1, 1, 1, 1, 0, 0)
; => [{1: 1215, 2: 400, 3:22, 4: 10, id: "tag", x:1226, y:412}]

performs the last .search with the last arguments supplied

oGraphicSearch.scan("|<tag>*165$22.03z", {x2: 1028, y2: 720})

oGraphicSearch.scanAgain()
oGraphicSearch.scanAgain("|<HumanReadableTag>*99$26.z7z")

functionally identicle to .scan but uses legacy argument order as a convience for old scripts

the search scope's upper left corner coordinates

the search scope's lower right corner coordinates

A number between 0 and 1 (0.1=10%) for fault tolerance of foreground (err1) and background (err0)

GraphicsSearch queries as strings. Can be multiple queries separated by |

if the value is 1, a new capture of the screen will be used; else it will use the last capture

if the value is 1, graphicsearch will find all matches. for 0, only return one match

if the value is 1, Join all GraphicsSearch queries for combination lookup

Set the Max offset for combination lookup

Set the direction search is conducted in

1( Left to Right / Top to Bottom )
2( Right to Left / Top to Bottom )
3( Left to Right / Bottom to Top )
4( Right to Left / Bottom to Top )
5( Top to Bottom / Left to Right )
6( Bottom to Top / Left to Right )
7( Top to Bottom / Right to Left )
8( Bottom to Top / Right to Left )
9( Center to Four Sides )

Zoom percentage of image width and height (0.1=10%)

(Array) Return an array of objects containing all lookup results, else false if no matches were found. Any result is an associative array {1:X, 2:Y, 3:W, 4:H, x:X+W//2, y:Y+H//2, id:tag}. All coordinates are relative to Screen, colors are in RGB format, and combination lookup must use uniform color mode

oGraphicSearch.find(x1, y1, x2, y2, err1, err0, "|<tag>*165$22.03z", 1, 1, 0, 20, 10)
; => [{1: 1215, 2: 400, 3: 22, 4: 10, id: "tag", x: 1226, y: 412}]

Sort the results object from left to right and top to bottom, ignoring slight height difference

The GraphicSearch results object to sort

The ammount of height difference to ingnore in pixels

(Array) Return an array of objects containing all lookup results

resultsObj := [ {1: 2000, 2: 2000, 3: 22, 4: 10, id: "HumanReadableTag", x: 2000, y: 2000}
              , {1: 1215, 2: 400, 3: 22, 4: 10, id: "HumanReadableTag", x: 1226, y: 412}]

oGraphicSearch.resultSort(resultsObj)
; => [{1: 1215, 2: 400, 3: 22, 4: 10, id: "HumanReadableTag", x: 1226, y: 412}, {1: 2000, 2: 2000, 3: 22, 4: 10, id: "HumanReadableTag", x: 2000, y: 2000}]

Sort the results objects by distance to a given x,y coordinate. A property "distance" is added to all elements in the returned result object

The GraphicSearch results object

The x screen coordinate to measure from

The y screen coordinate to measure from

(Array) Return an array of objects containing all lookup results

resultsObj := [ {1: 2000, 2: 2000, 3: 22, 4: 10, id: "HumanReadableTag", x: 2000, y: 2000}
              , {1: 1215, 2: 400, 3: 22, 4: 10, id: "HumanReadableTag", x: 1226, y: 412}]

oGraphicSearch.resultSortDistance(resultsObj, 2000, 2000)
/*
[ {1: 2000, 2: 2000, 3: 22, 4: 10, distance: "12.08", id: "HumanReadableTag", x: 2000, y: 2000}
, {1: 1215, 2: 400, 3: 22, 4: 10, distance: "1766.58", id: "HumanReadableTag", x: 1226, y: 412}]
*/