NAME Win32::GuiTest - Perl GUI Test Utilities. SYNOPSIS use Win32::GuiTest qw(FindWindowLike GetWindowText SetForegroundWindow SendKeys); $Win32::GuiTest::debug = 0; # Set to "1" to enable verbose mode my @windows = FindWindowLike(0, "^Microsoft Excel", "^XLMAIN\$"); for (@windows) { print "$_>\t'", GetWindowText($_), "'\n"; SetForegroundWindow($_); SendKeys("%fn~a{TAB}b{TAB}{BS}{DOWN}"); } INSTALLATION // This batch file comes with MS Visual Studio. Running // it first might help with various compilation problems. vcvars32.bat perl makefile.pl nmake nmake test nmake install See more details in the DEVELOPMENT section elswhere in this document. You can get the most recent release from . The package will contain Win32-GuiTest.ppd file and Win32-GuiTest.tar.gz file, which is all that you need to use ppm. If you put those 2 files in C:\TEMP directory, the installation should look as follows. Enter PPM (Perl Package Manager) from the command-line and type commands as below C:\TEMP>ppm PPM interactive shell (2.0) - type 'help' for available commands. PPM> install C:\temp\win32-guitest.ppd Install package 'C:\temp\win32-guitest.ppd?' (y/N): Y Retrieving package 'C:\temp\win32-guitest.ppd'... Writing C:\Perl\site\lib\auto\Win32\GuiTest\.packlist PPM> I extracted them to 'c:\temp', please use the directory where you extracted the files instead. DESCRIPTION Most GUI test scripts I have seen/written for Win32 use some variant of Visual Basic (e.g. MS-VB or MS-Visual Test). The main reason is the availability of the SendKeys function. A nice way to drive Win32 programs from a test script is to use OLE Automation (ActiveX Scripting), but not all Win32 programs support this interface. That is where SendKeys comes handy. Some time ago Al Williams published a Delphi version in Dr. Dobb's (http://www.drdobbs.com/keys-to-the-kingdom/184410429). I ported it to C and packaged it using h2xs... The tentative name for this module is Win32::GuiTest (mostly because I plan to include more GUI testing functions). I've created a Yahoo Group for the module that you can join at http://groups.yahoo.com/group/perlguitest/join Also, an initial version of a script recording application has been written to use with this module. A copy of it may be found with this distribution (Recorder\Win32GuiTest.exe) or can be obtained at http://sourceforge.net/projects/winguitest If the documentation of these functions is not satisfactory, you can try running a search on http://msdn.microsoft.com/ using the name of the function. Some of these functions are described there. This distribution of the module - the one you are looking at now - has its own CVS repository at http://sourceforge.net/projects/winguitest Patches to both the code and the documentation are welcome. Functions $debug When set enables the verbose mode. SendKeys($keys[,$delay]) Sends keystrokes to the active window as if typed at the keyboard using the optional delay between key-up and key-down messages (default is 25 ms and should be OK for most uses). The keystrokes to send are specified in KEYS. There are several characters that have special meaning. This allows sending control codes and modifiers: ~ means ENTER + means SHIFT ^ means CTRL % means ALT The parens allow character grouping. You may group several characters, so that a specific keyboard modifier applies to all of them. Groups can be enclosed in groups. E.g. SendKeys("ABC") is equivalent to SendKeys("+(abc)") The curly braces are used to quote special characters (SendKeys("{+}{{}") sends a '+' and a '{'). You can also use them to specify certain named actions: Name Action {BACKSPACE} Backspace {BS} Backspace {BKSP} Backspace {BREAK} Break {CAPS} Caps Lock {DELETE} Delete {DOWN} Down arrow {END} End {ENTER} Enter (same as ~) {ESCAPE} Escape {HELP} Help key {HOME} Home {INSERT} Insert {LEFT} Left arrow {NUMLOCK} Num lock {PGDN} Page down {PGUP} Page up {PRTSCR} Print screen {RIGHT} Right arrow {SCROLL} Scroll lock {TAB} Tab {UP} Up arrow {PAUSE} Pause {F1} Function Key 1 ... ... {F24} Function Key 24 {SPC} Spacebar {SPACE} Spacebar {SPACEBAR} Spacebar {LWI} Left Windows Key {RWI} Right Windows Key {APP} Open Context Menu Key or supply a number that will be treated as a VK code. Note that a single-digit number will be treated as a character, so prepend these with '0'. All these named actions take an optional integer argument, like in {RIGHT 5}. For all of them, except PAUSE, the argument means a repeat count. For PAUSE it means the number of milliseconds SendKeys should pause before proceding. In this implementation, SendKeys always returns after sending the keystrokes. There is no way to tell if an application has processed those keys when the function returns. Unicode characters in $keys are translated into set of ALT+NUMPAD keystrokes. Note that not all applications can understand unicode input. SendMouse($command) This function emulates mouse input. The COMMAND parameter is a string containing one or more of the following substrings: {LEFTDOWN} left button down {LEFTUP} left button up {MIDDLEDOWN} middle button down {MIDDLEUP} middle button up {RIGHTDOWN} right button down {RIGHTUP} right button up {LEFTCLICK} left button single click {MIDDLECLICK} middle button single click {RIGHTCLICK} right button single click {ABSx,y} move to absolute coordinate ( x, y ) {RELx,y} move to relative coordinate ( x, y ) Note: Absolute mouse coordinates range from 0 to 65535. Relative coordinates can be positive or negative. If you need pixel coordinates you can use MouseMoveAbsPix. Also equivalent low-level functions are available: SendLButtonUp() SendLButtonDown() SendMButtonUp() SendMButtonDown() SendRButtonUp() SendRButtonDown() SendMouseMoveRel(x,y) SendMouseMoveAbs(x,y) MouseMoveAbsPix($x,$y) Move the mouse cursor to the screen pixel indicated as parameter. # Moves to x=200, y=100 in pixel coordinates. MouseMoveAbsPix(200, 100); MouseMoveWheel($change) Positive or negative value to direct mouse wheel movement. FindWindowLike($window,$titleregex,$classregex,$childid,$maxlevel) Finds the window handles of the windows matching the specified parameters and returns them as a list. You may specify the handle of the window to search under. The routine searches through all of this windows children and their children recursively. If 'undef' then the routine searches through all windows. There is also a regexp used to match against the text in the window caption and another regexp used to match against the text in the window class. If you pass a child ID number, the functions will only match windows with this id. In each case undef matches everything. GetWindowID($window) Returns the control Id of the specified window. PushButton($button[,$delay]) Equivalent to PushChildButton(GetForegroundWindow, BUTTON, DELAY) PushChildButton($parent,$button[,$delay]) Allows generating a mouse click on a particular button. parent - the parent window of the button button - either the text in a button (e.g. "Yes") or the control ID of a button. delay - the time (0.25 means 250 ms) to wait between the mouse down and the mouse up event. This is useful for debugging. PushChildById( $parent, $button, $level, $delay ) Allows pushing a button, which control id is eqaul to a given parameter. "PushChildButton" tries to match parameter against control id or caption. PushChildById matches only against control id. Secondly, PushChildById allows specifying search depth in the windows hierarchy tree. The default is 2, which means that only direct children will be pushed. WaitWindowLike($parent,$wndtitle,$wndclass,$wndid,$depth,$wait) Function which allows one to wait for a window to appear vs. using hard waits (e.g. sleep 2). parent - Where to start (parent window) wndtitle - Regexp for the window title wndclass - Regexp for the window class name wndid - Numeric Window or Control ID depth - How deep should we search before we stop wait - How many seconds should we wait before giving up WaitWindow($wndtitle,[$wait]) Minimal version of WaitWindowLike. Only requires the window title regexp. You can also specify the wait timeout in seconds. wndtitle - Regexp for the window title wait - How many seconds should we wait before giving up IsWindowStyle($window, $style) Determines if a window has the specified style. See sample script for more details. IsWindowStyleEx($window, $exstyle) Determines if a window has the specified extended style. See sample script for more details. GetMenu Using the corresponding library function (see MSDN) it returns a MenuID number GetMenuItemIndex($curr, $menu); $curr is a MenuId and $menu is the (localized !) name of the menu including the hot key: "Rep&eate" Returns the index of the menu item (-1 if not found) GetMenuItemCount($menu) Returns the number of elements in the given menu. MenuSelect($menupath,$window,$menu) Allows selecting a menu programmatically. Simple Examples: # Exit foreground application through application menu. MenuSelect("&File|E&xit"); # Exit foreground application through system menu MenuSelect("&Close", 0, GetSystemMenu(GetForegroundWindow(), FALSE)); GetMenuItemInfo($menuHndl, $cnt) Receives a menu handler (one we got from GetMenu or GetSubMenu) and a number (which is the location of the item within the given menu). Returns a hash of which there are currently 2 keys: type can be either "string" or "separator" - this is the type of the menu item text is the visible text of the menu item (provided only for "string" type) WARNING: This is an experimental function. Its behavior might change. MouseClick($window [,$parent] [,$x_offset] [,$y_offset] [,$button] [,$delay]) Allows one to easily interact with an application through mouse emulation. window = Regexp for a Window caption / Child caption, or just a Child ID. parent = Handle to parent window. Default is foreground window. Use GetDesktopWindow() return value for this if clicking on an application title bar. x_offset = Offset for X axis. Default is 0. y_offset = Offset for Y axis. Default is 0. button = {LEFT}, {MIDDLE}, {RIGHT}. Default is {LEFT} delay = Default is 0. 0.50 = 500 ms. Delay between button down and button up. Simple Examples: # Click on CE button if its parent window is in foreground. MouseClick('^CE$'); # Right click on CE button if its parent window is in foreground MouseClick('^CE$', undef, undef, undef, '{RIGHT}'); # Click on 8 button window under the specified parent window; where # [PARENTHWND] will be replaced by a parent handle variable. MouseClick('8', [PARENTHWND]); # Click on Calculator parent window itself MouseClick('Calculator', GetDesktopWindow()); $buf_str = AllocateVirtualBuffer( $hwnd, $size ) Allocates memory in the address space of the process, which is an owner of a window identified by $hwnd. Returns a reference to a hash, which has 2 elements: ptr - address of the allocated memory process - process handle (in the Win32 meaning, as returned by Win32 OpenProcess API function $value = ReadFromVirtualBuffer( $buf_str, $size ) Read from a memory in the address space of the other process. $buf_str is a reference to a hash returned by AllocateVirtualBuffer. Returns read value. WriteToVirtualBuffer( $buf_str, $value ) Write to a memory in the address space of the other process. $buf_str is a reference to a hash returned by AllocateVirtualBuffer. $value is a value to be copied. FreeVirtualBuffer( $buf_str ) Frees memory allocated by AllocateVirtualBuffer $text = WMGetText($hwnd) * Sends a WM_GETTEXT to a window and returns its contents $set = WMSetText(hwnd,text) * Sends a WM_SETTEXT to a window setting its contents ($x,$y) = GetCursorPos() * Retrieves the cursor's position,in screen coordinates as (x,y) array. GetCaretPos() Retrieves the caret's position, in client coordinates as (x,y) array. (Like Windows function) HWND SetFocus(hWnd) Sets the keyboard focus to the specified window HWND GetDesktopWindow() * Returns a handle to the desktop window HWND GetWindow(hwnd,uCmd) * SV * GetWindowText(hwnd) * Get the text name of the window as shown on the top of it. Beware, this is text depends on localization. $class = GetClassName(hwnd) * Using the same Windows library function returns the name of the class wo which the specified window belongs. See MSDN for more details. You can also check out MSDN to see an overview of the Window Classes. HWND GetParent(hwnd) * A library function (see MSDN) to return the WindowID of the parent window. See MSDN for the special cases. long GetWindowLong(hwnd,index) * BOOL SetForegroundWindow(hWnd) * See corresponding Windows functions. @wnds = GetChildWindows(hWnd) Using EnumChildWindows library function (see MSDN) it returns the WindowID of each child window. If the children have their own children the function returns them too until the tree ends. BOOL IsChild(hWndParent,hWnd) * Using the corresponding library function (see MSDN) it returns true if the second window is an immediate child or a descendant window of the first window. $depth = GetChildDepth(hAncestor,hChild) Using the GetParent library function in a loop, returns the distance between an ancestor window and a child (descendant) window. Features/bugs: If the given "ancsetor" is not really an ancestor, the return value is the distance of child from the root window (0) If you supply the same id for both the ancestor and the child you get 1. If the ancestor you are checking is not 0 then the distance given is 1 larger than it should be. see eg\get_child_depth.pl $res = SendMessage(hWnd,Msg,wParam,lParam) * This is a library function (see MSDN) used by a number of the functions provided by Win32::GuiTest. It sends the specified message to a window or windows. HWnd is the WindowID or HWND_BROADCAST to send message to all top level windows. Message is not sent to child windows. (If I understand this correctly this means it is sent to all the immediate children of the root window (0). Msg the message wParam additional parameter lParam additioanl parameter It is most likely you won't use this directly but through one of the functions implemented already in Win32::GuiTest. See the guitest.xs for some examples. $res = PostMessage(hwnd,msg,wParam,lParam) * See corresponding Windows library function in MSDN. CheckButton(hwnd) UnCheckButton(hwnd) GrayOutButton(hwnd) BOOL IsCheckedButton(hwnd) BOOL IsGrayedButton(hwnd) The names say it. Works on radio buttons and checkboxes. For regular buttons, use IsWindowEnabled. BOOL IsWindow(hwnd) * ($x,$y) = ScreenToClient(hwnd,x,y) * ($x,$y) = ClientToScreen(hwnd,x,y) * ($x,$y) = GetCaretPos(hwnd) *A HWND SetFocus(hWnd) *A HWND GetFocus(hwnd) *A HWND GetActiveWindow(hwnd) *A HWND GetForegroundWindow() * HWND SetActiveWindow(hwnd) *A BOOL EnableWindow(hwnd,fEnable) * BOOL IsWindowEnabled(hwnd)* BOOL IsWindowVisible(hwnd)* BOOL ShowWindow(hwnd,nCmdShow) *A See corresponding Windows functions. ($x,$y) = ScreenToNorm(x,y) Returns normalised coordinates of given point (0-FFFF as a fraction of screen resolution) ($x,$y) = NormToScreen(x,y) The opposite transformation ($x,$y) = GetScreenRes() Returns screen resolution HWND WindowFromPoint(x, y) ($l,$t,$r,$b) = GetWindowRect(hWnd) * ($l,$t,$r,$b) = GetClientRect(hWnd) * See corresponding Windows functions. SelComboItem($window, $index) Selects an item in the combo box based off an index (zero-based). SelComboItemText($window, $txt) Selects an item in the combo box based off text (case insensitive). $txt = GetComboText(hwnd,index) $txt = GetListText(hwnd,index) @lst = GetComboContents(hWnd) @lst = GetListContents(hWnd) Fetch the contents of the list and combo boxes. GetAsyncKeyState($key) IsKeyPressed($key) Wrapper around the GetAsyncKeyState API function. Returns TRUE if the user presses the specified key. IsKeyPressed("ESC"); IsKeyPressed("A"); IsKeyPressed("DOWN"); IsKeyPressed( VK_DOWN); SendRawKey($virtualkey,$flags) Wrapper around keybd_event. Allows sending low-level keys. The first argument is any of the VK_* constants. The second argument can be 0, KEYEVENTF_EXTENDEDKEY, KEYEVENTF_KEYUP or a combination of them. KEYEVENTF_EXTENDEDKEY - Means it is an extended key (i.e. to distinguish between arrow keys on the numeric keypad and elsewhere). KEYEVENTF_KEYUP - Means keyup. Unspecified means keydown. #Example use Win32::GuiTest qw/:FUNC :VK/; while (1) { SendRawKey(VK_DOWN, KEYEVENTF_EXTENDEDKEY); SendKeys "{PAUSE 200}"; } VkKeyScan(int) "GetListViewContents($handle)" Return the items of the list view with C<$handle> as a list, each element of which is a reference to an array containing the values in each column. SelListViewItem($window, $idx, [$multi_select]) Selects an item in the list view based off an index (zero-based). # Select first item, clears out any previous selections. SelListViewItem($win, 0); # Select an *additional* item. SelListViewItem($win, 1, 1); SelListViewItemText($window, $txt, [$multi_select]) Selects an item in the list view based off text (case insensitive). # Select first item, clears out any previous selections. SelListViewItemText($win, 'Temp'); # Select an *additional* item. SelListViewItemText($win, 'cabs', 1); IsListViewItemSel($window, $txt) Determines if the specified list view item is selected. GetTabItems($window) Returns a list of a tab control's labels. SelTabItem($window, $idx) Selects a tab based off an index (zero-based). SelTabItemText($window, $txt) Selects a tab based off text label (case insensitive). IsTabItemSel($window, $txt) Determines if the specified tab item is selected. SelTreeViewItemPath($window, $path) Selects a tree view item based off a "path" (case insensitive). # Select Machine item and Processors sub-item. SelTreeViewItemPath($window, "Machine|Processors"); SelTreeViewItemPath($window, "Item"); GetTreeViewSelPath($window) Returns a string containing the path (i.e., "parent|child") of the currently selected tree view item. $oldpath = GetTreeViewSelPath($window); SelTreeViewItemPath($window, "Parent|Child"); SelTreeViewItemPath($window, $oldpath); $hpopup = GetPopupHandle($hwnd, $x, $y, [$wait]) This function gets the handle of a popup window generated by right-clicking at the $x and $y screen coordinates (absolute). An optional delay can be entered which will wait the given number of milliseconds after the right-click for the window to appear (default is 50). Zero is returned when no popup menu is found. DibSect A class to manage a Windows DIB section. Currently limited in functionality to 24-bit images. Pulled from old code into GuiTest when I (jurasz@imb.uni-karlsruhe.de) needed to create several grayscale screen dumps. Possible future extenstions: other color resolutions, loading, comparison of bitmaps, getting from clipboard. Synopsis: $ds = new Win32::GuiTest::DibSect; $ds->CopyWindow($w); $ds->ToGrayScale(); $ds->SaveAs("bla.bmp"); $ds->ToClipboard(); bool DibSect::CopyClient(hwnd,[rect]) Copy a client area of given window (or possibly its subset) into a given DibSect. The rectangle may be optionally passed as a reference to 4-element array. To get the right result make sure the window you want to copy is not obscured by others. bool DibSect::CopyWindow(hwnd) Copy the window rectangle. Equivalent to $ds->CopyClient(GetDesktopWindow(), \@{[GetWindowRect($w)]}); bool DibSect::SaveAs(szFile) Save the current contents of the DIB section in a given file. With 24-bit resolution it can grow quite big, so I immediately convert them to PNG (direct writing of PNG seemed to complicated to implement). bool DibSect::Invert() Invert the colors in a current DIB section. bool DibSect::ToGrayScale() Convert the DibSection to the gray scale. Note that it is still encoded as 24-bit BMP for simplicity. bool DibSect::ToClipboard() Copies the DibSect to clipboard (as an old-fashioned metafile), so that it can be further processed with your favourite image processing software, for example automatically using SendKeys. bool DibSect::Destroy() Destroys the contents of the DIB section. UNICODE SUPPORT Currently (2007) there's no consensus about unicode input in Perl, so the module declares function "UnicodeSemantics" that sets whether information queried from windows should use A or W syscalls. The function that support this differentiation, and produce different results depending on value set to "UnicodeSemantics" is: "GetWindowText", and all its callers, - FindWindowLike, WaitWindow, WaitWindowLike "SendKeys" translated unicode characters into set of ALT+NUMPAD keystrokes. Note that not all applications can understand unicode input. UnicodeSemantics [BOOL] If a boolean parameter is set, changes the semantics flag for functions that return results of either A or W syscalls. If the parameter is not set, returns the current value of the flag. DEVELOPMENT If you would like to participate in the development of this module there are several thing that need to be done. For some of them you only need Perl and the latest source of the module from CVS for others you'll also need to have a C++ compiler. To get the latest source code you need a CVS client and then do the following: cvs -d:pserver:anonymous@cvs.sourceforge.net:/cvsroot/winguitest login cvs -z3 -d:pserver:anonymous@cvs.sourceforge.net:/cvsroot/winguitest co Win32-GuiTest See more detailed explanations here http://sourceforge.net/projects/winguitest/ cygwin g++ needs to be installed perl Makefile.PL make make test make install MSVC environment To setup a development environment for compiling the C++ code you can either buy Visual Studio with Visual C++ or you can download a few things free of charge from Microsoft. There might be other ways too we have not explored. The instructions to get the free environment are here: From http://www.microsoft.com/ download and install: 1) Microsoft .NET Framework Version 1.1 Redistributable Package 2) .NET Framework SDK Version 1.1 This is not enough as there are a number of header files and libraries that are not included in these distributions. You can get them from Microsoft in two additional downloads. For these you will have to be using Internet Explorer. Visit http://www.microsoft.com/msdownload/platformsdk/sdkupdate/ and install 1) Core SDK 2) Microsoft Data Access Components 2.7 Before you can compile you'll have to open a command prompt and execute the "sdkvars.bat" script from the.NET SDK that will set a number of environment variables. In addition you'll have to run the "setenv.bat" you got with the Core SDK (and located in C:\Program Files\Microsoft SDK) with the appropriate parameters. For me this was /XP32 /RETAIL In order to finish the packaging you'll also need the tar, gzip and zip utilities from http://gnuwin32.sourceforge.net/packages.html I have not tried it yet. After this you will probably be able to do the normal cycle: perl makefile.pl nmake nmake test or run perl makedist.pl SEE ALSO Module's documentation is available at . TODO Here are a few items where help would be welcome. Perl only Improve Tests Improve documentation Add more examples and explain them C++ compiler needed Add more calls to the C++ backend Fix current calls 32bit custom controls (some already implemented) Possibly Java interfaces Retreive the list of the menu of a given window. COPYRIGHT The SendKeys function is based on the Delphi sourcecode published by Al Williams in Dr.Dobbs . Copyright (c) 1998-2002 Ernesto Guisado, (c) 2004 Dennis K. Paulsen. All rights reserved. This program is free software; You may distribute it and/or modify it under the same terms as Perl itself. AUTHORS Ernesto Guisado (erngui@acm.org), http://triumvir.org Jarek Jurasz (jurasz@imb.uni-karlsruhe.de), http://www.uni-karlsruhe.de/~gm07 wrote DibSect and some other pieces (see "Changes" for details). Dennis K. Paulsen (ctrondlp@cpan.org) wrote various pieces (See "Changes" for details). Dmitry Karasik (dmitry@karasik.eu.org) added support for unicode and cygwin/mingw. CREDITS Thanks very much to: Johannes Maehner Ben Shern Phill Wolf Mauro Sohrab Niramwalla Frank van Dijk Jarek Jurasz Wilson P. Snyder II Rudi Farkas Paul Covington Piotr Kaluski ...and more... for code, suggestions and bug fixes.