iuscommunity / ius-tools Goto Github PK

The 'admin sync' process doesn't include the EUA or GPG Key which need to be in the base of the repo as well.

The --passphrase does not except a value, rather it just stores true.

For the ability to automate GPG key signing... need a clean way of reading the GPG passphrase from somewhere.

SPEC for ius-tools and required python-launchpadlib have been loaded to the IUS Project:

https://code.launchpad.net/~ius-coredev/ius/ius-tools
https://code.launchpad.net/~ius-coredev/ius/python-launchpadlib

python-launchpad has successfully built in MF under the IUS Project:

 $ mf build quickview -f python-launchpadlib

 python-launchpadlib-1.9.8-1.ius (BuildSuccess)
 > python-launchpadlib-1.9.8-1.ius.el5.i386 : BuildSuccess :  :
 > python-launchpadlib-1.9.8-1.ius.el5.x86_64 : BuildSuccess :  :

Still deciding how to proceed with ius-tools build. ius-tools BuildRequires monkeyfarm however monkeyfarm is not in the IUS Project build repo.

The ircbot dropped, and was unable to reconnect.

2011-04-11 13:04:15,809 (ERROR) iustools.controllers.ircbot : ircbot child process 5191 died
2011-04-11 13:04:15,811 (DEBUG) iustools.controllers.ircbot : respawned ircbot process 'keepalive_process_hook' (pid: 5193)
2011-04-11 13:04:15,812 (DEBUG) iustools.lib.ircbot : sending ping response
Process Process-749333:
Traceback (most recent call last):
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 232, in _bootstrap
    self.run()
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 88, in run
    self._target(*self._args, **self._kwargs)
  File "/home/wdierkes/devel/ius-tools/src/iustools.ircbot/iustools/bootstrap/ircbot.py", line 95, in keepalive_process_hook
    irc.ping()
  File "/home/wdierkes/devel/ius-tools/src/iustools.ircbot/iustools/lib/ircbot.py", line 88, in ping
    self.ircsock.send("PONG :pingis\n")
error: [Errno 32] Broken pipe

Most likely, we just need to catch this error... and add a reconnect call on the irc object.

Launchpadlib has a number of deps... should break out all those features into its own plugin to remove the dep on launchpadlib from iustools.core.

Noticed a failed rsync on our Jenkins server, however the job was marked as success.

This is do to the push to public functionality not checking for a successful rsync:

 2012-11-19 22:52:17,142 (INFO) iustools.controllers.admin : pushing changes to      dl.iuscommunity.org:/exports/pub/
 ssh: connect to host dl.iuscommunity.org port 22: No route to host
 rsync: connection unexpectedly closed (0 bytes received so far) [sender]
 rsync error: unexplained error (code 255) at io.c(600) [sender=3.0.6]
 2012-11-19 22:52:17,783 (INFO) iustools.controllers.admin : appending archive to      exclude list

The code uses os.system to perform its rsync:

https://github.com/rackspace/ius-tools/blob/master/src/iustools.admin/iustools/controllers/admin.py#L130-L140

Python will return the Linux return status code on os.system,
we should check the return is a successful 0 status:

http://docs.python.org/2/library/os.html#os.system

On the morning of Saturday, March 23, 2013, the 'rackspace' organization on GitHub will be reorganized. All repos will be moved to the new 'rackerlabs' organization, except for those that are designed to be used by Rackspace customers and which are fully supported.

Please update any links to this repo to reflect the new location within GitHub. For example, if the link to your repo is 'https://github.com/rackspace/foo', you need to change it to 'https://github.com/rackerlabs/foo'.

The ircbot should only attempt to parse commands if the msg starts with a single '.' following by [a-z]. Currently, if something says:

[#iuscommunity] ... whatever they were saying

The ircbot responds with the unknown command error.

Upon first connect to an irc channel... the bot post a bunch of bugs.

6:53 iusbot2 [[email protected]] entered the room.

6:53 iusbot2
New Bug #740421 in IUS Community Project: "WL: nginx 0.8.53 with Substitutions Filter Module " - http://bit.ly/hVbH3U
New Bug #741314 in IUS Community Project: "WL: poppler-utils 0.14.5" - http://bit.ly/eCkQWU
New Bug #771362 in IUS Community Project: "Nginx 1.0" - http://bit.ly/hZTe8U
New Bug #745354 in IUS Community Project: "Support for php52-magickwand" - http://bit.ly/hPXwtH
New Bug #746110 in IUS Community Project: "yum-plugin-replace does not imply further dep solving may occur" - http://bit.ly/gPqP90
New Bug #746115 in IUS Community Project: "mysql55 does not resolve all providers" - http://bit.ly/eiM9rP
New Bug #746116 in IUS Community Project: "mysql55 does not 'add' to check config or restart service" - http://bit.ly/ertVxs
New Bug #777319 in IUS Community Project: "UPDATE REQUEST: php52-pecl-apc 3.1.8 is available upstream" - http://bit.ly/j5UAn5
New Bug #777320 in IUS Community Project: "UPDATE REQUEST: php53u-pecl-apc 3.1.8 is available upstream" - http://bit.ly/lLsQWM
New Bug #777437 in IUS Community Project: "UPDATE REQUEST: python31-distribute 0.6.16 is available upstream" - http://bit.ly/lrvfZS
New Bug #779120 in IUS Community Project: "Python 3.1 incorrectly uses UCS2 for Unicode" - http://bit.ly/mTET9x
New Bug #779899 in IUS Community Project: "UPDATE REQUEST: mysql51 5.1.57 is available upstream" - http://bit.ly/lZ1eVS

Need to ensure that on first go... nothing is posted to the channel.

The 'iustools/init.py' is a namespace package, which is removed by RPM on build... so nothing can exist there. I've moved this definition from iustools/init.py to iustools/core/init.py which is not a namespace package.

The tool is archive packages in a separate branch:

 The following builds have been tagged as 'stable':

    - epel-release-5-4


 Additionally, the following older builds were moved to tag 'archive':

   - epel-release-6-5

2011-06-27 15:17:02,435 (DEBUG) iustools.controllers.ircbot : checking LaunchPad for new bugs
Process Process-17:
Traceback (most recent call last):
  File "/usr/lib64/python2.6/multiprocessing/process.py", line 232, in _bootstrap
    self.run()
  File "/usr/lib64/python2.6/multiprocessing/process.py", line 88, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rpmdev/devel/ius-tools/src/iustools.launchpad/iustools/bootstrap/launchpad.py", line 56, in new_bug_notify_ircbot_process_hook
    lp = Launchpad.login_anonymously('ius-tools', 'production')
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/launchpadlib-1.9.8-py2.6.egg/launchpadlib/launchpad.py", line 373, in login_anonymously
    version=version)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/launchpadlib-1.9.8-py2.6.egg/launchpadlib/launchpad.py", line 198, in __init__
    credentials, service_root, cache, timeout, proxy_info, version)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/resource.py", line 460, in __init__
    self._wadl = self._browser.get_wadl_application(self._root_uri)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 299, in get_wadl_application
    response, content = self._request(url, media_type=wadl_type)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 242, in _request
    str(url), method=method, body=data, headers=headers)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 211, in _request_and_retry
    url, method=method, body=body, headers=headers)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 1436, in request
    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/launchpadlib-1.9.8-py2.6.egg/launchpadlib/launchpad.py", line 126, in _request
    LaunchpadOAuthAwareHttp, self)._request(*args)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 130, in _request
    redirections, cachekey)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 1188, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 1123, in _conn_request
    conn.connect()
  File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 911, in connect
    raise SSLHandshakeError(e)
SSLHandshakeError: [Errno 1] _ssl.c:480: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
^C2011-06-27 15:17:02,996 (WARNING) iustools.controllers.ircbot : Caught signal 2, shutting down clean...
Process Process-2:
Traceback (most recent call last):
  File "/usr/lib64/python2.6/multiprocessing/process.py", line 232, in _bootstrap
    self.run()
  File "/usr/lib64/python2.6/multiprocessing/process.py", line 88, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rpmdev/devel/ius-tools/src/iustools.ircbot/iustools/bootstrap/ircbot.py", line 92, in keepalive_process_hook

The tool is archive packages in a separate branch:

 The following builds have been tagged as 'stable':

    - epel-release-5-4


 Additionally, the following older builds were moved to tag 'archive':

   - epel-release-6-5

2011-05-17 10:30:21,954 (DEBUG) iustools.lib.ircbot : sending ping response
2011-05-17 10:30:21,955 (ERROR) iustools.lib.ircbot : Caught socket.error: [Errno 32] Broken pipe
2011-05-17 10:30:22,159 (INFO) iustools.lib.ircbot : joining channel #iuscommunity
2011-05-17 10:31:22,196 (DEBUG) iustools.lib.ircbot : sending ping response
2011-05-17 10:32:22,256 (DEBUG) iustools.lib.ircbot : sending ping response
2011-05-17 10:32:22,257 (ERROR) iustools.lib.ircbot : Caught socket.error: [Errno 32] Broken pipe
2011-05-17 10:32:22,443 (INFO) iustools.lib.ircbot : joining channel #iuscommunity
2011-05-17 10:32:32,129 (DEBUG) iustools.lib.ircbot : sending ping response
2011-05-17 10:33:22,470 (DEBUG) iustools.lib.ircbot : sending ping response
2011-05-17 10:34:22,470 (DEBUG) iustools.lib.ircbot : sending ping response
2011-05-17 10:34:22,471 (ERROR) iustools.lib.ircbot : Caught socket.error: [Errno 32] Broken pipe
2011-05-17 10:34:22,565 (INFO) iustools.lib.ircbot : joining channel #iuscommunity