iuscommunity / ius-tools Goto Github PK
View Code? Open in Web Editor NEWScripts and Utilities for The IUS Community Project
Home Page: http://iuscommunity.org
License: GNU General Public License v2.0
Scripts and Utilities for The IUS Community Project
Home Page: http://iuscommunity.org
License: GNU General Public License v2.0
NAME: ius-tools AUTHORS: BJ Dierkes <[email protected]> Jeffrey Ness <[email protected]> DESCRIPTION: The IUS Community Project is committed to providing up to date and regularly maintained RPM packages for the latest upstream versions of PHP, Python, MySQL and other common software specifically for Red Hat Enterprise Linux and clones. The project is sponsored by Rackspace, and lead by a number of Linux Engineers from the companies 'RPM Development Team' that also contributes to other projects such as Fedora and EPEL. The IUS Tools project is made up of scripts and utilities such as our irc bot, and build system automation scripts. It is Open Source and released under the GNU General Public License v2. This software is built on the Cement CLI Application Framework. USAGE: $ ius --help CONFIGURATION: Application configuration files are parsed in the following order: * /etc/ius-tools/ius-tools.conf * ~/.ius-tools.conf
Launchpadlib has a number of deps... should break out all those features into its own plugin to remove the dep on launchpadlib from iustools.core.
On the morning of Saturday, March 23, 2013, the 'rackspace' organization on GitHub will be reorganized. All repos will be moved to the new 'rackerlabs' organization, except for those that are designed to be used by Rackspace customers and which are fully supported.
Please update any links to this repo to reflect the new location within GitHub. For example, if the link to your repo is 'https://github.com/rackspace/foo', you need to change it to 'https://github.com/rackerlabs/foo'.
The ircbot should only attempt to parse commands if the msg starts with a single '.' following by [a-z]. Currently, if something says:
[#iuscommunity] ... whatever they were saying
The ircbot responds with the unknown command error.
2011-06-27 15:17:02,435 (DEBUG) iustools.controllers.ircbot : checking LaunchPad for new bugs Process Process-17: Traceback (most recent call last): File "/usr/lib64/python2.6/multiprocessing/process.py", line 232, in _bootstrap self.run() File "/usr/lib64/python2.6/multiprocessing/process.py", line 88, in run self._target(*self._args, **self._kwargs) File "/home/rpmdev/devel/ius-tools/src/iustools.launchpad/iustools/bootstrap/launchpad.py", line 56, in new_bug_notify_ircbot_process_hook lp = Launchpad.login_anonymously('ius-tools', 'production') File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/launchpadlib-1.9.8-py2.6.egg/launchpadlib/launchpad.py", line 373, in login_anonymously version=version) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/launchpadlib-1.9.8-py2.6.egg/launchpadlib/launchpad.py", line 198, in __init__ credentials, service_root, cache, timeout, proxy_info, version) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/resource.py", line 460, in __init__ self._wadl = self._browser.get_wadl_application(self._root_uri) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 299, in get_wadl_application response, content = self._request(url, media_type=wadl_type) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 242, in _request str(url), method=method, body=data, headers=headers) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 211, in _request_and_retry url, method=method, body=body, headers=headers) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 1436, in request (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/launchpadlib-1.9.8-py2.6.egg/launchpadlib/launchpad.py", line 126, in _request LaunchpadOAuthAwareHttp, self)._request(*args) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/lazr.restfulclient-0.11.2-py2.6.egg/lazr/restfulclient/_browser.py", line 130, in _request redirections, cachekey) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 1188, in _request (response, content) = self._conn_request(conn, request_uri, method, body, headers) File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 1123, in _conn_request conn.connect() File "/home/rpmdev/env/ius-tools/lib/python2.6/site-packages/httplib2-0.7.1-py2.6.egg/httplib2/__init__.py", line 911, in connect raise SSLHandshakeError(e) SSLHandshakeError: [Errno 1] _ssl.c:480: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed ^C2011-06-27 15:17:02,996 (WARNING) iustools.controllers.ircbot : Caught signal 2, shutting down clean... Process Process-2: Traceback (most recent call last): File "/usr/lib64/python2.6/multiprocessing/process.py", line 232, in _bootstrap self.run() File "/usr/lib64/python2.6/multiprocessing/process.py", line 88, in run self._target(*self._args, **self._kwargs) File "/home/rpmdev/devel/ius-tools/src/iustools.ircbot/iustools/bootstrap/ircbot.py", line 92, in keepalive_process_hook
The 'iustools/init.py' is a namespace package, which is removed by RPM on build... so nothing can exist there. I've moved this definition from iustools/init.py to iustools/core/init.py which is not a namespace package.
Noticed a failed rsync on our Jenkins server, however the job was marked as success.
This is do to the push to public functionality not checking for a successful rsync:
2012-11-19 22:52:17,142 (INFO) iustools.controllers.admin : pushing changes to dl.iuscommunity.org:/exports/pub/
ssh: connect to host dl.iuscommunity.org port 22: No route to host
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: unexplained error (code 255) at io.c(600) [sender=3.0.6]
2012-11-19 22:52:17,783 (INFO) iustools.controllers.admin : appending archive to exclude list
The code uses os.system to perform its rsync:
Python will return the Linux return status code on os.system,
we should check the return is a successful 0 status:
The --passphrase does not except a value, rather it just stores true.
2011-05-17 10:30:21,954 (DEBUG) iustools.lib.ircbot : sending ping response 2011-05-17 10:30:21,955 (ERROR) iustools.lib.ircbot : Caught socket.error: [Errno 32] Broken pipe 2011-05-17 10:30:22,159 (INFO) iustools.lib.ircbot : joining channel #iuscommunity 2011-05-17 10:31:22,196 (DEBUG) iustools.lib.ircbot : sending ping response 2011-05-17 10:32:22,256 (DEBUG) iustools.lib.ircbot : sending ping response 2011-05-17 10:32:22,257 (ERROR) iustools.lib.ircbot : Caught socket.error: [Errno 32] Broken pipe 2011-05-17 10:32:22,443 (INFO) iustools.lib.ircbot : joining channel #iuscommunity 2011-05-17 10:32:32,129 (DEBUG) iustools.lib.ircbot : sending ping response 2011-05-17 10:33:22,470 (DEBUG) iustools.lib.ircbot : sending ping response 2011-05-17 10:34:22,470 (DEBUG) iustools.lib.ircbot : sending ping response 2011-05-17 10:34:22,471 (ERROR) iustools.lib.ircbot : Caught socket.error: [Errno 32] Broken pipe 2011-05-17 10:34:22,565 (INFO) iustools.lib.ircbot : joining channel #iuscommunity
For the ability to automate GPG key signing... need a clean way of reading the GPG passphrase from somewhere.
The tool is archive packages in a separate branch:
The following builds have been tagged as 'stable':
- epel-release-5-4
Additionally, the following older builds were moved to tag 'archive':
- epel-release-6-5
The ircbot dropped, and was unable to reconnect.
2011-04-11 13:04:15,809 (ERROR) iustools.controllers.ircbot : ircbot child process 5191 died 2011-04-11 13:04:15,811 (DEBUG) iustools.controllers.ircbot : respawned ircbot process 'keepalive_process_hook' (pid: 5193) 2011-04-11 13:04:15,812 (DEBUG) iustools.lib.ircbot : sending ping response Process Process-749333: Traceback (most recent call last): File "/usr/lib64/python2.7/multiprocessing/process.py", line 232, in _bootstrap self.run() File "/usr/lib64/python2.7/multiprocessing/process.py", line 88, in run self._target(*self._args, **self._kwargs) File "/home/wdierkes/devel/ius-tools/src/iustools.ircbot/iustools/bootstrap/ircbot.py", line 95, in keepalive_process_hook irc.ping() File "/home/wdierkes/devel/ius-tools/src/iustools.ircbot/iustools/lib/ircbot.py", line 88, in ping self.ircsock.send("PONG :pingis\n") error: [Errno 32] Broken pipe
Most likely, we just need to catch this error... and add a reconnect call on the irc object.
The tool is archive packages in a separate branch:
The following builds have been tagged as 'stable':
- epel-release-5-4
Additionally, the following older builds were moved to tag 'archive':
- epel-release-6-5
The 'admin sync' process doesn't include the EUA or GPG Key which need to be in the base of the repo as well.
Upon first connect to an irc channel... the bot post a bunch of bugs.
6:53 iusbot2 [[email protected]] entered the room. 6:53 iusbot2 New Bug #740421 in IUS Community Project: "WL: nginx 0.8.53 with Substitutions Filter Module " - http://bit.ly/hVbH3U New Bug #741314 in IUS Community Project: "WL: poppler-utils 0.14.5" - http://bit.ly/eCkQWU New Bug #771362 in IUS Community Project: "Nginx 1.0" - http://bit.ly/hZTe8U New Bug #745354 in IUS Community Project: "Support for php52-magickwand" - http://bit.ly/hPXwtH New Bug #746110 in IUS Community Project: "yum-plugin-replace does not imply further dep solving may occur" - http://bit.ly/gPqP90 New Bug #746115 in IUS Community Project: "mysql55 does not resolve all providers" - http://bit.ly/eiM9rP New Bug #746116 in IUS Community Project: "mysql55 does not 'add' to check config or restart service" - http://bit.ly/ertVxs New Bug #777319 in IUS Community Project: "UPDATE REQUEST: php52-pecl-apc 3.1.8 is available upstream" - http://bit.ly/j5UAn5 New Bug #777320 in IUS Community Project: "UPDATE REQUEST: php53u-pecl-apc 3.1.8 is available upstream" - http://bit.ly/lLsQWM New Bug #777437 in IUS Community Project: "UPDATE REQUEST: python31-distribute 0.6.16 is available upstream" - http://bit.ly/lrvfZS New Bug #779120 in IUS Community Project: "Python 3.1 incorrectly uses UCS2 for Unicode" - http://bit.ly/mTET9x New Bug #779899 in IUS Community Project: "UPDATE REQUEST: mysql51 5.1.57 is available upstream" - http://bit.ly/lZ1eVS
Need to ensure that on first go... nothing is posted to the channel.
SPEC for ius-tools and required python-launchpadlib have been loaded to the IUS Project:
https://code.launchpad.net/~ius-coredev/ius/ius-tools
https://code.launchpad.net/~ius-coredev/ius/python-launchpadlib
python-launchpad has successfully built in MF under the IUS Project:
$ mf build quickview -f python-launchpadlib
python-launchpadlib-1.9.8-1.ius (BuildSuccess)
> python-launchpadlib-1.9.8-1.ius.el5.i386 : BuildSuccess : :
> python-launchpadlib-1.9.8-1.ius.el5.x86_64 : BuildSuccess : :
Still deciding how to proceed with ius-tools build. ius-tools BuildRequires monkeyfarm however monkeyfarm is not in the IUS Project build repo.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.