`_.
25 |
26 | Master needs: flask, requests, sqlalchemy, wtforms, hotqueue
27 | Slave needs: hotqueue, requests
28 | p4a-build needs: requests
29 |
30 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/templates/frontend/_formhelpers.html:
--------------------------------------------------------------------------------
1 | {% macro form_field(field) %}
2 | {{ field.label }}
3 | {{ field(placeholder=field.description, **kwargs)|safe }}
4 | {% if field.errors %}
5 |
6 | {% for error in field.errors %}
7 | {{ error }}
8 | {% endfor %}
9 |
10 | {% endif %}
11 | {% endmacro %}
12 |
13 | {% macro form_begin(form) %}
14 | {% if form.csrf.errors %}
15 |
16 | {% for error in form.csrf.errors %}
17 | {{ error }}
18 | {% endfor %}
19 |
20 | {% endif %}
21 | {{ form.hidden_tag() }}
22 | {% endmacro %}
23 |
24 | {% macro form_field_hidden(name, value) %}
25 | {{ title }}
34 | What is it?
7 |
8 | This is a service for building your APK from your python source code. We
9 | know that it can be a pain to compile the python source code, modules, and put
10 | everything in an APK to make it work. With some constraint, we are able to do
11 | that for you.
12 |
The whole website is based on top of Python for Android project.
13 |
14 | How it works?
15 |
16 | You submit a zip file containing your python source code, and give some information like the package name, title, version, python modules to include etc. Then when available, a cloud builder will build your project, and give you an APK in debug or release mode, on an URL or email.
17 |
18 | Where to start ?
19 |
20 | You can read how to create the Hello
22 | world example . Then you can use our p4a-build tool for pushing your application on this service
23 |
24 |
25 |
26 |
27 |
28 | {% endblock %}
29 |
--------------------------------------------------------------------------------
/master/web/config.py:
--------------------------------------------------------------------------------
1 | __all__ = ('config', 'logger', )
2 |
3 | from hotqueue import HotQueue
4 | from ConfigParser import ConfigParser
5 | from os.path import dirname, join, exists
6 | from redis import Redis
7 | import json
8 |
9 | # configuration
10 | config = ConfigParser()
11 | config.add_section('www'),
12 | config.set('www', 'baseurl', 'http://android.kivy.org/')
13 | config.set('www', 'secret_key', '')
14 |
15 | config.add_section('database')
16 | config.set('database', 'url', 'sqlite:////tmp/test.db')
17 |
18 | config.add_section('redis')
19 | config.set('redis', 'host', 'localhost')
20 | config.set('redis', 'port', '6379')
21 | config.set('redis', 'password', '')
22 |
23 | # read existing file
24 | config_fn = join(dirname(__file__), '..', 'config.cfg')
25 | if exists(config_fn):
26 | config.read(config_fn)
27 |
28 | # write current config if possible
29 | try:
30 | fd = open(config_fn, 'w')
31 | config.write(fd)
32 | fd.close()
33 | except Exception:
34 | pass
35 |
36 | # start the queue
37 | qjob = HotQueue(
38 | 'jobsubmit',
39 | host=config.get('redis', 'host'),
40 | port=config.getint('redis', 'port'),
41 | password=config.get('redis', 'password'),
42 | db=0)
43 |
44 | # Redis database connector
45 | r = Redis(
46 | host=config.get('redis', 'host'),
47 | port=config.getint('redis', 'port'),
48 | password=config.get('redis', 'password'),
49 | db=1)
50 |
51 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/static/js/genero.js:
--------------------------------------------------------------------------------
1 | $(document).ready(function() {
2 | $('form input[type="text"]').not('[readonly=readonly]').first().select().focus();
3 | $('div.flash-message').hide().slideDown().delay(5000).slideUp();
4 | $('div.flash-error').hide().slideDown();
5 | //$('input[type="submit"]').button();
6 | $('a.btn-back').button({ icons: { primary: 'ui-icon-arrowreturn-1-w' }});
7 | $('a.btn-add').button({ icons: { primary: 'ui-icon-plus' }});
8 | $('a.btn-del').button({ icons: { primary: 'ui-icon-circle-close' }});
9 | $('a.btn-edit').button({ icons: { primary: 'ui-icon-pencil' }});
10 | $('a.btn-mod').button({ icons: { primary: 'ui-icon-cancel' }});
11 | $('a.btn-moderate').button({ icons: { primary: 'ui-icon-pencil' }});
12 | $('a.btn-check').button({ icons: { primary: 'ui-icon-circle-check' }});
13 | $('a.btn-search').button({ icons: { primary: 'ui-icon-search' }});
14 | $('a.btn-big').button()
15 |
16 | $('input[name="dt_start"]').datetimepicker({
17 | 'dateFormat': 'yy-mm-dd',
18 | 'timeFormat': 'hh:mm:ss',
19 | 'separator': ' '
20 | });
21 |
22 | $('input[name="dt_end"]').datetimepicker({
23 | 'dateFormat': 'yy-mm-dd',
24 | 'timeFormat': 'hh:mm:ss',
25 | 'separator': ' '
26 | });
27 |
28 | $('input[name="dt_event"]').datetimepicker({
29 | 'dateFormat': 'yy-mm-dd',
30 | 'timeFormat': 'hh:mm:ss',
31 | 'separator': ' '
32 | });
33 |
34 | $(' [placeholder] ').defaultValue();
35 |
36 | $('#expertmode').click(function() {
37 | $('#expertdiv').show();
38 | $('#expertmode').hide();
39 | })
40 | });
41 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/templates/frontend/index.html:
--------------------------------------------------------------------------------
1 | {% from "frontend/_formhelpers.html" import form_begin, form_field, form_end %}
2 |
3 | {% extends "frontend/layout.html" %}
4 | {% block body_class %}focus{% endblock%}
5 | {% block content %}
6 |
7 | Create Android APK package from your Python source code using Python for android . Tell me more »
8 |
9 |
10 |
11 |
Web submission
12 |
13 |
32 |
33 |
35 |
Command line
36 |
37 |
Install p4a-build tool:
38 |
pip install p4a-build
39 |
Usage:
40 |
p4a-build \
41 | --package org.kivy.touchtracer \
42 | --name Touchtracer \
43 | --version 1.0 \
44 | --modules "pil kivy" \
45 | --dir /path/to/app
46 |
47 |
Python for Android - Builder
5 |
22 |
23 |
24 | {% block pagetitle %}{% endblock %}
25 |
26 |
27 | {% for category, msg in get_flashed_messages(with_categories=true) %}
28 |
{{ msg }}
29 | {% endfor %}
30 | {% block content %}{% endblock %}
31 |
32 |
33 |
12 |
Status
13 |
14 |
{{ job.package_title }}, version {{ job.package_version }}
15 | {% if job.is_failed == '1' %}
16 | have failed building.
17 | {% elif job.is_done == '1' %}
18 | is done.
28 |
29 |
{{status}}
30 |
31 |
32 |
34 |
Actions
35 |
36 |
42 |
45 |
46 | Logs
47 |
48 |
49 | {% for line in joblog %}{{ line.replace(
50 | '>', '<').replace(
51 | '<', '>').replace(
52 | '\n', '').replace(
54 | '[31;01m', '').replace(
55 | '[30;01m', '').replace(
56 | '[39;49;00m', ' ')|safe }}
59 |
60 | Options
61 |
62 |
63 | Name: {{ job.package_name }}
64 | Title: {{ job.package_title }}
65 | Version: {{ job.package_version }}
66 | Modules: {{ job.modules }}
67 | Orientation: {{ job.package_orientation }}
68 | {% if job.package_permissions != '' %}
69 | Permissions: {{ job.package_permissions }}
70 | {% endif %}
71 | {% if job.emails != '' %}
72 | Notification emails: {{ job.emails }}
73 | {% endif %}
74 |
75 |
76 | {% endblock %}
77 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/templates/frontend/about.html:
--------------------------------------------------------------------------------
1 | {% extends "frontend/layout.html" %}
2 | {% block content %}
3 |
4 |
5 |
6 | What is it?
7 |
8 | This is a service for building your APK from your python source code. We
9 | know that it can be a pain to compile the python source code, modules, and put
10 | everything in an APK to make it work. With some constraint, we are able to do
11 | that for you.
12 |
The whole website is based on top of Python for Android project.
13 |
14 | How it works?
15 |
16 | You submit a zip file containing your python source code, and give some information like the package name, title, version, python modules to include etc. Then when available, a cloud builder will build your project, and give you an APK in debug or release mode, on an URL or email.
17 |
18 | All the jobs are trashed (failed or done) after 48h, or as soon as you click on Delete button. We are not keeping any informations from your build.
19 |
20 | Where to start ?
21 |
22 | You can read how to create the Hello
24 | world example . Then you can use our p4a-build tool for pushing your application on this service
25 |
26 | pip install --upgrade p4a-build
27 | p4a-build --package com.test.helloworld --name 'Hello world' --version '1.0' \
28 | --modules 'kivy' --dir /path/to/helloworld
29 |
30 |
31 | It will give you a Hello-world-1.0-debug.apk
32 |
33 | How to install an APK?
34 |
35 | If you have created a debug APK, then you need to use adb tool from the android SDK, and write:
36 | adb install -r Hello-world-1.0-debug.apk
37 |
38 | How to sign a release APK?
39 |
40 | If you've created a release APK (with --release), you will need to sign the package for beeing able to install it in any android device, and to submit it on the android market.
41 | Go to Signing Your Applications from the android guide, in the section "Signing Release Mode"
42 | Basically, it can be done in 3 steps when you have your keystore available:
43 |
44 | jarsigner -verbose -keystore /path/to/your/key.keystore \
45 | Hello-world-1.0-release-unsigned.apk my_keyname
46 | jarsigner -verbose -verify Hello-world-1.0-release-unsigned.apk
47 | zipalign -v 4 Hello-world-1.0-release-unsigned.apk Hello-world-1.0.apk
48 |
49 |
50 |
51 |
52 | How can i participate?
53 |
54 | Take a look at the Python for android - cloud project on github
55 |
56 | {% endblock %}
57 |
--------------------------------------------------------------------------------
/master/web/job.py:
--------------------------------------------------------------------------------
1 | __all__ = ('read_job', 'read_logs')
2 |
3 |
4 | import subprocess
5 | from os.path import dirname, join, realpath
6 | from web.config import config, r
7 |
8 | class QueryDict(dict):
9 | # taken from kivy
10 | def __getattr__(self, attr):
11 | try:
12 | return self.__getitem__(attr)
13 | except KeyError:
14 | try:
15 | return super(QueryDict, self).__getattr__(attr)
16 | except AttributeError:
17 | raise KeyError(attr)
18 |
19 | def __setattr__(self, attr, value):
20 | self.__setitem__(attr, value)
21 |
22 |
23 | class JobObj(QueryDict):
24 | @property
25 | def directory(self):
26 | return realpath(join(dirname(__file__), '..', 'jobs', self.uid))
27 |
28 | @property
29 | def data_fn(self):
30 | return join(self.directory, 'data%s' % self.data_ext)
31 |
32 | @property
33 | def icon_fn(self):
34 | return join(self.directory, 'icon.png')
35 |
36 | @property
37 | def presplash_fn(self):
38 | return join(self.directory, 'presplash.png')
39 |
40 | @property
41 | def apk_fn(self):
42 | return join(self.directory, self.apk)
43 |
44 | def notify(self):
45 | if len(self.emails) == 0:
46 | return
47 | status = 'failed build' if self.is_failed == '1' else 'finished'
48 | subject = '[p4a] Build %s, version %s %s' % (
49 | self.package_title,
50 | self.package_version,
51 | status)
52 | if self.is_failed == '1':
53 | content = ('Hi,\n\nYour package %s failed to build.\n\n'
54 | 'Informations: %s\n\nP4A Build Cloud.') % (
55 | self.package_title,
56 | '%s/job/%s' % (config.get('www', 'baseurl'),self.uid))
57 | else:
58 | content = ('Hi,\n\nYour package %s is available.\n\n'
59 | 'APK: %s\nInformations: %s\n\nEnjoy,\n\nP4A Build Cloud.') % (
60 | self.package_title,
61 | '%s/download/%s/%s' % (config.get('www', 'baseurl'),
62 | self.uid, self.apk),
63 | '%s/job/%s' % (config.get('www', 'baseurl'),self.uid))
64 |
65 | for email in self.emails.split():
66 | cmd = ['mail', '-s', subject, '-a', 'From: p4a-noreply@kivy.org',
67 | email]
68 | p = subprocess.Popen(cmd, shell=False, stdin=subprocess.PIPE)
69 | p.stdin.write(content)
70 | p.stdin.close()
71 | p.communicate()
72 |
73 | def read_entry(basekey, cls=QueryDict, *keyswanted):
74 | keys = r.keys('%s*' % basekey)
75 | entry = cls()
76 | for key in keyswanted:
77 | entry[key] = None
78 | for key in keys:
79 | skey = key[len(basekey):]
80 | if keyswanted and skey not in keyswanted:
81 | continue
82 | entry[skey] = r.get(key)
83 | return entry
84 |
85 | def read_logs(uid):
86 | return read_entry('log:%s:' % uid).values()
87 |
88 | def read_job(uid, *keys):
89 | if not r.keys('job:%s' % uid):
90 | return None
91 | job = read_entry('job:%s:' % uid, JobObj, *keys)
92 | job['uid'] = uid
93 | return job
94 |
95 |
--------------------------------------------------------------------------------
/master/pollqlog.py:
--------------------------------------------------------------------------------
1 | #!/usr/bin/env python
2 | '''
3 | Poll the log queue (builder -> webservice).
4 | Must be started on the same server than the web service.
5 | '''
6 |
7 | import sys
8 | import os
9 | from os.path import dirname, join
10 | sys.path.insert(0, dirname(__file__))
11 | activate_this = join(dirname(__file__), '.env', 'bin', 'activate_this.py')
12 | execfile(activate_this, dict(__file__=activate_this))
13 |
14 | from web.config import config, r
15 | from hotqueue import HotQueue
16 | from web.job import read_job, JobObj
17 | from time import time, sleep
18 |
19 | # start a thread for listing qlog
20 | qlog = HotQueue(
21 | 'joblog',
22 | host=config.get('redis', 'host'),
23 | port=config.getint('redis', 'port'),
24 | password=config.get('redis', 'password'),
25 | db=0)
26 |
27 | qlog.put({'cmd': 'purge'})
28 |
29 | def loop_handle(log):
30 | if 'cmd' not in log:
31 | return
32 | cmd = log['cmd']
33 |
34 | if 'host' in log:
35 | r.set('host:{}:last_alive'.format(log['host']), time())
36 |
37 | if cmd in ('available', 'busy'):
38 | r.set('host:{}:status'.format(log['host']), cmd)
39 | return
40 |
41 | if cmd == 'purge':
42 | # search all projects done last 48h
43 | keys = r.keys('job:*:dt_added')
44 | print keys
45 | to_delete = []
46 | ctime = time()
47 | for key in keys:
48 | dt = ctime - float(r.get(key))
49 | print 'checked', key[4:-9], dt
50 | if dt > 60 * 60 * 48:
51 | print 'going to delete', key[4:-9], ', delta is', dt
52 | to_delete.append(key[4:-9])
53 |
54 | # delete everything related to all the jobs to delete
55 | print 'doing deletion of', to_delete
56 | for uid in to_delete:
57 | print 'delete', uid
58 | job = JobObj({'uid': uid})
59 | d = job.directory
60 | if d and len(d) > 10:
61 | subprocess.Popen(['rm', '-rf', d], shell=False).communicate()
62 | keys = r.keys('job:%s*' % uid)
63 | if keys:
64 | r.delete(*keys)
65 | keys = r.keys('log:%s*' % uid)
66 | if keys:
67 | r.delete(*keys)
68 |
69 | return
70 |
71 | # next command _need_ uid.
72 |
73 | if 'uid' not in log:
74 | return
75 | uid = log['uid']
76 |
77 | jobkey = 'job:%s' % uid
78 | if not r.keys(jobkey):
79 | return
80 |
81 | if cmd == 'status':
82 | r.set(jobkey + ':build_status', log['msg'])
83 | elif cmd == 'exception':
84 | r.set(jobkey + ':build_status', '[1/1] Error')
85 | r.set(jobkey + ':is_failed', 1)
86 | r.set(jobkey + ':fail_message', log['msg'])
87 |
88 | if cmd == 'log' or cmd == 'exception':
89 | logkey = 'log:%s' % uid
90 | if not r.keys(logkey):
91 | r.set(logkey, 1)
92 | lidx = 1
93 | else:
94 | lidx = r.incr(logkey)
95 | logkeytxt = logkey + ':%d' % lidx
96 | if cmd == 'log':
97 | r.set(logkeytxt, log['line'])
98 | else:
99 | r.set(logkeytxt, log['msg'])
100 |
101 | if cmd == 'exception':
102 | job = read_job(uid)
103 | if job:
104 | job.notify()
105 |
106 |
107 | if __name__ == '__main__':
108 | while True:
109 | # trigger a purge every hour
110 | qlog.put({'cmd': 'purge'})
111 | for log in qlog.consume(timeout=3600):
112 | loop_handle(log)
113 | # sleep only 1 second if we keep asking break
114 | sleep(1)
115 |
116 |
--------------------------------------------------------------------------------
/tools/p4a-build:
--------------------------------------------------------------------------------
1 | #!/usr/bin/env python
2 |
3 | host = 'http://android.kivy.org/'
4 |
5 | import json
6 | import os
7 | import re
8 | import requests
9 | import tempfile
10 | import webbrowser
11 | import zipfile
12 |
13 | def zipper(d, zip_file):
14 | zfd = zipfile.ZipFile(zip_file, 'w', compression=zipfile.ZIP_DEFLATED)
15 | root_len = len(os.path.abspath(d))
16 | for root, dirs, files in os.walk(d):
17 | archive_root = os.path.abspath(root)[root_len:]
18 | for f in files:
19 | fullpath = os.path.join(root, f)
20 | archive_name = os.path.join(archive_root, f)
21 | zfd.write(fullpath, archive_name, zipfile.ZIP_DEFLATED)
22 | zfd.close()
23 | return zip_file
24 |
25 |
26 | def submit_package(args):
27 | url_form = args.host
28 | url_submit = args.host + 'submit'
29 |
30 | s = requests.session()
31 |
32 | # first time, just get the csrf token
33 | r = s.get(url_form)
34 | csrf = re.search(u'name="csrf" type="hidden" value="(.*)"',
35 | r.content).groups()[0]
36 |
37 | # create a zip of the whole directory
38 | zfd, zfn = tempfile.mkstemp(suffix='.zip')
39 | zipper(args.dir, zfn)
40 |
41 | # build the data and push it
42 | payload = {
43 | 'package_name': args.package,
44 | 'package_version': args.version,
45 | 'package_title': args.name,
46 | 'package_permissions':
47 | ' '.join(args.permissions) if args.permissions else '',
48 | 'package_orientation': args.orientation,
49 | 'emails': ' '.join(args.notify) if args.notify else '',
50 | 'modules': args.modules,
51 | 'csrf': csrf,
52 | 'batch': '1'}
53 | if args.release:
54 | payload['release'] = 'release'
55 |
56 | fd = open(zfn, 'rb')
57 | files = {'directory': (zfn, fd)}
58 |
59 | if args.icon:
60 | fdicon = open(args.icon, 'rb')
61 | files['package_icon'] = (os.path.basename(args.icon), fdicon)
62 |
63 | if args.presplash:
64 | fdpresplash = open(args.presplash, 'rb')
65 | files['package_presplash'] = (os.path.basename(args.presplash),
66 | fdpresplash)
67 |
68 | r = s.post(url_submit, data=payload, files=files)
69 | r.raise_for_status()
70 |
71 | fd.close()
72 | if args.icon:
73 | fdicon.close()
74 | if args.presplash:
75 | fdpresplash.close()
76 |
77 | data = json.loads(r.text)
78 |
79 | print
80 | print 'Package submitted to P4A Cloud.'
81 | print 'Get the build progress at:', data['url']
82 | print
83 |
84 | webbrowser.open_new_tab(data['url'])
85 |
86 | if __name__ == '__main__':
87 | import argparse
88 |
89 | ap = argparse.ArgumentParser(description='''\
90 | P4A Build tool using P4A Cloud.
91 | ''')
92 |
93 | ap.add_argument('--package', dest='package', required=True,
94 | help='The name of the java package the project will be packaged under.')
95 | ap.add_argument('--name', dest='name', required=True,
96 | help='The human-readable name of the project.')
97 | ap.add_argument('--version', dest='version', required=True,
98 | help=('The version number of the project.'
99 | 'This should consist of numbers and dots, and should have the same '
100 | 'number of groups of numbers as previous versions.'))
101 | ap.add_argument('--dir', dest='dir', required=True,
102 | help='The directory containing files for the project.')
103 | ap.add_argument('--modules', dest='modules', required=True,
104 | help='Modules to compile with the program')
105 | ap.add_argument('--icon', dest='icon',
106 | help='Path to an icon (.png)')
107 | ap.add_argument('--presplash', dest='presplash',
108 | help='Path to an presplash image (.png)')
109 | ap.add_argument('--permission', dest='permissions', action='append',
110 | help='The android permissions needed for this app.')
111 | ap.add_argument('--orientation', dest='orientation', default='landscape',
112 | help='Orientation of the application. One of "landscape" or "portrait"')
113 | ap.add_argument('--release', dest='release', action='store_true',
114 | help='If set, then a release package will be done')
115 | ap.add_argument('--notify', dest='notify', action='append',
116 | help='Email to send a notification when build is finished')
117 |
118 | ap.add_argument('--host', dest='host', default=host,
119 | help='Host to push the P4A build request')
120 | args = ap.parse_args()
121 |
122 | submit_package(args)
123 |
--------------------------------------------------------------------------------
/master/web/table.py:
--------------------------------------------------------------------------------
1 | '''
2 | DataTable: a flask/sqlachemy module to generate HTML with server side data.
3 |
4 | The project use datatable from http://www.datatables.net/
5 | '''
6 | __all__ = ('Table', 'Column')
7 |
8 | import simplejson
9 | from flask import url_for, request
10 | from sqlalchemy import asc, desc
11 |
12 | class Column(object):
13 | def __init__(self, name, field, display=None, formatter=None, width=None):
14 | super(Column, self).__init__()
15 | self.name = name
16 | self.field = field
17 | self.display = display
18 | self.formatter = formatter
19 | self.width = width
20 |
21 | def __html__(self):
22 | return '%s ' % self.name
23 |
24 | def __js_def__(self, index, out):
25 | if self.width:
26 | out.append({'sWidth': self.width, 'aTargets': [index]})
27 |
28 | def get_field(self, entry):
29 | if self.display:
30 | value = self.display(entry)
31 | else:
32 | value = getattr(entry, self.field)
33 | if self.formatter:
34 | return self.formatter(value)
35 | return value
36 |
37 | class Table(object):
38 | __uniqid = 0
39 | db_table = None
40 | db_session = None
41 | display_length = 20
42 | activate_sort = True
43 | activate_info = True
44 | activate_paginate = True
45 | activate_scroll_infinite = False
46 | activate_filter = True
47 | activate_length_change = True
48 | activate_scroll_collapse = True
49 | pagination_type = 'full_numbers'
50 | scroll_x = ''
51 | scroll_y = ''
52 | href_link = None
53 |
54 | def __init__(self, **kwargs):
55 | super(Table, self).__init__()
56 | self.html_id = kwargs.get('html_id', None)
57 | if self.html_id is None:
58 | Table.__uniqid += 1
59 | self.html_id = 'datatable%d' % Table.__uniqid
60 |
61 | def query(self):
62 | return self.db_session.query(self.db_table)
63 |
64 | def ajax(self):
65 | q = self.query()
66 |
67 | # total number of entries
68 | count = q.count()
69 |
70 | # search
71 | if 'sSearch' in request.args:
72 | search = None
73 | for col in self.columns:
74 | field = getattr(self.db_table, col.field)
75 | field = field.like('%%%s%%' % request.args['sSearch'])
76 | if search is None:
77 | search = field
78 | else:
79 | search = search | field
80 | q = q.filter(search)
81 |
82 | # sorting
83 | if 'iSortingCols' in request.args:
84 | field = self.columns[int(request.args['iSortCol_0'])].field
85 | db_field = getattr(self.db_table, field)
86 | if request.args['sSortDir_0'] == 'asc':
87 | db_field = asc(db_field)
88 | else:
89 | db_field = desc(db_field)
90 | q = q.order_by(db_field)
91 |
92 | # get the number after filter
93 | count_filtered = q.count()
94 |
95 | # pagination
96 | if self.activate_scroll_infinite:
97 | limit = self.display_length
98 | else:
99 | limit = request.args['iDisplayLength']
100 | offset = request.args['iDisplayStart']
101 | entries = q.offset(offset).limit(limit)
102 |
103 | # construct the output
104 | data = []
105 | columns = self.columns
106 | for entry in entries:
107 | data.append([col.get_field(entry) for col in columns])
108 |
109 | return simplejson.dumps({
110 | 'sEcho': request.args['sEcho'],
111 | 'iTotalRecords': count,
112 | 'iTotalDisplayRecords': count_filtered,
113 | 'aaData': data
114 | })
115 |
116 | def __json_columns_defs__(self):
117 | out = []
118 | for index, col in enumerate(self.columns):
119 | col.__js_def__(index, out)
120 | return simplejson.dumps(out)
121 |
122 | def __js_rowclick__(self):
123 | return ''
124 |
125 | def __html_columns__(self):
126 | out = ['']
127 | for col in self.columns:
128 | out.append(col.__html__())
129 | out.append(' ')
130 | return ''.join(out)
131 |
132 | def __html__(self):
133 | data = {
134 | 'html_id': self.html_id,
135 | 'columns': self.__html_columns__(),
136 | 'click_callback': self.__js_rowclick__(),
137 |
138 | # datatable
139 | 'iDisplayLength': str(int(self.display_length)),
140 | 'bSort': str(bool(self.activate_sort)).lower(),
141 | 'bInfo': str(bool(self.activate_info)).lower(),
142 | 'bPaginate': str(bool(self.activate_paginate)).lower(),
143 | 'bScrollInfinite': str(bool(self.activate_scroll_infinite)).lower(),
144 | 'bScrollCollapse': str(bool(self.activate_scroll_collapse)).lower(),
145 | 'bFilter': str(bool(self.activate_filter)).lower(),
146 | 'bLengthChange': str(bool(self.activate_length_change)).lower(),
147 | 'sScrollX': str(self.scroll_x),
148 | 'sScrollY': str(self.scroll_y),
149 | 'sPaginationType': str(self.pagination_type),
150 | 'sAjaxSource': url_for(self.source),
151 | 'aoColumnDefs': self.__json_columns_defs__()
152 | }
153 |
154 | html = '''
155 |
180 |
181 |
182 | %(columns)s
183 |
184 |
185 |
186 |
187 | ''' % data
188 | return html
189 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/static/css/style.css:
--------------------------------------------------------------------------------
1 | /* layouts
2 | */
3 |
4 | #wrapper {
5 | width: 100%;
6 | }
7 |
8 | /* global styles
9 | */
10 |
11 | a {
12 | text-decoration: none;
13 | color: #31a1ff;
14 | }
15 |
16 | a:hover {
17 | color: #99b900;
18 | }
19 |
20 | h1, h2, h3, h4, h5, h6 {
21 | font-weight: normal;
22 | }
23 |
24 | hr {
25 | border: none;
26 | background: transparent;
27 | border-bottom: 1px solid #505050;
28 | }
29 |
30 |
31 |
32 | /* styles
33 | */
34 |
35 | html, body {
36 | padding: 0px;
37 | margin: 0px;
38 | }
39 |
40 | html, body, table {
41 | font-family: Helvetica, Arial, sans-serif;
42 | color: #4d4d4d;
43 | font-size: 14px;
44 | }
45 |
46 | #wrappercolumn {
47 | min-height: 200px;
48 | width: 950px;
49 | margin: 0 auto;
50 | --background: #ffffff url('background_content.png') top left repeat-x;
51 | }
52 |
53 | /* table
54 | */
55 |
56 | table.simple {
57 | margin: 1em 0;
58 | border-collapse: collapse;
59 | width: 100%;
60 | }
61 |
62 | table.simple td,
63 | table.simple th {
64 | text-align: left;
65 | padding: 0.3em 0.4em;
66 | border-bottom: 1px solid #dddddd;
67 | }
68 |
69 | table.simple td {
70 | border-left: 1px dotted #dddddd;
71 | }
72 |
73 | table.simple th.first,
74 | table.simple td.first {
75 | border-left: none;
76 | }
77 |
78 | table.simple td.info {
79 | font-size: 10px;
80 | }
81 |
82 | .infoForm {
83 | font-size: 9px;
84 | }
85 |
86 | /* data table
87 | */
88 | .dataTables_wrapper {
89 | margin: 10px 0;
90 | }
91 |
92 | .dataTables_wrapper div,
93 | .dataTables_wrapper {
94 | clear: none !important;
95 | }
96 |
97 |
98 | .dataTables_wrapper table {
99 | width: 100%;
100 | border-collapse: collapse;
101 | }
102 | .dataTables_wrapper table td,
103 | .dataTables_wrapper table th {
104 | text-align: left;
105 | padding: 0.3em 0.4em;
106 | }
107 |
108 | .css_right {
109 | float: right;
110 | }
111 |
112 |
113 | /* login/register form
114 | */
115 | form.login,
116 | form.register {
117 | padding: 1px 10px;
118 | margin: 10px 0px;
119 | width: 350px;
120 | }
121 |
122 | form.login label,
123 | form.register label {
124 | display: block;
125 | padding: 0px;
126 | margin: 10px 0 2px 0;
127 | }
128 |
129 | form.register textarea,
130 | form.login input,
131 | form.register input {
132 | border: 1px solid #cbcbcb;
133 | padding: 5px;
134 | width: 338px;
135 | color: #606060;
136 | font-size: 16px;
137 | }
138 |
139 | form.register textarea {
140 | height: 150px;
141 | }
142 |
143 | form.login input[type='submit'],
144 | form.register input[type='submit'] {
145 | margin: 20px 0 10px 0;
146 | width: 350px;
147 | color: #404040;
148 | }
149 |
150 | form.register input[type='checkbox'] {
151 | width: auto;
152 | float: right;
153 | margin-top: -18px;
154 | }
155 |
156 | form.register input[type='radio'] {
157 | width: auto;
158 | float: right;
159 | /* margin-top: -18px; */
160 | }
161 |
162 | form.register input[readonly] {
163 | background-color: #f0f0f0;
164 | color: #909090;
165 | }
166 |
167 |
168 | /* errors
169 | */
170 |
171 | div.flash-message,
172 | div.flash-error {
173 | padding: 10px 15px;
174 | margin: 5px auto;
175 | }
176 |
177 | div.flash-error {
178 | background-color: #ff9999;
179 | border: 1px solid #aa3333;
180 | }
181 |
182 | div.flash-message {
183 | background-color: #99ff99;
184 | border: 1px solid #33aa33;
185 | }
186 |
187 | /* footer
188 | */
189 |
190 | #footer {
191 | text-align: left;
192 | padding: 1em;
193 | font-size: 0.8em;
194 | position: fixed;
195 | bottom: 0px;
196 | right: 0px;
197 | }
198 |
199 | /* content
200 | */
201 | #content {
202 | padding: 1em;
203 | font-size: 18px;
204 | }
205 |
206 | #content.nopadding {
207 | padding: 0;
208 | }
209 |
210 | #content h1 {
211 | font-size: 2.4em;
212 | font-weight: bold;
213 | padding: 0;
214 | margin: 0;
215 | }
216 |
217 | #content h1 a {
218 | color: #333;
219 | }
220 |
221 | #content h2 {
222 | color: #f8fbfd;
223 | background-color: #333;
224 | font-size: 24px;
225 | height: 33px;
226 | line-height: 33px;
227 | padding: 3px 10px;
228 | clear: both;
229 | float: left;
230 | }
231 |
232 | #content #col1,
233 | #content #col2 {
234 | width: 50%;
235 | float: left;
236 | }
237 |
238 | #content pre {
239 | font-family: monospace;
240 | margin: 0 20px;
241 | background-color: #eee;
242 | padding: 10px 15px;
243 | }
244 |
245 | #content .help {
246 | color: #aaa;
247 | }
248 |
249 | #content .button,
250 | #content input[type='submit'] {
251 | background-color: #0059f6;
252 | border-radius: 32px;
253 | padding: 10px 22px;
254 | color: #e6ebf4;
255 | font-size: 18px;
256 | }
257 |
258 | #content .button {
259 | margin: 20px auto;
260 | display: run-in;
261 | }
262 |
263 | #content .buttoncancel {
264 | background-color: #808080;
265 | }
266 |
267 | #content .logs {
268 | font-size: 12px;
269 | white-space: normal;
270 | }
271 |
272 | .clear {
273 | clear: left;
274 | }
275 |
276 | #expertdiv {
277 | display: none;
278 | }
279 |
280 | .statusbar {
281 | background-color: #808080;
282 | height: 44px;
283 | line-height: 44px;
284 | margin-right: 20px;
285 | }
286 |
287 | .progressbar {
288 | background-color: #0059f6;
289 | height: 44px;
290 | line-height: 44px;
291 | float: left;
292 | }
293 |
294 | .progressbar.failed {
295 | background-color: #f65900;
296 | }
297 |
298 | .statusmessage {
299 | height: 44px;
300 | line-height: 44px;
301 | position: absolute;
302 | width: 417px;
303 | color: white;
304 | text-align: center;
305 | }
306 |
307 | /* myaccount
308 | */
309 | #menu span.myaccount {
310 | font-size: 1em;
311 | display: block;
312 | color: #aaaaaa;
313 | }
314 |
315 | /* storage
316 | */
317 |
318 | table.browser td.first a {
319 | padding-left: 24px;
320 | background-position: center left;
321 | background-repeat: no-repeat;
322 | display: block;
323 | }
324 |
325 | td.icon-folder a {
326 | background-image: url('icon-folder.png');
327 | }
328 |
329 | td.icon-document a {
330 | background-image: url('icon-document.png');
331 | }
332 |
333 | td.icon-back a {
334 | background-image: url('icon-back.png');
335 | }
336 |
337 | /* submenu
338 | */
339 | div.submenu {
340 | margin: 1em 0;
341 | }
342 |
343 | div.submenu a {
344 | font-size: 12px;
345 | }
346 |
347 | div.submenu a:hover {
348 | color: inherit;
349 | }
350 |
351 | input[type="submit"].ui-button,
352 | a.ui-button {
353 | font-size: 12px;
354 | }
355 |
356 | /* helpers
357 | */
358 | .clear {
359 | clear: both;
360 | }
361 |
362 | /* maps
363 | */
364 | div#map_canvas {
365 | margin-top: 20px;
366 | float: left;
367 | width: 370px;
368 | height: 370px;
369 | }
370 |
371 | div#map_canvasf {
372 | width: 100%;
373 | height: 500px;
374 | }
375 |
376 | /* crosshair
377 | */
378 | div#map_crosshair {
379 | background: url("crosshair.gif") no-repeat scroll center center transparent;
380 | width: 19px;
381 | height: 19px;
382 | float: left;
383 | position: relative;
384 | left: -194px;
385 | top: 175px;
386 | margin-top: 20px;
387 | }
388 |
389 | /* buttons
390 | */
391 | a.btn-notext {
392 | width: 28px;
393 | height: 24px;
394 | }
395 |
396 | a.btn-big {
397 | line-height: 62px !important;
398 | font-size: 1.1em;
399 | margin-bottom: 1em;
400 | }
401 |
402 | a.btn-big img {
403 | border: none;
404 | vertical-align: middle;
405 | margin-right: 10px;
406 | }
407 |
408 | a.ui-button:hover {
409 | color: black;
410 | }
411 |
412 | /** Time picker
413 | */
414 | .ui-timepicker-div .ui-widget-header{ margin-bottom: 8px; }
415 | .ui-timepicker-div dl{ text-align: left; }
416 | .ui-timepicker-div dl dt{ height: 25px; }
417 | .ui-timepicker-div dl dd{ margin: -25px 10px 10px 65px; }
418 | .ui-timepicker-div td { font-size: 90%; }
419 |
--------------------------------------------------------------------------------
/slave/builder.py:
--------------------------------------------------------------------------------
1 | import re
2 | import socket
3 | from copy import copy
4 | from os import mkdir, environ
5 | from os.path import dirname, join, realpath, exists, basename
6 | from hotqueue import HotQueue
7 | from ConfigParser import ConfigParser
8 | from time import sleep
9 |
10 | buildenv = copy(environ)
11 | environ.pop('http_proxy', None)
12 |
13 | import subprocess
14 | import requests
15 |
16 | # reading the configuration
17 | hostname = socket.gethostname()
18 | config = ConfigParser()
19 | config.read(join(dirname(__file__), 'config.cfg'))
20 |
21 | # start the queue
22 | qjob = HotQueue(
23 | 'jobsubmit',
24 | host=config.get('hotqueue', 'host'),
25 | port=config.getint('hotqueue', 'port'),
26 | db=config.getint('hotqueue', 'db'),
27 | password=config.get('hotqueue', 'password'))
28 |
29 | qlog = HotQueue(
30 | 'joblog',
31 | host=config.get('hotqueue', 'host'),
32 | port=config.getint('hotqueue', 'port'),
33 | db=config.getint('hotqueue', 'db'),
34 | password=config.get('hotqueue', 'password'))
35 |
36 | # put a hello world message
37 | qlog.put({'cmd': 'alive', 'host': hostname})
38 |
39 | # create the job directory if not exist
40 | root_dir = realpath(join(dirname(__file__), 'jobs'))
41 | try:
42 | mkdir(root_dir)
43 | except:
44 | pass
45 |
46 | # checkout and clean the python-for-android project
47 | build_dir = realpath(join(dirname(__file__), 'python-for-android'))
48 | dist_dir = join(build_dir, 'dist', 'default')
49 | if not exists(build_dir):
50 | subprocess.Popen(['git', 'clone',
51 | 'git://github.com/kivy/python-for-android'], shell=False).communicate()
52 | else:
53 | subprocess.Popen(['git', 'clean', '-dxf'], shell=False,
54 | cwd=build_dir).communicate()
55 | subprocess.Popen(['git', 'pull', 'origin', 'master'], shell=False,
56 | cwd=build_dir).communicate()
57 |
58 | base_maxstatus = 10
59 | max_status = base_maxstatus
60 | id_status = 0
61 | def status(job, message):
62 | global id_status
63 | id_status += 1
64 | print job['uid'], message
65 | message = '[%d/%d] ' % (id_status, max_status) + message
66 | qlog.put({'cmd': 'status', 'uid': job['uid'], 'msg': message, 'host':
67 | hostname})
68 | qlog.put({'cmd': 'log', 'uid': job['uid'], 'line': message, 'host':
69 | hostname})
70 |
71 | def command(job, command, cwd=None):
72 | global max_status
73 | process = subprocess.Popen(command, shell=False, cwd=cwd,
74 | stderr=subprocess.STDOUT, stdout=subprocess.PIPE, env=buildenv)
75 | lines = []
76 | while process.poll() is None:
77 | line = process.stdout.readline()
78 | if not line:
79 | break
80 | line = line.rstrip('\r\n')
81 | lines.append(line)
82 | lines = lines[-100:]
83 | #qlog.put({'cmd': 'log', 'uid': job['uid'], 'line': line})
84 | print job['uid'], process.returncode, line
85 |
86 | # send progressive distribution information
87 | if 'Dependency order' in line:
88 | groups = re.search('Dependency order is (.*) \(computed\)', line)
89 | if groups:
90 | groups = groups.groups()[0].split()
91 | max_status = base_maxstatus + len(groups)
92 | if 'Run get packages' in line:
93 | status(job, 'Downloading packages')
94 | elif 'Run prebuild' in line:
95 | status(job, 'Prebuild packages')
96 | elif 'Run build' in line:
97 | status(job, 'Building packages')
98 | elif 'Run postbuild' in line:
99 | status(job, 'Postbuild packages')
100 | elif 'Run distribute' in line:
101 | status(job, 'Create distribution')
102 | elif 'Call build_' in line:
103 | groups = re.search('build_(\w+)', line)
104 | if groups:
105 | package = groups.groups()[0]
106 | status(job, 'Build ' + package)
107 |
108 | process.communicate()
109 |
110 | print process.returncode, command
111 | if process.returncode != 0:
112 | qlog.put({'cmd': 'status', 'uid': job['uid'],
113 | 'msg': 'Error while executing %r' % command,
114 | 'host': hostname})
115 | raise Exception('Error on %r.\n\n%s' % (command, '\n'.join(lines)))
116 |
117 | def builder(job_dir, **job):
118 | # got a job to do
119 | uid = job['uid']
120 |
121 | app_dir = join(job_dir, 'app')
122 | mkdir(app_dir)
123 |
124 | # do the job here
125 | url_base = config.get('www', 'url')
126 |
127 | # get data
128 | url_data = url_base + '/api/data/' + uid
129 | r = requests.get(url_data)
130 | r.raise_for_status()
131 | data_fn = join(job_dir, 'data.zip')
132 | with open(data_fn, 'wb') as fd:
133 | fd.write(r.content)
134 |
135 | # icon ?
136 | if job['have_icon'] == '1':
137 | url_icon = url_base + '/api/icon/' + uid
138 | r = requests.get(url_icon)
139 | r.raise_for_status()
140 | icon_fn = join(job_dir, 'icon.png')
141 | with open(icon_fn, 'wb') as fd:
142 | fd.write(r.content)
143 |
144 | # presplash ?
145 | if job['have_presplash'] == '1':
146 | url_presplash = url_base + '/api/presplash/' + uid
147 | r = requests.get(url_presplash)
148 | r.raise_for_status()
149 | presplash_fn = join(job_dir, 'presplash.png')
150 | with open(presplash_fn, 'wb') as fd:
151 | fd.write(r.content)
152 |
153 | # decompress
154 | command(job, ['unzip', '-d', app_dir, data_fn])
155 |
156 | # build distribution
157 | status(job, 'Build distribution')
158 | command(job, ['git', 'clean', '-dxf'], build_dir)
159 | command(job, ['./distribute.sh', '-m', job['modules']], build_dir)
160 |
161 | # build the package
162 | status(job, 'Build apk')
163 | build = ['./build.py',
164 | '--package', job['package_name'],
165 | '--name', job['package_title'],
166 | '--version', job['package_version'],
167 | '--private', app_dir,
168 | '--orientation', job['package_orientation']]
169 | if job['have_icon'] == '1':
170 | build.append('--icon')
171 | build.append(icon_fn)
172 | if job['have_presplash'] == '1':
173 | build.append('--presplash')
174 | build.append(presplash_fn)
175 | if job['package_permissions']:
176 | for permission in job['package_permissions'].split(' '):
177 | build.append('--permission')
178 | build.append(permission)
179 | build.append(job['mode'])
180 | command(job, build, dist_dir)
181 |
182 | # get apk name
183 | versioned_name = job['package_title'].replace(' ', '').replace('\'', '') + \
184 | '-' + job['package_version']
185 | apk_fn = join(dist_dir, 'bin', '%s-%s.apk' % (versioned_name,
186 | 'release-unsigned' if job['mode'] == 'release' else 'debug'))
187 |
188 | # job done, upload the apk
189 | status(job, 'Upload %s' % basename(apk_fn))
190 | with open(apk_fn, 'rb') as fd:
191 | files = {'file': (basename(apk_fn), fd)}
192 | count = 5
193 | while count:
194 | try:
195 | status(job, 'Uploading (%d remaining)' % count)
196 | r = requests.post(url_base + '/api/push/' + uid, files=files)
197 | except:
198 | count -= 1
199 | status(job, 'Upload failed (%d remaining)' % count)
200 | if not count:
201 | raise
202 | sleep(5)
203 | continue
204 |
205 | r.raise_for_status()
206 | break
207 |
208 | status(job, 'Done')
209 |
210 | # === go !
211 | print '== Ready to build!'
212 | while True:
213 | qlog.put({'cmd': 'available', 'host': hostname})
214 | task = qjob.get(timeout=5, block=True)
215 | if task is None:
216 | continue
217 | qlog.put({'cmd': 'busy', 'host': hostname})
218 | uid = task['uid']
219 | try:
220 | id_status = 0
221 | max_status = base_maxstatus
222 | status(task, 'Initialize job')
223 | # create a directory
224 | job_dir = realpath(join(root_dir, uid))
225 | mkdir(job_dir)
226 | qlog.put({'cmd': 'start', 'uid': uid, 'host': hostname})
227 | builder(job_dir, **task)
228 | qlog.put({'cmd': 'done', 'uid': uid, 'host': hostname})
229 | except Exception, e:
230 | print 'Got exception', e
231 | import traceback
232 | traceback.print_exc()
233 | qlog.put({'cmd': 'exception', 'uid': uid, 'msg': str(e), 'host':
234 | hostname})
235 | finally:
236 | # just to be entirely sure sure sure
237 | if len(uid) > 10 and not '.' in uid and job_dir.endswith(uid):
238 | subprocess.Popen(['rm', '-rf', job_dir], shell=False).communicate()
239 |
240 |
--------------------------------------------------------------------------------
/master/supervisord.conf:
--------------------------------------------------------------------------------
1 | ; Sample supervisor config file.
2 | ;
3 | ; For more information on the config file, please see:
4 | ; http://supervisord.org/configuration.html
5 | ;
6 | ; Note: shell expansion ("~" or "$HOME") is not supported. Environment
7 | ; variables can be expanded using this syntax: "%(ENV_HOME)s".
8 |
9 | [unix_http_server]
10 | file=/tmp/supervisor.sock ; (the path to the socket file)
11 | ;chmod=0700 ; socket file mode (default 0700)
12 | ;chown=nobody:nogroup ; socket file uid:gid owner
13 | ;username=user ; (default is no username (open server))
14 | ;password=123 ; (default is no password (open server))
15 |
16 | ;[inet_http_server] ; inet (TCP) server disabled by default
17 | ;port=127.0.0.1:9001 ; (ip_address:port specifier, *:port for all iface)
18 | ;username=user ; (default is no username (open server))
19 | ;password=123 ; (default is no password (open server))
20 |
21 | [supervisord]
22 | logfile=/tmp/supervisord.log ; (main log file;default $CWD/supervisord.log)
23 | logfile_maxbytes=50MB ; (max main logfile bytes b4 rotation;default 50MB)
24 | logfile_backups=10 ; (num of main logfile rotation backups;default 10)
25 | loglevel=info ; (log level;default info; others: debug,warn,trace)
26 | pidfile=/tmp/supervisord.pid ; (supervisord pidfile;default supervisord.pid)
27 | nodaemon=false ; (start in foreground if true;default false)
28 | minfds=1024 ; (min. avail startup file descriptors;default 1024)
29 | minprocs=200 ; (min. avail process descriptors;default 200)
30 | ;umask=022 ; (process file creation umask;default 022)
31 | ;user=chrism ; (default is current user, required if root)
32 | ;identifier=supervisor ; (supervisord identifier, default is 'supervisor')
33 | ;directory=/tmp ; (default is not to cd during start)
34 | ;nocleanup=true ; (don't clean up tempfiles at start;default false)
35 | ;childlogdir=/tmp ; ('AUTO' child log dir, default $TEMP)
36 | ;environment=KEY=value ; (key value pairs to add to environment)
37 | ;strip_ansi=false ; (strip ansi escape codes in logs; def. false)
38 |
39 | ; the below section must remain in the config file for RPC
40 | ; (supervisorctl/web interface) to work, additional interfaces may be
41 | ; added by defining them in separate rpcinterface: sections
42 | [rpcinterface:supervisor]
43 | supervisor.rpcinterface_factory = supervisor.rpcinterface:make_main_rpcinterface
44 |
45 | [supervisorctl]
46 | serverurl=unix:///tmp/supervisor.sock ; use a unix:// URL for a unix socket
47 | ;serverurl=http://127.0.0.1:9001 ; use an http:// url to specify an inet socket
48 | ;username=chris ; should be same as http_username if set
49 | ;password=123 ; should be same as http_password if set
50 | ;prompt=mysupervisor ; cmd line prompt (default "supervisor")
51 | ;history_file=~/.sc_history ; use readline history if available
52 |
53 | ; The below sample program section shows all possible program subsection values,
54 | ; create one or more 'real' program: sections to be able to control them under
55 | ; supervisor.
56 |
57 | ;[program:theprogramname]
58 | ;command=/bin/cat ; the program (relative uses PATH, can take args)
59 | ;process_name=%(program_name)s ; process_name expr (default %(program_name)s)
60 | ;numprocs=1 ; number of processes copies to start (def 1)
61 | ;directory=/tmp ; directory to cwd to before exec (def no cwd)
62 | ;umask=022 ; umask for process (default None)
63 | ;priority=999 ; the relative start priority (default 999)
64 | ;autostart=true ; start at supervisord start (default: true)
65 | ;autorestart=unexpected ; whether/when to restart (default: unexpected)
66 | ;startsecs=1 ; number of secs prog must stay running (def. 1)
67 | ;startretries=3 ; max # of serial start failures (default 3)
68 | ;exitcodes=0,2 ; 'expected' exit codes for process (default 0,2)
69 | ;stopsignal=QUIT ; signal used to kill process (default TERM)
70 | ;stopwaitsecs=10 ; max num secs to wait b4 SIGKILL (default 10)
71 | ;stopasgroup=false ; send stop signal to the UNIX process group (default false)
72 | ;killasgroup=false ; SIGKILL the UNIX process group (def false)
73 | ;user=chrism ; setuid to this UNIX account to run the program
74 | ;redirect_stderr=true ; redirect proc stderr to stdout (default false)
75 | ;stdout_logfile=/a/path ; stdout log path, NONE for none; default AUTO
76 | ;stdout_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB)
77 | ;stdout_logfile_backups=10 ; # of stdout logfile backups (default 10)
78 | ;stdout_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0)
79 | ;stdout_events_enabled=false ; emit events on stdout writes (default false)
80 | ;stderr_logfile=/a/path ; stderr log path, NONE for none; default AUTO
81 | ;stderr_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB)
82 | ;stderr_logfile_backups=10 ; # of stderr logfile backups (default 10)
83 | ;stderr_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0)
84 | ;stderr_events_enabled=false ; emit events on stderr writes (default false)
85 | ;environment=A=1,B=2 ; process environment additions (def no adds)
86 | ;serverurl=AUTO ; override serverurl computation (childutils)
87 |
88 | ; The below sample eventlistener section shows all possible
89 | ; eventlistener subsection values, create one or more 'real'
90 | ; eventlistener: sections to be able to handle event notifications
91 | ; sent by supervisor.
92 |
93 | ;[eventlistener:theeventlistenername]
94 | ;command=/bin/eventlistener ; the program (relative uses PATH, can take args)
95 | ;process_name=%(program_name)s ; process_name expr (default %(program_name)s)
96 | ;numprocs=1 ; number of processes copies to start (def 1)
97 | ;events=EVENT ; event notif. types to subscribe to (req'd)
98 | ;buffer_size=10 ; event buffer queue size (default 10)
99 | ;directory=/tmp ; directory to cwd to before exec (def no cwd)
100 | ;umask=022 ; umask for process (default None)
101 | ;priority=-1 ; the relative start priority (default -1)
102 | ;autostart=true ; start at supervisord start (default: true)
103 | ;autorestart=unexpected ; whether/when to restart (default: unexpected)
104 | ;startsecs=1 ; number of secs prog must stay running (def. 1)
105 | ;startretries=3 ; max # of serial start failures (default 3)
106 | ;exitcodes=0,2 ; 'expected' exit codes for process (default 0,2)
107 | ;stopsignal=QUIT ; signal used to kill process (default TERM)
108 | ;stopwaitsecs=10 ; max num secs to wait b4 SIGKILL (default 10)
109 | ;stopasgroup=false ; send stop signal to the UNIX process group (default false)
110 | ;killasgroup=false ; SIGKILL the UNIX process group (def false)
111 | ;user=chrism ; setuid to this UNIX account to run the program
112 | ;redirect_stderr=true ; redirect proc stderr to stdout (default false)
113 | ;stdout_logfile=/a/path ; stdout log path, NONE for none; default AUTO
114 | ;stdout_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB)
115 | ;stdout_logfile_backups=10 ; # of stdout logfile backups (default 10)
116 | ;stdout_events_enabled=false ; emit events on stdout writes (default false)
117 | ;stderr_logfile=/a/path ; stderr log path, NONE for none; default AUTO
118 | ;stderr_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB)
119 | ;stderr_logfile_backups ; # of stderr logfile backups (default 10)
120 | ;stderr_events_enabled=false ; emit events on stderr writes (default false)
121 | ;environment=A=1,B=2 ; process environment additions
122 | ;serverurl=AUTO ; override serverurl computation (childutils)
123 |
124 | ; The below sample group section shows all possible group values,
125 | ; create one or more 'real' group: sections to create "heterogeneous"
126 | ; process groups.
127 |
128 | ;[group:thegroupname]
129 | ;programs=progname1,progname2 ; each refers to 'x' in [program:x] definitions
130 | ;priority=999 ; the relative start priority (default 999)
131 |
132 | ; The [include] section can just contain the "files" setting. This
133 | ; setting can list multiple files (separated by whitespace or
134 | ; newlines). It can also contain wildcards. The filenames are
135 | ; interpreted as relative to this file. Included files *cannot*
136 | ; include files themselves.
137 |
138 | ;[include]
139 | ;files = relative/directory/*.ini
140 |
141 | [program:pollqlog]
142 | command=python /home/web/kivy.org/android/pollqlog.py
143 | redirect_stderr=true
144 | stdout_logfile=pollqlog.log
145 | stdout_logfile_maxbytes=20MB
146 | stdout_logfile_backups=10
147 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/__init__.py:
--------------------------------------------------------------------------------
1 | '''
2 | Frontend module
3 | '''
4 |
5 | __all__ = ('frontend', )
6 |
7 | from flask import Blueprint, render_template, url_for, redirect, abort, \
8 | send_file, request, make_response, jsonify
9 | from web.job import read_job, read_logs, JobObj
10 | from werkzeug import secure_filename
11 | from web.config import qjob, r
12 | from os.path import exists
13 | from uuid import uuid4
14 | import subprocess
15 | import re
16 |
17 | from time import time
18 | from os import mkdir
19 | from os.path import join, splitext
20 | from flaskext.wtf import Form, TextField, SubmitField, validators, \
21 | FileField, SelectField, BooleanField
22 |
23 | frontend = Blueprint('frontend', __name__, static_folder='static',
24 | static_url_path='/frontend/static', template_folder='templates')
25 |
26 | class JobForm(Form):
27 | package_name = TextField('Package', [
28 | validators.Required(), validators.Length(min=3, max=128)],
29 | description='org.kivy.touchtracer')
30 | package_version = TextField('Version', [
31 | validators.Required(), validators.Length(min=1, max=64)],
32 | description='1.0')
33 | package_title = TextField('Name', [
34 | validators.Required(), validators.Length(min=1, max=128)],
35 | description='Touchtracer')
36 | modules = TextField('Modules',
37 | description='pil kivy')
38 | directory = FileField('Application zipped with main.py',
39 | description='''You must create a zip of your application directory
40 | containing main.py in the zip root.''')
41 | package_permissions = TextField('Permissions', [
42 | validators.Length(max=2048)],
43 | description='INTERNET')
44 | package_orientation = SelectField('Orientation', choices=[
45 | ('landscape', 'Landscape'),
46 | ('portrait', 'Portrait')], default='landscape')
47 | package_icon = FileField('Icon')
48 | package_presplash = FileField('Presplash')
49 | emails = TextField('Send notification to', [
50 | validators.Length(max=2048)],
51 | description='your@email.com')
52 | release = BooleanField('Release mode')
53 | submit = SubmitField('Submit')
54 |
55 | @frontend.route('/job/')
56 | def job(uid):
57 | job = read_job(uid)
58 | if job is None:
59 | return redirect(url_for('frontend.index'))
60 |
61 | # get the log associated to the job
62 | joblog = list(reversed(read_logs(uid)))
63 | progress = job.build_status
64 | if not progress:
65 | pprogress = 0
66 | ptotal = 1
67 | pcurrent = 0
68 | status = "Waiting a builder"
69 | else:
70 | try:
71 | progress, status = progress[1:].split(']', 1)
72 | pcurrent, ptotal = progress.split('/')
73 | except ValueError:
74 | status = job.build_status
75 | pcurrent = 1
76 | ptotal = 1
77 | pprogress = int((int(pcurrent) / float(ptotal)) * 100.)
78 | status = status.strip().rstrip('.').capitalize()
79 | return render_template('frontend/job.html', job=job, joblog=joblog,
80 | pcurrent=pcurrent, ptotal=ptotal, pprogress=pprogress,
81 | status=status)
82 |
83 | @frontend.route('/job//delete')
84 | def delete(uid):
85 | job = read_job(uid, 'package_name')
86 | if not job:
87 | abort(404)
88 |
89 | # delte job directory
90 | d = job.directory
91 | if d and len(d) > 10:
92 | subprocess.Popen(['rm', '-rf', d], shell=False).communicate()
93 |
94 | keys = r.keys('job:%s*' % uid)
95 | if keys:
96 | r.delete(*keys)
97 | keys = r.keys('log:%s*' % uid)
98 | if keys:
99 | r.delete(*keys)
100 |
101 | return redirect(url_for('frontend.index'))
102 |
103 | @frontend.route('/api/data/')
104 | def jobdata(uid):
105 | job = read_job(uid, 'directory', 'data_ext')
106 | if not job:
107 | return abort(404)
108 | print job
109 | r.set('job:%s:dt_started' % uid, time())
110 | r.set('job:%s:is_started' % uid, 1)
111 | return send_file(job.data_fn)
112 |
113 | @frontend.route('/api/icon/')
114 | def jobicon(uid):
115 | job = read_job(uid, 'directory', 'have_icon')
116 | if not job or not job.have_icon or not exists(job.icon_fn):
117 | return abort(404)
118 | return send_file(job.icon_fn)
119 |
120 | @frontend.route('/api/presplash/')
121 | def jobpresplash(uid):
122 | job = read_job(uid, 'directory')
123 | if not job or not job.have_presplash or not exists(job.presplash_fn):
124 | return abort(404)
125 | return send_file(job.presplash_fn)
126 |
127 | @frontend.route('/api/push/', methods=['POST'])
128 | def jobpush(uid):
129 | job = read_job(uid)
130 | if not job:
131 | return abort(404)
132 | file = request.files['file']
133 | if file and file.filename.rsplit('.', 1)[-1] == 'apk':
134 | filename = secure_filename(file.filename)
135 | file.save(join(job.directory, filename))
136 | r.set('job:%s:apk' % uid, filename)
137 | r.set('job:%s:dt_done' % uid, time())
138 | r.set('job:%s:is_done' % uid, 1)
139 |
140 | try:
141 | job.notify()
142 | except:
143 | pass
144 | return make_response('done')
145 | else:
146 | return abort(403)
147 |
148 | @frontend.route('/download//')
149 | def download(uid, apk):
150 | job = read_job(uid, 'apk', 'directory', 'dt_done')
151 | if not job or not job.apk or not job.dt_done:
152 | return abort(404)
153 | return send_file(job.apk_fn)
154 |
155 | @frontend.route('/')
156 | def index():
157 | form = JobForm()
158 | return render_template('frontend/index.html', form=form)
159 |
160 | @frontend.route('/faq')
161 | def faq():
162 | return render_template('frontend/faq.html')
163 |
164 | @frontend.route('/about')
165 | def about():
166 | return render_template('frontend/about.html')
167 |
168 | @frontend.route('/status')
169 | def status():
170 | key = qjob.key
171 | queue_len = qjob._HotQueue__redis.llen(key)
172 |
173 | hosts_last_alive = r.keys('host:*:last_alive')
174 | hosts = [x.split(':')[1] for x in hosts_last_alive]
175 |
176 | stats = {}
177 | for host in hosts:
178 | stats[host] = {
179 | 'last_seen': int(time() - float(r.get('host:{}:last_alive'.format(host)))),
180 | 'status': r.get('host:{}:status'.format(host))}
181 |
182 | return render_template('frontend/status.html', queue_len=queue_len,
183 | stats=stats)
184 |
185 | def csplit(s):
186 | return ' '.join([x for x in re.split(r'[.; ]', s) if len(x)])
187 |
188 | @frontend.route('/submit', methods=['POST'])
189 | def submit():
190 | form = JobForm()
191 | if form.validate_on_submit():
192 | fn = secure_filename(form.directory.file.filename)
193 | ext = splitext(fn)[-1]
194 | if splitext(fn)[-1] not in (
195 | '.zip'):#, '.tbz', '.tar.gz', '.tbz2', '.tar.bz2'):
196 | return render_template('frontend/index.html', form=form,
197 | error='Invalid application directory package')
198 |
199 | # create a job
200 | uid = str(uuid4())
201 |
202 | # fake job obj for getting path
203 | job = JobObj({'uid': uid})
204 |
205 | jobkey = 'job:%s' % uid
206 | basekey = jobkey + ':'
207 | r.set(basekey + 'dt_added', time())
208 |
209 | # create the job directory
210 | d = job.directory
211 | mkdir(d)
212 | form.directory.file.save(join(d, 'data%s' % ext))
213 |
214 | if form.package_presplash.file:
215 | form.package_presplash.file.save(job.presplash_fn)
216 | r.set(basekey + 'have_presplash', 1)
217 | else:
218 | r.set(basekey + 'have_presplash', 0)
219 |
220 | if form.package_icon.file:
221 | form.package_icon.file.save(job.icon_fn)
222 | r.set(basekey + 'have_icon', 1)
223 | else:
224 | r.set(basekey + 'have_icon', 0)
225 |
226 | # add in the database
227 | r.set(basekey + 'package_name', form.package_name.data)
228 | r.set(basekey + 'package_version', form.package_version.data)
229 | r.set(basekey + 'package_title', form.package_title.data)
230 | r.set(basekey + 'package_orientation', form.package_orientation.data)
231 | r.set(basekey + 'package_permissions', form.package_permissions.data)
232 | r.set(basekey + 'modules', form.modules.data)
233 | r.set(basekey + 'emails', form.emails.data)
234 | r.set(basekey + 'data_ext', ext)
235 | r.set(basekey + 'is_release', 1 if form.release.data else 0)
236 | r.set(basekey + 'build_status', '')
237 | r.set(basekey + 'is_failed', 0)
238 | r.set(basekey + 'is_started', 0)
239 | r.set(basekey + 'is_done', 0)
240 | r.set(basekey + 'apk', '')
241 |
242 | # creation finished
243 | r.set(jobkey, uid)
244 |
245 | # not optimized, but reread it.
246 | job = read_job(uid)
247 |
248 | # submit a job in reddis
249 | qjob.put({
250 | 'uid': job.uid,
251 | 'package_name': job.package_name,
252 | 'package_title': job.package_title,
253 | 'package_version': job.package_version,
254 | 'package_orientation': job.package_orientation,
255 | 'package_permissions': csplit(job.package_permissions),
256 | 'emails': csplit(job.emails),
257 | 'have_icon': job.have_icon,
258 | 'have_presplash': job.have_presplash,
259 | 'mode': 'release' if job.is_release == '1' else 'debug',
260 | 'modules': csplit(job.modules)
261 | })
262 |
263 | if 'batch' in request.form:
264 | d = {'status': 'ok',
265 | 'uid': job.uid,
266 | 'url': url_for('frontend.job', uid=job.uid, _external=True)}
267 | return jsonify(**d)
268 | else:
269 | # redirect to the view job
270 | return redirect(url_for('frontend.job', uid=job.uid))
271 |
272 | return render_template('frontend/index.html', form=form)
273 |
274 |
--------------------------------------------------------------------------------
/master/web/apps/frontend/static/index.html:
--------------------------------------------------------------------------------
1 |
2 |
3 |
4 | jQuery UI Example Page
6 | Welcome to jQuery UI!
85 | This page demonstrates the widgets you downloaded using the theme you selected in the download builder. We've included and linked to minified versions of jQuery , your personalized copy of jQuery UI (js/jquery-ui-1.8.6.custom.min.js) , and css/smoothness/jquery-ui-1.8.6.custom.css which imports the entire jQuery UI CSS Framework. You can choose to link a subset of the CSS Framework depending on your needs.
86 | You've downloaded components and a theme that are compatible with jQuery 1.3+. Please make sure you are using jQuery 1.3+ in your production environment.
87 |
88 | YOUR COMPONENTS:
89 |
90 |
91 |
92 |
93 |
94 |
95 |
Lorem ipsum dolor sit amet. Lorem ipsum dolor sit amet. Lorem ipsum dolor sit amet.
96 |
97 |
98 |
99 |
Phasellus mattis tincidunt nibh.
100 |
101 |
102 |
103 |
Nam dui erat, auctor a, dignissim quis.
104 |
105 |
110 |
112 |
113 |
114 |
115 |
116 | A button element
117 |
124 |
125 |
126 |
127 |
128 |
129 |
134 |
Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.
135 |
Phasellus mattis tincidunt nibh. Cras orci urna, blandit id, pretium vel, aliquet ornare, felis. Maecenas scelerisque sem non nisl. Fusce sed lorem in enim dictum bibendum.
136 |
Nam dui erat, auctor a, dignissim quis, sollicitudin eu, felis. Pellentesque nisi urna, interdum eget, sagittis et, consequat vestibulum, lacus. Mauris porttitor ullamcorper augue.
137 |
142 |
143 |
144 |
145 |
146 |
Lorem ipsum dolor sit amet, Nulla nec tortor. Donec id elit quis purus consectetur consequat.
Nam congue semper tellus. Sed erat dolor, dapibus sit amet, venenatis ornare, ultrices ut, nisi. Aliquam ante. Suspendisse scelerisque dui nec velit. Duis augue augue, gravida euismod, vulputate ac, facilisis id, sem. Morbi in orci.
Nulla purus lacus, pulvinar vel, malesuada ac, mattis nec, quam. Nam molestie scelerisque quam. Nullam feugiat cursus lacus.orem ipsum dolor sit amet, consectetur adipiscing elit. Donec libero risus, commodo vitae, pharetra mollis, posuere eu, pede. Nulla nec tortor. Donec id elit quis purus consectetur consequat.
Nam congue semper tellus. Sed erat dolor, dapibus sit amet, venenatis ornare, ultrices ut, nisi. Aliquam ante. Suspendisse scelerisque dui nec velit. Duis augue augue, gravida euismod, vulputate ac, facilisis id, sem. Morbi in orci. Nulla purus lacus, pulvinar vel, malesuada ac, mattis nec, quam. Nam molestie scelerisque quam.
Nullam feugiat cursus lacus.orem ipsum dolor sit amet, consectetur adipiscing elit. Donec libero risus, commodo vitae, pharetra mollis, posuere eu, pede. Nulla nec tortor. Donec id elit quis purus consectetur consequat. Nam congue semper tellus. Sed erat dolor, dapibus sit amet, venenatis ornare, ultrices ut, nisi. Aliquam ante.
Suspendisse scelerisque dui nec velit. Duis augue augue, gravida euismod, vulputate ac, facilisis id, sem. Morbi in orci. Nulla purus lacus, pulvinar vel, malesuada ac, mattis nec, quam. Nam molestie scelerisque quam. Nullam feugiat cursus lacus.orem ipsum dolor sit amet, consectetur adipiscing elit. Donec libero risus, commodo vitae, pharetra mollis, posuere eu, pede. Nulla nec tortor. Donec id elit quis purus consectetur consequat. Nam congue semper tellus. Sed erat dolor, dapibus sit amet, venenatis ornare, ultrices ut, nisi.
147 |
148 |
149 |
150 |
151 |
152 |
Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.
153 |
154 |
155 |
156 |
161 |
Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.
162 |
367 |
368 |
369 |
370 |
371 |
372 |
373 |
374 |
375 |
376 |
377 |
378 |
384 | ' +
278 | '' + o.timeText + ' ' +
280 | '' + o.hourText + ' ',
284 | hourGridSize = 0,
285 | minuteGridSize = 0,
286 | secondGridSize = 0,
287 | size;
288 |
289 | if (o.showHour && o.hourGrid > 0) {
290 | html += '' +
291 | '
' +
292 | '';
293 |
294 | for (var h = o.hourMin; h <= hourMax; h += o.hourGrid) {
295 | hourGridSize++;
296 | var tmph = (o.ampm && h > 12) ? h-12 : h;
297 | if (tmph < 10) tmph = '0' + tmph;
298 | if (o.ampm) {
299 | if (h == 0) tmph = 12 +'a';
300 | else if (h < 12) tmph += 'a';
301 | else tmph += 'p';
302 | }
303 | html += '' + tmph + ' ';
304 | }
305 |
306 | html += '
';
308 | } else html += '' + o.minuteText + ' ';
313 |
314 | if (o.showMinute && o.minuteGrid > 0) {
315 | html += '' +
316 | '
' +
318 | '';
319 |
320 | for (var m = o.minuteMin; m <= minMax; m += o.minuteGrid) {
321 | minuteGridSize++;
322 | html += '' + ((m < 10) ? '0' : '') + m + ' ';
323 | }
324 |
325 | html += '
';
327 | } else html += '' + o.secondText + ' ';
332 |
333 | if (o.showSecond && o.secondGrid > 0) {
334 | html += '' +
335 | '
' +
337 | '';
338 |
339 | for (var s = o.secondMin; s <= secMax; s += o.secondGrid) {
340 | secondGridSize++;
341 | html += '' + ((s < 10) ? '0' : '') + s + ' ';
342 | }
343 |
344 | html += '
';
346 | } else html += '' + o.timezoneText + ' ';
351 | html += '