├── MANIFEST.in
├── README.rst
├── __init__.py
├── setup.py
└── tmin
    ├── __init__.py
    └── management
        ├── __init__.py
        └── commands
            ├── _JavascriptMinify.py
            ├── _ManageMinimizers.py
            ├── _SimpleHTMLParser.py
            ├── _TemplateTextMinimizer.py
            ├── __init__.py
            ├── _cssmin.py
            └── minimizetemplates.py


/MANIFEST.in:
--------------------------------------------------------------------------------
1 | include *.rst
2 | include *.md
3 | include *.txt


--------------------------------------------------------------------------------
/README.rst:
--------------------------------------------------------------------------------
  1 | django-template-minimizer
  2 | =========================
  3 | 
  4 | For Django developers obsessed with performance. 
  5 | 
  6 | Minimize your templates once and not your HTML each time you serve it up.
  7 | 
  8 | :Download: http://pypi.python.org/pypi/django-template-minimizer/
  9 | :Source: http://github.com/Charles-Kaminski/django-template-minimizer
 10 | :License: MIT
 11 | 
 12 | Run this Django command to minimize your Django templates.  Eliminate the need to reprocess your HTML to minimize it; as the HTML is now being put together in minimized form.
 13 | 
 14 | The command minimizes django templates along with the html, in-line ``<script>`` javascript, and in-line ``<style>`` css inside the templates.  The command includes a minimize and an undo option.  The minimizers for html, css, and javascript are plugable so you can override or add your own.
 15 | 
 16 | Installing django-template-minimizer
 17 | ====================================
 18 | 
 19 | You can install ``django-template-minimizer`` either via the Python Package Index (PyPI) or from source.
 20 | 
 21 | To install using ``pip`` (recommended)::
 22 | 
 23 |     $ pip install django-template-minimizer
 24 | 
 25 | To install using ``easy_install``::
 26 | 
 27 |     $ easy_install django-template-minimizer
 28 | 
 29 | Register the app in your Django project's settings file::
 30 | 
 31 |     import tmin
 32 |     ...
 33 |     INSTALLED_APPS += ('tmin',)
 34 | 
 35 | To install from source, download the source from github (http://github.com/Charles-Kaminski/django-template-minimizer/downloads).  Decompress it and put it in the folder with your django project as another django app.  Register the app in your Django project's settings file.  
 36 | 
 37 | Usage
 38 | =====
 39 | 
 40 | **Commands**::
 41 | 
 42 |     $ python manage.py minimizetemplates    -> help text
 43 |     $ python manage.py minimizetemplates -m -> minimize
 44 |     $ python manage.py minimizetemplates -u -> undo
 45 |     
 46 | Use these commands to minimize (or unminimize) Django templates after development.  This way, your templates are small when they are evaluated and the HTML served is already minimized; eliminiating any post-processing minimization step.  
 47 | 
 48 | Use the comment tags ``{# NOMINIFY #} {# ENDNOMINIFY #}`` inside your templates to wrap content you do not want minified.  
 49 | 
 50 | Uses the setting ``TEMPLATE_DIRS`` in your Django settings file to tell the command where to find templates to minimize.::
 51 | 
 52 |     TEMPLATE_DIRS = [...]
 53 | 
 54 | Customization
 55 | =============
 56 | 
 57 | The minimizer command uses default minimizers for html, style tag embeded css, and script tag embeded javascript. You can override these and chain any number of your own minimizers using the settings below.  These settings go in the Django settings file. Custom minimizers must be functions that accept text as a string parameter and return text as a string.:: 
 58 | 
 59 |     JAVASCRIPT_MINIMIZERS = [my_function_1, my_function_2, ...]
 60 |     CSS_MINIMIZERS        = [my_function_3, my_function_4, ...]
 61 |     HTML_MINIMIZERS       = [my_function_5, my_function_6, ...]
 62 | 
 63 | To turn off a minimizer, use the following pattern::
 64 | 
 65 |     f = lambda x: x
 66 |     JAVASCRIPT_MINIMIZERS = [f,]
 67 | 
 68 | You can tell the minimizer command to disable an aggressive HTML minimizer in the default HTML minimizer chain.  This minimizer normally removes (instead of just collapsing) the remaining space between '``>``' & '``<``' character.  To disable this minimizer in the default chain, set the following setting to False in your Django settings file::
 69 | 
 70 |     AGGRESSIVE_HTML_MINIMIZER = False
 71 | 
 72 | Method
 73 | ======
 74 | 
 75 | For each template, the minimizer command:  
 76 | 
 77 | 1. Replaces any ``{# NOMINIFY #} {# ENDNOMINIFY #}`` tags and content with a unique identifier and saves the content in memory so that it is excluded from the rest of the process.
 78 | 
 79 | 2. Remaining Django comments are removed.
 80 | 
 81 | 3. Django tags and django variables are replaced with unique identifiers.  The tags and variables are saved in memory.  This approach "protects" the tags and variables from the minimizers.  It also allows you to use Django tags and variables inside your javascript and CSS without ill effect by the CSS or javascript minimizer.
 82 | 
 83 | 4. HTML script tags and content are replaced with unique identifiers. The tags and content are saved in memory for additional processing.  The type attribute for the script tag is checked to see if the script content is javascript.  If no type is provided, then javascript is assumed.  Any javascript is then run through the javascript minimizers.
 84 | 
 85 | 5. An almost identical process to step 4 is implemented on the HTML style tags for css.
 86 | 
 87 | 6. The remaining text (with the identifiers) is run through the html minimizers.
 88 | 
 89 | 7. All of the content saved in memory and associated with unique identifiers are put back.
 90 | 
 91 | 8. The original template is moved to an archive folder.  The minimized template is put in the original location.
 92 | 
 93 | Limitations
 94 | ===========
 95 | 
 96 | Use the ``{# NOMINIFY #} {# ENDNOMINIFY #}`` comment tags to overcome these limitations.
 97 | 
 98 | 1. The default javascript and css minimizers do not handle script tags inside script tags or style tags inside style tags; an unusual occurance.
 99 | 
100 |     ``eg: <script>bla bla<script>bla</script>bla</script>``
101 | 
102 | 2. The minimizer collapses all white space not in a django tag, django variable, javascript, or inline css.  This includes whitespace inside ``<pre>``, ``<textarea>``, and similar tags; and whitespace inside html attributes.
103 | 


--------------------------------------------------------------------------------
/__init__.py:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Charles-Kaminski/django-template-minimizer/6104121ec354ae3d782b1df1384925004d0846d6/__init__.py


--------------------------------------------------------------------------------
/setup.py:
--------------------------------------------------------------------------------
 1 | #!/usr/bin/env python
 2 | from distutils.core import setup
 3 | import codecs
 4 | 
 5 | long_description = codecs.open('README.rst', 'r', 'utf-8').read()
 6 | 
 7 | setup(name='django-template-minimizer',
 8 |       version='0.1.7',
 9 |       description=('Minimize your Django templates so that '
10 |                    'your HTML is served up already minimized.'), 
11 |       long_description=long_description,
12 |       author='Charles Kaminski',
13 |       author_email='CharlesKaminski@gmail.com',
14 |       url='https://github.com/Charles-Kaminski/django-template-minimizer',
15 |       license='MIT',
16 |       py_modules=['tmin.__init__',
17 |                   'tmin.management.__init__',
18 |                   'tmin.management.commands.__init__',
19 |                   'tmin.management.commands.minimizetemplates',
20 |                   'tmin.management.commands._cssmin',
21 |                   'tmin.management.commands._JavascriptMinify',
22 |                   'tmin.management.commands._ManageMinimizers',
23 |                   'tmin.management.commands._SimpleHTMLParser',
24 |                   'tmin.management.commands._TemplateTextMinimizer',],
25 |       classifiers=[
26 |           'Development Status :: 4 - Beta',
27 |           'Environment :: Web Environment',
28 |           'Framework :: Django',
29 |           'Intended Audience :: Developers',
30 |           'License :: OSI Approved :: MIT License',
31 |           'Operating System :: OS Independent',
32 |           'Programming Language :: Python',
33 |           'Programming Language :: Python :: 2.5',
34 |           'Programming Language :: Python :: 2.6',
35 |           'Programming Language :: Python :: 2.7',
36 |           'Topic :: Internet :: WWW/HTTP',
37 |           'Topic :: Internet :: WWW/HTTP :: Dynamic Content',
38 |           'Topic :: Internet :: WWW/HTTP :: WSGI',
39 |           'Topic :: Software Development :: Libraries :: Python Modules',
40 |           'Topic :: Utilities',
41 |       ] 
42 | )


--------------------------------------------------------------------------------
/tmin/__init__.py:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Charles-Kaminski/django-template-minimizer/6104121ec354ae3d782b1df1384925004d0846d6/tmin/__init__.py


--------------------------------------------------------------------------------
/tmin/management/__init__.py:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Charles-Kaminski/django-template-minimizer/6104121ec354ae3d782b1df1384925004d0846d6/tmin/management/__init__.py


--------------------------------------------------------------------------------
/tmin/management/commands/_JavascriptMinify.py:
--------------------------------------------------------------------------------
  1 | import os, os.path, shutil
  2 | 
  3 | # This code is original from jsmin by Douglas Crockford, it was translated to
  4 | # Python by Baruch Even. The original code had the following copyright and
  5 | # license.
  6 | #
  7 | # /* jsmin.c
  8 | #    2007-05-22
  9 | #
 10 | # Copyright (c) 2002 Douglas Crockford  (www.crockford.com)
 11 | #
 12 | # Permission is hereby granted, free of charge, to any person obtaining a copy of
 13 | # this software and associated documentation files (the "Software"), to deal in
 14 | # the Software without restriction, including without limitation the rights to
 15 | # use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies
 16 | # of the Software, and to permit persons to whom the Software is furnished to do
 17 | # so, subject to the following conditions:
 18 | #
 19 | # The above copyright notice and this permission notice shall be included in all
 20 | # copies or substantial portions of the Software.
 21 | #
 22 | # The Software shall be used for Good, not Evil.
 23 | #
 24 | # THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
 25 | # IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
 26 | # FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
 27 | # AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
 28 | # LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
 29 | # OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
 30 | # SOFTWARE.
 31 | # */
 32 | 
 33 | from StringIO import StringIO
 34 | 
 35 | def jsmin(js):
 36 |     ins = StringIO(js)
 37 |     outs = StringIO()
 38 |     JavascriptMinify().minify(ins, outs)
 39 |     str = outs.getvalue()
 40 |     if len(str) > 0 and str[0] == '\n':
 41 |         str = str[1:]
 42 |     return str
 43 | 
 44 | def isAlphanum(c):
 45 |     """return true if the character is a letter, digit, underscore,
 46 |            dollar sign, or non-ASCII character.
 47 |     """
 48 |     return ((c >= 'a' and c <= 'z') or (c >= '0' and c <= '9') or
 49 |             (c >= 'A' and c <= 'Z') or c == '_' or c == '$' or c == '\\' or
 50 |             (c is not None and ord(c) > 126));
 51 | 
 52 | class UnterminatedComment(Exception):
 53 |     pass
 54 | 
 55 | class UnterminatedStringLiteral(Exception):
 56 |     pass
 57 | 
 58 | class UnterminatedRegularExpression(Exception):
 59 |     pass
 60 | 
 61 | class JavascriptMinify(object):
 62 | 
 63 |     def _outA(self):
 64 |         self.outstream.write(self.theA)
 65 |     def _outB(self):
 66 |         self.outstream.write(self.theB)
 67 | 
 68 |     def _get(self):
 69 |         """return the next character from stdin. Watch out for lookahead. If
 70 |            the character is a control character, translate it to a space or
 71 |            linefeed.
 72 |         """
 73 |         c = self.theLookahead
 74 |         self.theLookahead = None
 75 |         if c == None:
 76 |             c = self.instream.read(1)
 77 |         if c >= ' ' or c == '\n':
 78 |             return c
 79 |         if c == '': # EOF
 80 |             return '\000'
 81 |         if c == '\r':
 82 |             return '\n'
 83 |         return ' '
 84 | 
 85 |     def _peek(self):
 86 |         self.theLookahead = self._get()
 87 |         return self.theLookahead
 88 | 
 89 |     def _next(self):
 90 |         """get the next character, excluding comments. peek() is used to see
 91 |            if an unescaped '/' is followed by a '/' or '*'.
 92 |         """
 93 |         c = self._get()
 94 |         if c == '/' and self.theA != '\\':
 95 |             p = self._peek()
 96 |             if p == '/':
 97 |                 c = self._get()
 98 |                 while c > '\n':
 99 |                     c = self._get()
100 |                 return c
101 |             if p == '*':
102 |                 c = self._get()
103 |                 while 1:
104 |                     c = self._get()
105 |                     if c == '*':
106 |                         if self._peek() == '/':
107 |                             self._get()
108 |                             return ' '
109 |                     if c == '\000':
110 |                         raise UnterminatedComment()
111 | 
112 |         return c
113 | 
114 |     def _action(self, action):
115 |         """do something! What you do is determined by the argument:
116 |            1   Output A. Copy B to A. Get the next B.
117 |            2   Copy B to A. Get the next B. (Delete A).
118 |            3   Get the next B. (Delete B).
119 |            action treats a string as a single character. Wow!
120 |            action recognizes a regular expression if it is preceded by
121 |            ( or , or =.
122 |         """
123 |         if action <= 1:
124 |             self._outA()
125 | 
126 |         if action <= 2:
127 |             self.theA = self.theB
128 |             if self.theA == "'" or self.theA == '"':
129 |                 while 1:
130 |                     self._outA()
131 |                     self.theA = self._get()
132 |                     if self.theA == self.theB:
133 |                         break
134 |                     if self.theA <= '\n':
135 |                         raise UnterminatedStringLiteral()
136 |                     if self.theA == '\\':
137 |                         self._outA()
138 |                         self.theA = self._get()
139 | 
140 | 
141 |         if action <= 3:
142 |             self.theB = self._next()
143 |             if self.theB == '/' and (self.theA == '(' or self.theA == ',' or
144 |                                      self.theA == '=' or self.theA == ':' or
145 |                                      self.theA == '[' or self.theA == '?' or
146 |                                      self.theA == '!' or self.theA == '&' or
147 |                                      self.theA == '|' or self.theA == ';' or
148 |                                      self.theA == '{' or self.theA == '}' or
149 |                                      self.theA == '\n'):
150 |                 self._outA()
151 |                 self._outB()
152 |                 while 1:
153 |                     self.theA = self._get()
154 |                     if self.theA == '/':
155 |                         break
156 |                     elif self.theA == '\\':
157 |                         self._outA()
158 |                         self.theA = self._get()
159 |                     elif self.theA <= '\n':
160 |                         raise UnterminatedRegularExpression()
161 |                     self._outA()
162 |                 self.theB = self._next()
163 | 
164 | 
165 |     def _jsmin(self):
166 |         """Copy the input to the output, deleting the characters which are
167 |            insignificant to JavaScript. Comments will be removed. Tabs will be
168 |            replaced with spaces. Carriage returns will be replaced with linefeeds.
169 |            Most spaces and linefeeds will be removed.
170 |         """
171 |         self.theA = '\n'
172 |         self._action(3)
173 | 
174 |         while self.theA != '\000':
175 |             if self.theA == ' ':
176 |                 if isAlphanum(self.theB):
177 |                     self._action(1)
178 |                 else:
179 |                     self._action(2)
180 |             elif self.theA == '\n':
181 |                 if self.theB in ['{', '[', '(', '+', '-']:
182 |                     self._action(1)
183 |                 elif self.theB == ' ':
184 |                     self._action(3)
185 |                 else:
186 |                     if isAlphanum(self.theB):
187 |                         self._action(1)
188 |                     else:
189 |                         self._action(2)
190 |             else:
191 |                 if self.theB == ' ':
192 |                     if isAlphanum(self.theA):
193 |                         self._action(1)
194 |                     else:
195 |                         self._action(3)
196 |                 elif self.theB == '\n':
197 |                     if self.theA in ['}', ']', ')', '+', '-', '"', '\'']:
198 |                         self._action(1)
199 |                     else:
200 |                         if isAlphanum(self.theA):
201 |                             self._action(1)
202 |                         else:
203 |                             self._action(3)
204 |                 else:
205 |                     self._action(1)
206 | 
207 |     def minify(self, instream, outstream):
208 |         self.instream = instream
209 |         self.outstream = outstream
210 |         self.theA = '\n'
211 |         self.theB = None
212 |         self.theLookahead = None
213 | 
214 |         self._jsmin()
215 |         self.instream.close()
216 | 
217 | def compress(in_files, out_file, in_type='js', verbose=False,
218 |              temp_file='.temp'):
219 |     temp = open(temp_file, 'w')
220 |     for f in in_files:
221 |         fh = open(f)
222 |         data = fh.read() + '\n'
223 |         fh.close()
224 | 
225 |         temp.write(data)
226 | 
227 |         print ' + %s' % f
228 |     temp.close()
229 | 
230 |     out = open(out_file, 'w')
231 | 
232 |     jsm = JavascriptMinify()
233 |     jsm.minify(open(temp_file,'r'), out)
234 | 
235 |     out.close()
236 | 
237 |     org_size = os.path.getsize(temp_file)
238 |     new_size = os.path.getsize(out_file)
239 | 
240 |     print '=> %s' % out_file
241 |     print 'Original: %.2f kB' % (org_size / 1024.0)
242 |     print 'Compressed: %.2f kB' % (new_size / 1024.0)
243 |     print 'Reduction: %.1f%%' % (float(org_size - new_size) / org_size * 100)
244 |     print ''
245 | 
246 |     os.remove(temp_file)


--------------------------------------------------------------------------------
/tmin/management/commands/_ManageMinimizers.py:
--------------------------------------------------------------------------------
 1 | """Copyright (c) 2012 Charles Kaminski (CharlesKaminski@gmail.com)
 2 | 
 3 | Permission is hereby granted, free of charge, to any person
 4 | obtaining a copy of this software and associated documentation
 5 | files (the "Software"), to deal in the Software without
 6 | restriction, including without limitation the rights to use,
 7 | copy, modify, merge, publish, distribute, sublicense, and/or sell
 8 | copies of the Software, and to permit persons to whom the
 9 | Software is furnished to do so, subject to the following
10 | conditions:
11 | 
12 | The above copyright notice and this permission notice shall be
13 | included in all copies or substantial portions of the Software.
14 | 
15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
16 | EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
17 | OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
18 | NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT
19 | HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
20 | WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
21 | FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
22 | OTHER DEALINGS IN THE SOFTWARE."""
23 | 
24 | import re
25 | from _JavascriptMinify import jsmin
26 | from _cssmin import cssmin
27 | from django.conf import settings
28 | 
29 | FLAGS  = re.IGNORECASE + re.DOTALL
30 | 
31 | SPACE   = r'(\s+)'
32 | TAGS    = r'(>\s+<)'
33 | 
34 | RE_SPACE   = re.compile(SPACE,   flags=FLAGS)
35 | RE_TAGS    = re.compile(TAGS,    flags=FLAGS)
36 | 
37 | HTMLMIN1 = lambda x: RE_SPACE.sub(' ', x)
38 | HTMLMIN2 = lambda x: RE_TAGS.sub('><', x)
39 | 
40 | 
41 | def get_minimizers():
42 |     """Returns ->
43 |     [jsminimizers_list, cssminimizers_list, htmlminimizers_list]"""
44 | 
45 |     # Initialize
46 |     jsminimizers = [jsmin]
47 |     cssminimizers = [cssmin]
48 |     htmlminimizers = [HTMLMIN1, HTMLMIN2]
49 |     
50 |     if hasattr(settings, 'AGGRESSIVE_HTML_MINIMIZER'):
51 |         aggressive = settings.AGGRESSIVE_HTML_MINIMIZER   
52 |         if not aggressive: htmlminimizers.pop()  
53 | 
54 |     # Get any override settings
55 |     if hasattr(settings, 'JAVASCRIPT_MINIMIZERS'):
56 |         jsminimizers = settings.JAVASCRIPT_MINIMIZERS
57 |     if hasattr(settings, 'CSS_MINIMIZERS'):
58 |         cssminimizers = settings.CSS_MINIMIZERS
59 |     if hasattr(settings, 'HTML_MINIMIZERS'):
60 |         htmlminimizers = settings.HTML_MINIMIZERS
61 | 
62 |     retval = [jsminimizers, cssminimizers, htmlminimizers]
63 | 
64 |     # Check that they are lists or tuples
65 |     for cat in retval:
66 |         if not isinstance(cat, (list, tuple)):
67 |             raise Exception('Minimizers must be enclosed in a list or tuple.\n'
68 |                             'Check your django settings file')
69 |         for f in cat:
70 |             if not callable(f):
71 |                 raise Exception('Minimizers must be callable functions.\n'
72 |                                 'Check your django settings file')
73 | 
74 |     # Convert any tuples into lists
75 |     for cat in retval:
76 |         cat = isinstance(cat, tuple) and list(cat) or cat
77 | 
78 |     return retval


--------------------------------------------------------------------------------
/tmin/management/commands/_SimpleHTMLParser.py:
--------------------------------------------------------------------------------
 1 | """Copyright (c) 2012 Charles Kaminski (CharlesKaminski@gmail.com)
 2 | 
 3 | Permission is hereby granted, free of charge, to any person
 4 | obtaining a copy of this software and associated documentation
 5 | files (the "Software"), to deal in the Software without
 6 | restriction, including without limitation the rights to use,
 7 | copy, modify, merge, publish, distribute, sublicense, and/or sell
 8 | copies of the Software, and to permit persons to whom the
 9 | Software is furnished to do so, subject to the following
10 | conditions:
11 | 
12 | The above copyright notice and this permission notice shall be
13 | included in all copies or substantial portions of the Software.
14 | 
15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
16 | EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
17 | OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
18 | NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT
19 | HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
20 | WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
21 | FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
22 | OTHER DEALINGS IN THE SOFTWARE."""
23 | 
24 | from HTMLParser import HTMLParser
25 | 
26 | def get_first_tag_info(html):
27 |     """ Takes an html snippet and returns:
28 |         (tag, attribute dictionary)
29 |     """
30 |     parser = FirstTagInfo()
31 |     parser.feed(html)
32 |     return (parser.tag, parser.attrs)
33 | 
34 | class FirstTagInfo(HTMLParser):
35 | 
36 |     def __init__(self):
37 |         HTMLParser.__init__(self)
38 |         # For new style classes
39 |         # super(FirstTagInfo, self).__init__()
40 |         self.tag = ''
41 |         self.attrs = {}
42 | 
43 |     def handle_starttag(self, tag, attrs):
44 |         if not self.tag:
45 |             self.tag = tag.lower()
46 |             attrs = [(x.lower(), y and y.lower() or '') for x,y in attrs]
47 |             self.attrs = dict(attrs)
48 | 
49 | if __name__ == '__main__':
50 |     text = ('<scRipt t="bla" t2 = bla t3= \'bla\' t4>cat dog'
51 |                              '<Script>mouse</scriPt>bla</scripT>')
52 |     print text
53 |     print get_first_tag_info(text)
54 | 


--------------------------------------------------------------------------------
/tmin/management/commands/_TemplateTextMinimizer.py:
--------------------------------------------------------------------------------
  1 | """Copyright (c) 2012 Charles Kaminski (CharlesKaminski@gmail.com)
  2 | 
  3 | Permission is hereby granted, free of charge, to any person
  4 | obtaining a copy of this software and associated documentation
  5 | files (the "Software"), to deal in the Software without
  6 | restriction, including without limitation the rights to use,
  7 | copy, modify, merge, publish, distribute, sublicense, and/or sell
  8 | copies of the Software, and to permit persons to whom the
  9 | Software is furnished to do so, subject to the following
 10 | conditions:
 11 | 
 12 | The above copyright notice and this permission notice shall be
 13 | included in all copies or substantial portions of the Software.
 14 | 
 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
 16 | EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
 17 | OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
 18 | NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT
 19 | HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
 20 | WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
 21 | FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
 22 | OTHER DEALINGS IN THE SOFTWARE."""
 23 | 
 24 | import re
 25 | from _SimpleHTMLParser import get_first_tag_info
 26 | from _ManageMinimizers import get_minimizers
 27 | 
 28 | FLAGS  = re.IGNORECASE + re.DOTALL
 29 | 
 30 | EXCLUDE = r'({#\s*NOMINIFY\s*#})(.*?)({#\s*ENDNOMINIFY\s*#})'
 31 | REMOVE  = r'({%\s*COMMENT\s*%})(.*?)({%\s*ENDCOMMENT\s*%})' # Tag Comments
 32 | REMOVE2 = r'({#[^\n\r]+#})' # Other Comments
 33 | DVAR    = r'({{[^\n\r]+}})' # Django variable
 34 | DTAG    = r'({%[^\n\r]+%})' # Django tag
 35 | SCRIPT  = r'(<SCRIPT\b[^>]*>)(.*?)(</SCRIPT>)'
 36 | STYLE   = r'(<STYLE\b[^>]*>)(.*?)(</STYLE>)'
 37 | 
 38 | RE_EXCLUDE = re.compile(EXCLUDE, flags=FLAGS)
 39 | RE_REMOVE  = re.compile(REMOVE,  flags=FLAGS)
 40 | RE_REMOVE2 = re.compile(REMOVE2, flags=FLAGS)
 41 | RE_DVAR    = re.compile(DVAR,    flags=FLAGS)
 42 | RE_DTAG    = re.compile(DTAG,    flags=FLAGS)
 43 | RE_SCRIPT  = re.compile(SCRIPT,  flags=FLAGS)
 44 | RE_STYLE   = re.compile(STYLE,   flags=FLAGS)
 45 | 
 46 | # Will encasing the key in quotes. Will work well with javascript minifiers?
 47 | KEY    = '_~%s~_'
 48 | 
 49 | JSMINIMIZERS, CSSMINIMIZERS, HTMLMINIMIZERS = get_minimizers()
 50 | 
 51 | def minimize_template_text(text):
 52 |     """Takes a Django template text and returns a minified version.
 53 | 
 54 |     Performance is not critical as this function should be run off-line
 55 |     to store minimized templates.
 56 | 
 57 |     This function does not properly handle script or style tags embeded inside
 58 |     themselves; an unusual occurence.
 59 | 
 60 |     EG:
 61 |     <script>bla
 62 |        <script>bla</script>
 63 |     </script>
 64 | 
 65 |     Use the {# NOMINIFY #} {# ENDNOMINIFY #} comment tags to wrap code you do
 66 |     not want minified.  Suggested uses include wrapping pre, code, and textarea
 67 |     html tags as well as the example above.
 68 |     """
 69 | 
 70 |     # Create a list to hold special values temporarily removed
 71 |     # from the text.
 72 |     # format -> [(key, value), ...]
 73 |     word_list = []
 74 | 
 75 |     # Remove Excluded text
 76 |     excludes = RE_EXCLUDE.findall(text)
 77 | 
 78 |     # Strip out the {# NOMINIFY #} and {# ENDNOMINIFY #} tags
 79 |     excludes_find    = [''.join(x) for x in excludes]
 80 |     excludes_replace = [x[1] for x in excludes]
 81 | 
 82 |     # replace excluded text with keys and populate word_list
 83 |     text = subsitute_text(text, word_list, KEY, excludes_find, excludes_replace)
 84 | 
 85 |     # Remove any remaining template comments
 86 |     text = RE_REMOVE.sub('', text)
 87 |     text = RE_REMOVE2.sub('', text)
 88 | 
 89 |     # We want to "protect" Django Vars and Tags
 90 |     # then treat scripts and styles after "protecting" Django Vars and tags
 91 | 
 92 |     # Extract Django Variables
 93 |     dvars = RE_DVAR.findall(text)
 94 | 
 95 |     # replace Django Variables text with keys and populate word_list
 96 |     text = subsitute_text(text, word_list, KEY, dvars)
 97 | 
 98 |     # Extract django tags
 99 |     dtags = RE_DTAG.findall(text)
100 | 
101 |     # replace Django Tags text with keys and populate word_list
102 |     text = subsitute_text(text, word_list, KEY, dtags)
103 | 
104 |     # Extract Styles
105 |     styles  = RE_STYLE.findall(text)
106 | 
107 |     # Minimize syles
108 |     styles_replace = minimize_tag_data(styles) or None
109 | 
110 |     # Put style pieces together
111 |     styles_find = [''.join(x) for x in styles]
112 | 
113 |     # replace styles with keys and populate word_list
114 |     text = subsitute_text(text, word_list, KEY, styles_find, styles_replace)
115 | 
116 |     # Extract Scripts
117 |     scripts = RE_SCRIPT.findall(text)
118 | 
119 |     # Put scripts pieces together
120 |     scripts_find = [''.join(x) for x in scripts]
121 | 
122 |     # Minimize javascripts if requested
123 |     scripts_replace = minimize_tag_data(scripts) or None
124 | 
125 |     # replace scripts with keys and populate word_list
126 |     text = subsitute_text(text, word_list, KEY, scripts_find, scripts_replace)
127 | 
128 |     # Run HTML Minimizers
129 |     for f in HTMLMINIMIZERS: text = f(text)
130 | 
131 |     # put values back into text
132 |     text = revert_text_keys(text, word_list)
133 | 
134 |     return text.strip()
135 | 
136 | def revert_text_keys(text, word_list):
137 |     """ revert the text keys.  We may have to do this multiple times
138 |     as some keys may be embeded in other word_list entries"""
139 |     
140 |     if not text or not word_list: 
141 |         return text
142 | 
143 |     # If we loop through the word_list 10 times without
144 |     #   consuming it completely, then something's probably wrong.
145 | 
146 |     max_iterations = len(word_list) * 10
147 | 
148 |     for x in xrange(max_iterations):
149 | 
150 |         # When the wordlist empties, break the for loop
151 |         if not word_list:
152 |             break
153 | 
154 |         # Take the first entry off the list
155 |         key, value = word_list.pop(0)
156 | 
157 |         if key in text:
158 |             # Replace the key with the value
159 |             text = text.replace(key, value)
160 |         else:
161 |             # Put the entry back at the end of the list
162 |             word_list.append((key, value))
163 |     else:
164 |         # We looped through too many time and
165 |         # never consumed the whole word_list
166 |         raise Exception('Minimizer failed to find all embeded variables.\n'
167 |                         '%s\n%s' % (word_list, text))
168 | 
169 |     return text
170 | 
171 | def subsitute_text(text, word_list, key_template,
172 |                    find_list, substitute_list=None):
173 |     """ Using the text provided, subsitutes the first occurance of each entry
174 |         in find_list with a key.  Store the key and value in the substitute_list
175 |         in the word_list.  If no substitute_list is provided, use the value in
176 |         the find list"""
177 |     if not substitute_list: substitute_list = find_list
178 | 
179 |     values_list = zip(find_list, substitute_list)
180 | 
181 |     for find, substitute in values_list:
182 |         key = key_template % len(word_list)
183 |         text = text.replace(find, key, 1)
184 |         word_list.append((key, substitute))
185 | 
186 |     return text
187 | 
188 | def minimize_tag_data(tags):
189 |     """ This minimizes data in certain tags.
190 |     Currently <script>Javascript</script> and <style>css</style>.
191 |     Function assumes script is javascript if no type is specified.
192 |     Function also assumes style is css if no type is specified.
193 |     """
194 | 
195 |     retval = []
196 | 
197 |     for tag, data, end_tag in tags:
198 | 
199 |         tag_name, attr = get_first_tag_info(tag)
200 |         type_attr = attr.get('type', 'javascript')
201 | 
202 |         if tag_name == 'script':
203 |             type_attr = attr.get('type', 'javascript')
204 |             if 'javascript' in type_attr:
205 |                 for f in JSMINIMIZERS: data = f(data)
206 | 
207 |         if tag_name == 'style':
208 |             type_attr = attr.get('type', 'css')
209 |             if 'css' in type_attr:
210 |                 for f in CSSMINIMIZERS: data = f(data)
211 | 
212 |         retval.append(tag + data + end_tag)
213 | 
214 |     return retval
215 | 
216 | if __name__ == '__main__':
217 |     text = """{% block one %}
218 | {% comment %}
219 | This should be stripped out
220 | {% endcomment %}
221 | {# This comment should be gone as well #}
222 | <Style> bla bla bla </stylE>
223 | <style type="text/css">
224 | h1 {letter-spacing:2px;}
225 | h2 {letter-spacing:-3px;}
226 | p {text-indent:50px;}
227 | </style>
228 | <scrIPT type="Text/javascript">a</Script>
229 | <script language=Javascript>
230 | <!--
231 | var _P="http://www.js-examples.com/data/ex_1004/";
232 | 
233 | function preloadImage(fnImg)
234 | {
235 |     // create array for preloadedImages if not already created:
236 |     if (!document.preloadedImages)
237 |         document.preloadedImages = new Array();
238 |     // create new image:
239 |     document.preloadedImages[fnImg] = new Image();
240 |     document.preloadedImages[fnImg].src = _P+fnImg;
241 | }
242 | 
243 | function imgSwitch(imgId, fnImgNew)
244 | {
245 |     // switch to new image:
246 |     if (document.preloadedImages && document.preloadedImages[fnImgNew])
247 |         document.images[imgId].src = document.preloadedImages[fnImgNew].src;
248 |     else
249 |         document.images[imgId].src = _P+fnImgNew;
250 | }
251 | 
252 | function imgMouseOver(imgId, fnImgOver)
253 | {
254 |     // remember original image:
255 |     document.images[imgId].originalSrc = document.images[imgId].src;
256 |     // switch to mouseover image:
257 |     imgSwitch(imgId, fnImgOver);
258 | }
259 | 
260 | function imgMouseOut(imgId)
261 | {
262 |     // switch back to original image:
263 |     if (document.images[imgId] && document.images[imgId].originalSrc)
264 |         document.images[imgId].src = document[imgId].originalSrc;
265 | }
266 | 
267 | 
268 | var timerID, now;
269 | 
270 | // These values are to store currently-displayed date digits.
271 | // They're initialized to -1 to ensure that all digits are updated in
272 | //   the first call to showTime:
273 | var year10 = -1;
274 | var year1 = -1;
275 | var month10 = -1;
276 | var month1 = -1;
277 | var date10 = -1;
278 | var date1 = -1;
279 | var day = -1;
280 | var hours10 = -1;
281 | var hours1 = -1;
282 | var minutes10 = -1;
283 | var minutes1 = -1;
284 | var seconds10 = -1;
285 | var seconds1 = -1;
286 | 
287 | // updates clock display:
288 | function showTime()
289 | {
290 |     // get digits in date:
291 |     var now = new Date();
292 |     var newYear = now.getYear();
293 |     newYear = newYear % 100;
294 |     var newYear10 = Math.floor(newYear / 10);
295 |     var newYear1 = newYear - (newYear10 * 10);
296 |     var newMonth = now.getMonth();
297 |     newMonth++;
298 |     var newMonth10 = Math.floor(newMonth / 10);
299 |     var newMonth1 = newMonth - (newMonth10 * 10);
300 |     var newDate = now.getDate();
301 |     var newDate10 = Math.floor(newDate / 10);
302 |     var newDate1 = newDate - (newDate10 * 10);
303 |     var newDay = now.getDay();
304 |     var newHours = now.getHours();
305 |     var newHours10 = Math.floor(newHours / 10);
306 |     var newHours1 = newHours - (newHours10 * 10);
307 |     var newMinutes = now.getMinutes();
308 |     var newMinutes10 = Math.floor(newMinutes / 10);
309 |     var newMinutes1 = newMinutes - (newMinutes10 * 10);
310 |     var newSeconds = now.getSeconds();
311 |     var newSeconds10 = Math.floor(newSeconds / 10);
312 |     var newSeconds1 = newSeconds - (newSeconds10 * 10);
313 | 
314 |     // only switch image if date digit has changed:
315 |     if (newYear10 != year10)
316 |     {
317 |         imgSwitch("year10", "images/tinydigit" + newYear10 + ".gif");
318 |         year10 = newYear10;
319 |     }
320 |     if (newYear1 != year1)
321 |     {
322 |         imgSwitch("year1", "images/tinydigit" + newYear1 + ".gif");
323 |         year1 = newYear1;
324 |     }
325 |     if (newMonth10 != month10)
326 |     {
327 |         if (newMonth10 == 0)
328 |             imgSwitch("month10", "images/tinyblank.gif");
329 |         else
330 |             imgSwitch("month10", "images/tinydigit" + newMonth10 + ".gif");
331 |         month10 = newMonth10;
332 |     }
333 |     if (newMonth1 != month1)
334 |     {
335 |         imgSwitch("month1", "images/tinydigit" + newMonth1 + ".gif");
336 |         month1 = newMonth1;
337 |     }
338 |     if (newDate10 != date10)
339 |     {
340 |         imgSwitch("date10", "images/tinydigit" + newDate10 + ".gif");
341 |         date10 = newDate10;
342 |     }
343 |     if (newDate1 != date1)
344 |     {
345 |         imgSwitch("date1", "images/tinydigit" + newDate1 + ".gif");
346 |         date1 = newDate1;
347 |     }
348 |     if (newDay != day)
349 |     {
350 |         imgSwitch("day", "images/day" + newDay + ".gif");
351 |         day = newDay;
352 |     }
353 |     if (newHours10 != hours10)
354 |     {
355 |         imgSwitch("hours10", "images/digit" + newHours10 + ".gif");
356 |         hours10 = newHours10;
357 |     }
358 |     if (newHours1 != hours1)
359 |     {
360 |         imgSwitch("hours1", "images/digit" + newHours1 + ".gif");
361 |         hours1 = newHours1;
362 |     }
363 |     if (newMinutes10 != minutes10)
364 |     {
365 |         imgSwitch("minutes10", "images/digit" + newMinutes10 + ".gif");
366 |         minutes10 = newMinutes10;
367 |     }
368 |     if (newMinutes1 != minutes1)
369 |     {
370 |         imgSwitch("minutes1", "images/digit" + newMinutes1 + ".gif");
371 |         minutes1 = newMinutes1;
372 |     }
373 |     if (newSeconds10 != seconds10)
374 |     {
375 |         imgSwitch("seconds10", "images/smalldigit" + newSeconds10 + ".gif");
376 |         seconds10 = newSeconds10;
377 |     }
378 |     imgSwitch("seconds1", "images/smalldigit" + newSeconds1 + ".gif");
379 | 
380 |     // update clock again in 1 second:
381 |     timerID = setTimeout("showTime()", 1000);
382 | }
383 | 
384 | 
385 | function preloadImages()
386 | {
387 |     for (var i = 0; i <= 9; i++)
388 |     {
389 |         preloadImage("images/digit" + i + ".gif");
390 |         preloadImage("images/smalldigit" + i + ".gif");
391 |         preloadImage("images/tinydigit" + i + ".gif");
392 |     }
393 |     for (i = 0; i <= 6; i++)
394 |         preloadImage("images/day" + i + ".gif");
395 | }
396 | 
397 | // -->
398 | </script>
399 | here \t\t\tcomes        the rain \n\n\nagain <a href='bla'>test</a>
400 | {% block two %}
401 | {{ fun.times|here:"bla" }}
402 | <div>over the rainbow</div>
403 | {#NOMINiFY #} do     not minify     this   . {# ENDNOminify
404 | 
405 | #}
406 | """
407 | 
408 |     a = minimize_template_text(text)
409 |     print text
410 |     print '#' * 10
411 |     print a
412 |     print '#' * 10
413 |     print 'Character length before: %s' % len(text)
414 |     print 'Character length after:  %s' % len(a)
415 | 


--------------------------------------------------------------------------------
/tmin/management/commands/__init__.py:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Charles-Kaminski/django-template-minimizer/6104121ec354ae3d782b1df1384925004d0846d6/tmin/management/commands/__init__.py


--------------------------------------------------------------------------------
/tmin/management/commands/_cssmin.py:
--------------------------------------------------------------------------------
  1 | #!/usr/bin/env python
  2 | # -*- coding: utf-8 -*-
  3 | 
  4 | """`cssmin` - A Python port of the YUI CSS compressor.
  5 | 
  6 | http://pypi.python.org/pypi/cssmin/
  7 | 
  8 | `cssmin.py` - A Python port of the YUI CSS compressor.
  9 | 
 10 | Copyright (c) 2010 Zachary Voase
 11 | 
 12 | Permission is hereby granted, free of charge, to any person
 13 | obtaining a copy of this software and associated documentation
 14 | files (the "Software"), to deal in the Software without
 15 | restriction, including without limitation the rights to use,
 16 | copy, modify, merge, publish, distribute, sublicense, and/or sell
 17 | copies of the Software, and to permit persons to whom the
 18 | Software is furnished to do so, subject to the following
 19 | conditions:
 20 | 
 21 | The above copyright notice and this permission notice shall be
 22 | included in all copies or substantial portions of the Software.
 23 | 
 24 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
 25 | EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
 26 | OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
 27 | NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT
 28 | HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
 29 | WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
 30 | FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
 31 | OTHER DEALINGS IN THE SOFTWARE.
 32 | 
 33 | -------------------------------------------------------------------------------
 34 | 
 35 | This software contains portions of the YUI CSS Compressor, notably some regular
 36 | expressions for reducing the size of CSS. The YUI Compressor source code can be
 37 | found at <http://github.com/yui/yuicompressor>, and is licensed as follows:
 38 | 
 39 | > YUI Compressor Copyright License Agreement (BSD License)
 40 | >
 41 | > Copyright (c) 2009, Yahoo! Inc.
 42 | > All rights reserved.
 43 | >
 44 | > Redistribution and use of this software in source and binary forms,
 45 | > with or without modification, are permitted provided that the following
 46 | > conditions are met:
 47 | >
 48 | > * Redistributions of source code must retain the above
 49 | >   copyright notice, this list of conditions and the
 50 | >   following disclaimer.
 51 | >
 52 | > * Redistributions in binary form must reproduce the above
 53 | >   copyright notice, this list of conditions and the
 54 | >   following disclaimer in the documentation and/or other
 55 | >   materials provided with the distribution.
 56 | >
 57 | > * Neither the name of Yahoo! Inc. nor the names of its
 58 | >   contributors may be used to endorse or promote products
 59 | >   derived from this software without specific prior
 60 | >   written permission of Yahoo! Inc.
 61 | >
 62 | > THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
 63 | > AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
 64 | > IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
 65 | > DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE
 66 | > FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
 67 | > DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
 68 | > SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
 69 | > CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
 70 | > OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
 71 | > OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
 72 | 
 73 | """
 74 | 
 75 | 
 76 | from StringIO import StringIO # The pure-Python StringIO supports unicode.
 77 | import re
 78 | 
 79 | 
 80 | __version__ = '0.1.4'
 81 | 
 82 | 
 83 | def remove_comments(css):
 84 |     """Remove all CSS comment blocks."""
 85 | 
 86 |     iemac = False
 87 |     preserve = False
 88 |     comment_start = css.find("/*")
 89 |     while comment_start >= 0:
 90 |         # Preserve comments that look like `/*!...*/`.
 91 |         # Slicing is used to make sure we don"t get an IndexError.
 92 |         preserve = css[comment_start + 2:comment_start + 3] == "!"
 93 | 
 94 |         comment_end = css.find("*/", comment_start + 2)
 95 |         if comment_end < 0:
 96 |             if not preserve:
 97 |                 css = css[:comment_start]
 98 |                 break
 99 |         elif comment_end >= (comment_start + 2):
100 |             if css[comment_end - 1] == "\\":
101 |                 # This is an IE Mac-specific comment; leave this one and the
102 |                 # following one alone.
103 |                 comment_start = comment_end + 2
104 |                 iemac = True
105 |             elif iemac:
106 |                 comment_start = comment_end + 2
107 |                 iemac = False
108 |             elif not preserve:
109 |                 css = css[:comment_start] + css[comment_end + 2:]
110 |             else:
111 |                 comment_start = comment_end + 2
112 |         comment_start = css.find("/*", comment_start)
113 | 
114 |     return css
115 | 
116 | 
117 | def remove_unnecessary_whitespace(css):
118 |     """Remove unnecessary whitespace characters."""
119 | 
120 |     def pseudoclasscolon(css):
121 | 
122 |         """
123 |         Prevents 'p :link' from becoming 'p:link'.
124 | 
125 |         Translates 'p :link' into 'p ___PSEUDOCLASSCOLON___link'; this is
126 |         translated back again later.
127 |         """
128 | 
129 |         regex = re.compile(r"(^|\})(([^\{\:])+\:)+([^\{]*\{)")
130 |         match = regex.search(css)
131 |         while match:
132 |             css = ''.join([
133 |                 css[:match.start()],
134 |                 match.group().replace(":", "___PSEUDOCLASSCOLON___"),
135 |                 css[match.end():]])
136 |             match = regex.search(css)
137 |         return css
138 | 
139 |     css = pseudoclasscolon(css)
140 |     # Remove spaces from before things.
141 |     css = re.sub(r"\s+([!{};:>+\(\)\],])", r"\1", css)
142 | 
143 |     # If there is a `@charset`, then only allow one, and move to the beginning.
144 |     css = re.sub(r"^(.*)(@charset \"[^\"]*\";)", r"\2\1", css)
145 |     css = re.sub(r"^(\s*@charset [^;]+;\s*)+", r"\1", css)
146 | 
147 |     # Put the space back in for a few cases, such as `@media screen` and
148 |     # `(-webkit-min-device-pixel-ratio:0)`.
149 |     css = re.sub(r"\band\(", "and (", css)
150 | 
151 |     # Put the colons back.
152 |     css = css.replace('___PSEUDOCLASSCOLON___', ':')
153 | 
154 |     # Remove spaces from after things.
155 |     css = re.sub(r"([!{}:;>+\(\[,])\s+", r"\1", css)
156 | 
157 |     return css
158 | 
159 | 
160 | def remove_unnecessary_semicolons(css):
161 |     """Remove unnecessary semicolons."""
162 | 
163 |     return re.sub(r";+\}", "}", css)
164 | 
165 | 
166 | def remove_empty_rules(css):
167 |     """Remove empty rules."""
168 | 
169 |     return re.sub(r"[^\}\{]+\{\}", "", css)
170 | 
171 | 
172 | def normalize_rgb_colors_to_hex(css):
173 |     """Convert `rgb(51,102,153)` to `#336699`."""
174 | 
175 |     regex = re.compile(r"rgb\s*\(\s*([0-9,\s]+)\s*\)")
176 |     match = regex.search(css)
177 |     while match:
178 |         colors = map(lambda s: s.strip(), match.group(1).split(","))
179 |         hexcolor = '#%.2x%.2x%.2x' % tuple(map(int, colors))
180 |         css = css.replace(match.group(), hexcolor)
181 |         match = regex.search(css)
182 |     return css
183 | 
184 | 
185 | def condense_zero_units(css):
186 |     """Replace `0(px, em, %, etc)` with `0`."""
187 | 
188 |     return re.sub(r"([\s:])(0)(px|em|%|in|cm|mm|pc|pt|ex)", r"\1\2", css)
189 | 
190 | 
191 | def condense_multidimensional_zeros(css):
192 |     """Replace `:0 0 0 0;`, `:0 0 0;` etc. with `:0;`."""
193 | 
194 |     css = css.replace(":0 0 0 0;", ":0;")
195 |     css = css.replace(":0 0 0;", ":0;")
196 |     css = css.replace(":0 0;", ":0;")
197 | 
198 |     # Revert `background-position:0;` to the valid `background-position:0 0;`.
199 |     css = css.replace("background-position:0;", "background-position:0 0;")
200 | 
201 |     return css
202 | 
203 | 
204 | def condense_floating_points(css):
205 |     """Replace `0.6` with `.6` where possible."""
206 | 
207 |     return re.sub(r"(:|\s)0+\.(\d+)", r"\1.\2", css)
208 | 
209 | 
210 | def condense_hex_colors(css):
211 |     """Shorten colors from #AABBCC to #ABC where possible."""
212 | 
213 |     regex = re.compile(r"([^\"'=\s])(\s*)#([0-9a-fA-F])([0-9a-fA-F])([0-9a-fA-F])([0-9a-fA-F])([0-9a-fA-F])([0-9a-fA-F])")
214 |     match = regex.search(css)
215 |     while match:
216 |         first = match.group(3) + match.group(5) + match.group(7)
217 |         second = match.group(4) + match.group(6) + match.group(8)
218 |         if first.lower() == second.lower():
219 |             css = css.replace(match.group(), match.group(1) + match.group(2) + '#' + first)
220 |             match = regex.search(css, match.end() - 3)
221 |         else:
222 |             match = regex.search(css, match.end())
223 |     return css
224 | 
225 | 
226 | def condense_whitespace(css):
227 |     """Condense multiple adjacent whitespace characters into one."""
228 | 
229 |     return re.sub(r"\s+", " ", css)
230 | 
231 | 
232 | def condense_semicolons(css):
233 |     """Condense multiple adjacent semicolon characters into one."""
234 | 
235 |     return re.sub(r";;+", ";", css)
236 | 
237 | 
238 | def wrap_css_lines(css, line_length):
239 |     """Wrap the lines of the given CSS to an approximate length."""
240 | 
241 |     lines = []
242 |     line_start = 0
243 |     for i, char in enumerate(css):
244 |         # It's safe to break after `}` characters.
245 |         if char == '}' and (i - line_start >= line_length):
246 |             lines.append(css[line_start:i + 1])
247 |             line_start = i + 1
248 | 
249 |     if line_start < len(css):
250 |         lines.append(css[line_start:])
251 |     return '\n'.join(lines)
252 | 
253 | 
254 | def cssmin(css, wrap=None):
255 |     css = remove_comments(css)
256 |     css = condense_whitespace(css)
257 |     # A pseudo class for the Box Model Hack
258 |     # (see http://tantek.com/CSS/Examples/boxmodelhack.html)
259 |     css = css.replace('"\\"}\\""', "___PSEUDOCLASSBMH___")
260 |     css = remove_unnecessary_whitespace(css)
261 |     css = remove_unnecessary_semicolons(css)
262 |     css = condense_zero_units(css)
263 |     css = condense_multidimensional_zeros(css)
264 |     css = condense_floating_points(css)
265 |     css = normalize_rgb_colors_to_hex(css)
266 |     css = condense_hex_colors(css)
267 |     if wrap is not None:
268 |         css = wrap_css_lines(css, wrap)
269 |     css = css.replace("___PSEUDOCLASSBMH___", '"\\"}\\""')
270 |     css = condense_semicolons(css)
271 |     return css.strip()
272 | 
273 | 
274 | def main():
275 |     import optparse
276 |     import sys
277 | 
278 |     p = optparse.OptionParser(
279 |         prog="cssmin", version=__version__,
280 |         usage="%prog [--wrap N]",
281 |         description="""Reads raw CSS from stdin, and writes compressed CSS to stdout.""")
282 | 
283 |     p.add_option(
284 |         '-w', '--wrap', type='int', default=None, metavar='N',
285 |         help="Wrap output to approximately N chars per line.")
286 | 
287 |     options, args = p.parse_args()
288 |     sys.stdout.write(cssmin(sys.stdin.read(), wrap=options.wrap))
289 | 
290 | 
291 | if __name__ == '__main__':
292 |     main()
293 | 


--------------------------------------------------------------------------------
/tmin/management/commands/minimizetemplates.py:
--------------------------------------------------------------------------------
  1 | """Copyright (c) 2012 Charles Kaminski (CharlesKaminski@gmail.com)
  2 | 
  3 | Permission is hereby granted, free of charge, to any person
  4 | obtaining a copy of this software and associated documentation
  5 | files (the "Software"), to deal in the Software without
  6 | restriction, including without limitation the rights to use,
  7 | copy, modify, merge, publish, distribute, sublicense, and/or sell
  8 | copies of the Software, and to permit persons to whom the
  9 | Software is furnished to do so, subject to the following
 10 | conditions:
 11 | 
 12 | The above copyright notice and this permission notice shall be
 13 | included in all copies or substantial portions of the Software.
 14 | 
 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
 16 | EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
 17 | OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
 18 | NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT
 19 | HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
 20 | WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
 21 | FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
 22 | OTHER DEALINGS IN THE SOFTWARE."""
 23 | 
 24 | from django.core.management.base import BaseCommand, CommandError
 25 | from django.conf import settings
 26 | from os import getcwd, sep, walk, makedirs
 27 | from os.path import join, exists, basename, dirname
 28 | from shutil import move, rmtree
 29 | from optparse import make_option
 30 | from _TemplateTextMinimizer import minimize_template_text
 31 | 
 32 | ARCHIVE = '_minimizer_archive'
 33 | REVERTED = '_reverted_'
 34 | ARCHIVE_EXISTS = ('A minimizer archive folder already exists.\n'
 35 |                   'Check that the following templates are not already '
 36 |                   'minimized: \n%s')
 37 | ARCHIVE_DOESNT_EXIST = ("The below archive folder doesn't exist.\n"
 38 |                         "Check that you shouldn't be reverting the "
 39 |                         "coresponding folder: \n%s")
 40 | 
 41 | class Command(BaseCommand):
 42 |     help = '''Use this tool to minimize Django templates after
 43 | development.  This way, your templates are small when they are
 44 | evaluated and the HTML served is already minimized; eliminiating
 45 | any post-processing minimization step.  The command can be undone
 46 | using the -u option.
 47 | 
 48 | Use the comment tags {# NOMINIFY #} {# ENDNOMINIFY #} to wrap
 49 | content you do not want minified.
 50 | 
 51 | Uses the setting TEMPLATE_DIRS in your Django settings file to
 52 |     tell the command where to find templates to minimize.
 53 | 
 54 | Customization:
 55 | The minimizer command uses its own minimizers for html, style tag embeded
 56 |     css, and script tag embeded javascript. You can override these and chain
 57 |     any number of your own minimizers using settings below.  These
 58 |     settings go in the Django settings file. Custom minimizers must
 59 |     be functions that accept text as a string parameter and return
 60 |     text as a string.
 61 |     JAVASCRIPT_MINIMIZERS = [custom_function1, custom_function2,]
 62 |     CSS_MINIMIZERS        = [custom_function3, custom_function4,]
 63 |     HTML_MINIMIZERS       = [custom_function5, custom_function6,]
 64 | 
 65 |     To turn off a minimizer, use the following pattern:
 66 |     f = lambda x: x
 67 |     JAVASCRIPT_MINIMIZER = [f,]
 68 | 
 69 | You can tell the minimizer command to disable an aggressive minimizer 
 70 |     in the default HTML minimizer chain.  This minimizer normally removes 
 71 |     (instead of just collapsing) the remaining space between '>' & '<' 
 72 |     character.  Set the following setting to False in your Django
 73 |     settings file to disable this final step:
 74 |     AGGRESSIVE_HTML_MINIMIZER = False
 75 | 
 76 | Method - For each template, the minimizer command:
 77 | 1. Replaces any {# NOMINIFY #} {# ENDNOMINIFY #} content with
 78 |     a unique identifier and saves the content in memory so that
 79 |     it is excluded from the rest of the process.
 80 | 2. Remaining Django comments are removed.
 81 | 3. Django tags and django variables are replaced with with unique
 82 |     identifiers.  The tags and variables are saved in memory.
 83 |     This approach "protects" the tags and variables from the
 84 |     minimizers.  It also allows you to use Django tags and variables
 85 |     inside your javascript and CSS without ill effect by the
 86 |     CSS or javascript minimizer.
 87 | 4. HTML script tags and content are replaced with unique
 88 |     identifiers. The tags and content are saved in memory for
 89 |     additional processing.  The type attribute for the script tag
 90 |     is checked to see if the script content is javascript.  If no
 91 |     type is provided, then javascript is assumed.  Any javascript
 92 |     is then run through the javascript minimizers.
 93 | 5. An almost identical process to step 4 is implemented on the HTML
 94 |     style tags for css.
 95 | 6. The remaining text (with the identifiers) is run through the
 96 |     html minimizers.
 97 | 7. All of the content saved in memory and associated with unique
 98 |     identifiers are put back.
 99 | 8. The original template is moved to an archive folder and replaced
100 |     with the minimized template.
101 | 
102 | Limitations:
103 | The minimizer does not handle script tags inside script tags or
104 |     style tags inside style tags; an unusual occurance.
105 |     eg: <script>bla bla <script> bla</script></script>
106 | The minimizer collapses all white space not in a django tag,
107 |     django variable, javascript, or inline css.  This includes
108 |     whitespace inside <pre>, <textarea>, & similar tags, and
109 |     whitespace inside html attributes.
110 | Use the {# NOMINIFY #} {# ENDNOMINIFY #} comment tags to overcome
111 |     these limiations.
112 |     
113 | '''
114 | 
115 |     option_list = BaseCommand.option_list + (
116 |         make_option('-m', '--minimize',
117 |                     action='store_true', dest='minimize', default=False,
118 |                     help='Minimize templates.'),
119 |         make_option('-u', '--undo',
120 |                     action='store_true', dest='undo', default=False,
121 |                     help='Reverts minimized templates from the archive.'),)
122 | 
123 |     def handle(self, *args, **options):
124 | 
125 |         # Reading template location from settings
126 |         try:
127 |             dirs = settings.TEMPLATE_DIRS
128 |         except AttributeError:
129 |             raise CommandError('You must specify TEMPLATE_DIRS in your '
130 |                                'settings file.')
131 | 
132 |         # Get the full and proper paths
133 |         cwd = getcwd()
134 |         dirs = [x.replace('/', sep).rstrip(sep) for x in dirs]
135 |         dirs = [join(cwd,x) for x in dirs]
136 | 
137 |         if options['undo']:
138 |             self.revert(dirs)
139 |             self.stdout.write('Successfully reverted minimized Templates:\n')
140 |             for d in dirs:
141 |                 self.stdout.write('%s\n' % d)
142 |             return 0
143 |         elif options['minimize']:
144 |             self.minimize_templates(dirs)
145 |             self.stdout.write('Successfully minimized Templates:\n')
146 |             for d in dirs:
147 |                 self.stdout.write('%s\n' % d)
148 |             return 0
149 |         else:
150 |             command_name = basename(__file__).rstrip('.py')
151 |             self.print_help(command_name, '')
152 | 
153 |     def minimize_templates(self, dirs):
154 | 
155 |         # Check that the archive folders don't already exist
156 |         for d in dirs:
157 |             if exists(join(d, ARCHIVE)):
158 |                 raise CommandError(ARCHIVE_EXISTS % d)
159 | 
160 |         paths = []
161 |         # Walk the directories to build a list of files to minimize
162 |         # Currently not following symbolic links
163 |         for d in dirs:
164 |             archive_dir = join(d, ARCHIVE)
165 |             for root, walk_dirs, files in walk(d):
166 |                 reverted_dirs = [x for x in walk_dirs if x.startswith(REVERTED)]
167 |                 for reverted_dir in reverted_dirs:
168 |                     walk_dirs.remove(reverted_dir)  
169 |                 for name in files:
170 |                     if not name.split('.')[-1] in ('.py', '.pyc'):
171 |                         path= join(root,name)
172 |                         paths.append([path, path.replace(d, archive_dir)])
173 | 
174 |         # Minimize the files
175 |         num_files, before, after = 0, 0, 0
176 |         for source_path, archive_path in paths:
177 |             original = ''.join(open(source_path).readlines())
178 |             minimized = minimize_template_text(original)
179 | 
180 |             num_files = num_files + 1
181 |             before = before + len(original)
182 |             after = after + len(minimized)
183 | 
184 |             d = dirname(archive_path)
185 |             if not exists(d):
186 |                 makedirs(d)
187 |             move(source_path, archive_path)
188 |             open(source_path, 'wb').write(minimized)
189 | 
190 |         print 'Files:    %s' % num_files
191 |         print 'Before:   %s' % before
192 |         print 'After:    %s' % after
193 |         print "Decrease: {0:.0%}".format((before - after) / float(before))
194 | 
195 |     def revert(self, dirs):
196 |         # Put together Archive dirs
197 |         # Check  the archive folders do exist
198 |         archive_dirs = []
199 |         for d in dirs:
200 |             archive_dir = join(d, ARCHIVE)
201 |             archive_dirs.append(archive_dir)
202 |             if not exists(archive_dir):
203 |                 raise CommandError(ARCHIVE_DOESNT_EXIST % archive_dir)
204 | 
205 |         # Put together reverted dirs
206 |         reverted_dirs = []
207 |         for d in dirs:
208 |             i = 1
209 |             while exists(join(d, REVERTED + str(i))):
210 |                 i = i + 1
211 |             reverted_dirs.append(join(d, REVERTED + str(i)))
212 | 
213 |         # zip everything up
214 |         all_dirs = zip(archive_dirs, dirs, reverted_dirs)
215 | 
216 |         # Walk the directories and put together paths
217 |         paths = []
218 |         for archive_dir, d, reverted_dir in all_dirs:
219 |             for root, walk_dirs, files in walk(archive_dir):
220 |                 reverted_dirs = [x for x in walk_dirs if x.startswith(REVERTED)]
221 |                 for reverted_dir in reverted_dirs:
222 |                     walk_dirs.remove(reverted_dir)                
223 |                 for archive_name in files:
224 |                     # Collect all the paths
225 |                     archive_path = join(root, archive_name)
226 |                     path = archive_path.replace(archive_dir, d)
227 |                     reverted_path = archive_path.replace(archive_dir,
228 |                                                          reverted_dir)
229 |                     paths.append([archive_path, path, reverted_path])
230 | 
231 |         # Make the moves
232 |         for archive_path, path, reverted_path in paths:
233 |             # Create the directories
234 |             d = dirname(path)
235 |             if not exists(d): makedirs(d)
236 |             d = dirname(reverted_path)
237 |             if not exists(d): makedirs(d)
238 | 
239 |             move(path, reverted_path)
240 |             move(archive_path, path)
241 | 
242 |         # Delete the archive folder
243 |         for d in archive_dirs:
244 |             rmtree(d)
245 | 


--------------------------------------------------------------------------------