Bug#657405: installing on wheezy
Here is my take on installing on wheezy (some issues might, and some
might not, apply to jessie too). It is based on my try to compile package from:
http://mentors.debian.net/debian/pool/main/m/mediagoblin/mediagoblin_0.6.1-1.dsc
(it just looks long, fixes are mostly few things we should put "Depends:"
on, documentation update suggestions and other minor fixes..
that is up to the last step where it fails to start completely, but
that is likely due to my trying it on wheezy instead of jessie)
python-bcrypt and python-itsdangerous on which mediagoblin depends
are not present in wheezy, so I copied/recompiled them from jessie.
After that, package compiled and installed without problems. So
I'd say "installing part" is ready for jessie!
Then I proceeded following instructions for manual configuration in
/usr/share/doc/mediagoblin/README.Debian.gz - here are few issues (on
wheezy):
- "sudo -u postgres createdb -E UNICODE -O mediagoblin mediagoblin"
complains with:
"createdb: database creation failed: ERROR: new encoding (UTF8) is
incompatible with the encoding of the template database (SQL_ASCII)
HINT: Use the same encoding as in the template database, or use
template0 as template."
So I did: "sudo -u postgres createdb -E UNICODE -T template0 -O mediagoblin mediagoblin"
which didn't complain. Hopefully it did the right thing :)
- "su - [mediagoblin]"
there is no user mediagoblin (maybe it should be created in some step before?
or package should autocreate it in postinst? it is not mentioned) and I don't
think square brackets are supposed to be there.
So I did: "useradd --system --home-dir /usr/share/mediagoblin mediagoblin"
and "su - mediagoblin"
- "Copy /usr/share/mediagoblin/mediagoblin/mediagoblin.ini to /etc/mediagoblin_local.ini"
well, there wasn't mediagoblin.ini in package at all. Should be fixed.
So I copied it from source tarball from which I built package.
And, it didn't work as mediagoblin user (from su(1) in step before), so I did as root:
"cp /home/mnalis/mediagoblin/mediagoblin-0.6.1/mediagoblin.ini /etc/mediagoblin_local.ini"
"$EDITOR /etc/mediagoblin_local.ini"
"chown root.mediagoblin /etc/mediagoblin_local.ini"
"chmod 640 /etc/mediagoblin_local.ini"
- "$ /usr/bin/gmg dbupdate"
It failed for me:
Traceback (most recent call last):
File "/usr/bin/gmg", line 5, in <module>
exit(main_cli())
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/__init__.py", line 96, in main_cli
setup_func = import_component(command_struct['setup'])
File "/usr/share/mediagoblin/mediagoblin/tools/common.py", line 34, in import_component
__import__(module_name)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/reprocess.py", line 20, in <module>
from mediagoblin.db.models import MediaEntry
File "/usr/share/mediagoblin/mediagoblin/db/models.py", line 27, in <module>
from sqlalchemy.orm import relationship, backref, with_polymorphic
ImportError: cannot import name with_polymorphic
It seems that "with_polymorphic()" is introduced in sqlalchemy.org 0.8
release, so we should fix depends version in package to be at least that.
So I upgraded to python-sqlalchemy_0.9.7-1_all.deb from Jessie
that failed with:
$ /usr/bin/gmg dbupdate
Traceback (most recent call last):
File "/usr/bin/gmg", line 5, in <module>
exit(main_cli())
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/__init__.py", line 96, in main_cli
setup_func = import_component(command_struct['setup'])
File "/usr/share/mediagoblin/mediagoblin/tools/common.py", line 34, in import_component
__import__(module_name)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/reprocess.py", line 20, in <module>
from mediagoblin.db.models import MediaEntry
File "/usr/share/mediagoblin/mediagoblin/db/models.py", line 36, in <module>
from mediagoblin.db.mixin import UserMixin, MediaEntryMixin, \
File "/usr/share/mediagoblin/mediagoblin/db/mixin.py", line 40, in <module>
from mediagoblin.tools.text import cleaned_markdown_conversion
File "/usr/share/mediagoblin/mediagoblin/tools/text.py", line 19, in <module>
from lxml.html.clean import Cleaner
ImportError: No module named lxml.html.clean
So I installed "python-lxml" packege from wheezy-backports (which
wanted to downgrade python-sqlalchemy, but worked around it). So we
need to depend on it.
that failed with:
$ /usr/bin/gmg dbupdate
Traceback (most recent call last):
File "/usr/bin/gmg", line 5, in <module>
exit(main_cli())
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/__init__.py", line 96, in main_cli
setup_func = import_component(command_struct['setup'])
File "/usr/share/mediagoblin/mediagoblin/tools/common.py", line 34, in import_component
__import__(module_name)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/reprocess.py", line 21, in <module>
from mediagoblin.gmg_commands import util as commands_util
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/util.py", line 18, in <module>
from mediagoblin import app
File "/usr/share/mediagoblin/mediagoblin/app.py", line 28, in <module>
from mediagoblin.tools import common, session, translate, template
File "/usr/share/mediagoblin/mediagoblin/tools/template.py", line 31, in <module>
from mediagoblin.tools.timesince import timesince
File "/usr/share/mediagoblin/mediagoblin/tools/timesince.py", line 32, in <module>
import pytz
ImportError: No module named pytz
So I installed "python-tz" (we need to depend on that too)
that failed with:
$ /usr/bin/gmg dbupdate
Traceback (most recent call last):
File "/usr/bin/gmg", line 5, in <module>
exit(main_cli())
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/__init__.py", line 96, in main_cli
setup_func = import_component(command_struct['setup'])
File "/usr/share/mediagoblin/mediagoblin/tools/common.py", line 34, in import_component
__import__(module_name)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/reprocess.py", line 22, in <module>
from mediagoblin.submit.lib import run_process_media
File "/usr/share/mediagoblin/mediagoblin/submit/lib.py", line 28, in <module>
from mediagoblin.processing.task import ProcessMedia
File "/usr/share/mediagoblin/mediagoblin/processing/task.py", line 34, in <module>
@celery.task(default_retry_delay=2 * 60)
AttributeError: 'module' object has no attribute 'task'
Ok, it seems python-celery 2.5.3-4 in wheezy is too old. We should
depend on newer version. Don't know which exactly, but 3.1.12-1
from jessie seems ok, so I got that (and its few dependencies)
that failed with:
$ /usr/bin/gmg dbupdate
Traceback (most recent call last):
File "/usr/bin/gmg", line 5, in <module>
exit(main_cli())
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/__init__.py", line 112, in main_cli
args.func(args)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/dbupdate.py", line 146, in dbupdate
run_dbupdate(app_config, global_config)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/dbupdate.py", line 119, in run_dbupdate
run_all_migrations(db, app_config, global_config)
File "/usr/share/mediagoblin/mediagoblin/gmg_commands/dbupdate.py", line 141, in run_all_migrations
migration_manager.init_or_migrate()
File "/usr/share/mediagoblin/mediagoblin/db/migration_tools.py", line 201, in init_or_migrate
assure_migrations_table_setup(self.session)
File "/usr/share/mediagoblin/mediagoblin/db/migration_tools.py", line 281, in assure_migrations_table_setup
if not MigrationData.__table__.exists(db.bind):
File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/schema.py", line 638, in exists
self.name, schema=self.schema)
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1732, in run_callable
with self.contextual_connect() as conn:
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1799, in contextual_connect
self.pool.connect(),
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 338, in connect
return _ConnectionFairy._checkout(self)
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 641, in _checkout
fairy = _ConnectionRecord.checkout(pool)
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 440, in checkout
rec = pool._do_get()
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1055, in _do_get
return self._create_connection()
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 285, in _create_connection
return _ConnectionRecord(self)
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 411, in __init__
self.connection = self.__connect()
File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 537, in __connect
connection = self.__pool._creator()
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line 96, in connect
connection_invalidated=invalidated
File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb)
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line 90, in connect
return dialect.connect(*cargs, **cparams)
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 377, in connect
return self.dbapi.connect(*cargs, **cparams)
sqlalchemy.exc.OperationalError: (OperationalError) unable to open database file None None
some stracing reveals that only looks for mediagoblin_local.ini in current directory.
so I kludge it with a symlink: "ln -s /etc/mediagoblin_local.ini ~mediagoblin/"
So probably "/etc/" path got lost somewhere. Should be checked.
anyway, it finally worked, albeit with a warning:
$ /usr/bin/gmg dbupdate
WARNING:mediagoblin.init.config:When setting up config section, could not import 'mediagoblin.media_types.image'
-> Initializing main mediagoblin tables... done.
+ Laying foundations for Privilege table
- "server_name mg.example.com www.mg.example.com" in nginx example config
is missing ";" at the end of the line
- starting up mediagoblin fails however with:
$ PYTHONPATH=/usr/share/mediagoblin/ CELERY_ALWAYS_EAGER=false\
/usr/bin/paster serve /usr/share/mediagoblin/mediagoblin/paste_local.ini\
--pid-file=/home/mediagoblin/mediagoblin.pid --server-name=fcgi\
fcgi_host=127.0.0.1 fcgi_port=26543
Traceback (most recent call last):
File "/usr/bin/paster", line 4, in <module>
command.run()
File "/usr/lib/python2.7/dist-packages/paste/script/command.py", line 93, in run
commands = get_commands()
File "/usr/lib/python2.7/dist-packages/paste/script/command.py", line 135, in get_commands
plugins = pluginlib.resolve_plugins(plugins)
File "/usr/lib/python2.7/dist-packages/paste/script/pluginlib.py", line 82, in resolve_plugins
pkg_resources.require(plugin)
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 686, in require
needed = self.resolve(parse_requirements(requirements))
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 584, in resolve
raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: Not Found: mediagoblin-0.6.1 (did you run python setup.py develop?)
Now, that might be due to mixing packages from various Debian versions. Oh well :(
I lack enough working knowledge of python to go past that point ATM.
Someone with jessie should try to build and run it and see how that fares
(should be much easier than above, as all packages would pull correct dependencies)
And maintainer (hopefully :) should fix that few minor (but
important) issues, add that few "depends" on packages (and
versions) and update/clear docs as suggested (or better :).
Cheers and I hope it will be published soon so more testing can be
done (and installation procedure automated as much as possible)
--
Opinions above are GNU-copylefted.
Reply to: