Bug#809211: tracker.debian.org: sqlite backend not usable

[Christophe Siraut <d@tobald.eu.org>]

Package: tracker.debian.org
Severity: normal

I am trying to run tracker configured with debian repositories using the sqlite
backend, but several tasks are giving:

  OperationalError: too many columns in result set

Tasks that are frequently failing:

  UpdateRepositoriesTask
  UpdatePackageBugStats
  UpdateLintianStatsTask
  UpdateExcusesTask
  UpdateBuildLogCheckStats
  DebianWatchFileScannerUpdate
  UpdateSecurityIssuesTask
  UpdateUbuntuStatsTask
  UpdateWnppStatsTask

I have tried the following with little success:

  Use a small subset of repositories
  Recompile libsqlite with #define SQLITE_MAX_COLUMN 32767
  Hack the querysets like http://stackoverflow.com/questions/7106016/too-many-sql-variables-error-in-django-witih-sqlite3

I think sqlite does not scale and we should not recommend it, in the setting files:

  # If you want to run a development setup close to what's running on
  # tracker.debian.org, then uncomment the next two lines.
  from .debian import *
- from .db_sqlite import DATABASES
+ from .db_postgresql import DATABASES

and remove db_sqlite.py.

Note we have a warning in the documentation:

  Distro Tracker does not rely on any database specific features and as such should be
  able to run on top of any database server. The only possible known issue is when
  using sqlite3 which has a limit on the number of query parameters of 999 on
  some systems.
    
Cheers,
Christophe