Re: rewrite of UDD importers runner
On 18/08/15 at 15:31 +0200, Andreas Tille wrote:
> Hi Lucas,
>
> On Sun, Aug 16, 2015 at 11:50:38PM +0200, Lucas Nussbaum wrote:
> > I changed the way UDD importers are executed.
> >
> > Previously, they were executed via cron.
> >
> > Now, there's a small cron-like daemon taking care of executing them.
> > - the importers are grouped into 'pools'. only one importer of each pool
> > can run at a given time, which should help reduce the load on the server
> > at some times.
>
> Sounds sensible. Is there any way to define a sequence? In
> scripts I defined
>
> cron_ftpnew_blends.sh
>
> which was calling three importers in the correct sequence. The
> rationale is that later importers might be override citations that are
> more up-to-date than by the importer before. Can your pool method
> implement such a determined sequence?
Can you elaborate on this? Shouldn't the whole sequence run in the same
transaction if the intermediate state is invalid?
> > - to add an importer, simply add it to rudd.conf.
>
> Is this somewhere outside of this mail documented?
No but it's kind-of obvious, no?
Lucas
Reply to: