deb-rev version 0.2
Bonjour,
le changelog :
version 0.2
- add: recursive search in subdirs of $home
- change: system call to create deep dir in parse
- bug fix:
- add: doc about .newmail and .mail extensions
version 0.1
- initial release, corresponding to ddts-rev version 0.9.8
Et une petite question pour les traducteurs.
Je voudrais faire un script « deb-tr » pour l'envoi des demandes de
relectures. Le principe serait le même que pour l'option « mail » de ce
« deb-rev », c.-à-d. :
- recherche récursive dans votre répertoire $home de traduction
(blablabla/french/) correspondant au french/ du cvs, pour que ça
marche bien, il faut que l'architecture des répertoires dans
blablabla/french/ soit la même que celle du cvs ;
- recherche des fichiers <doc> ;
- si <doc.sent> n'existe pas on envoie <doc>, on le renomme en <doc.old>
et on sauve le courriel envoyé dans <doc.sent>.
Est-ce que ça vous irait ?
a+
Nicolas
--
#! /usr/bin/perl -w
use strict;
### Config part
# Things you must change in $HOME/.ddts-rev
my ($home, $tmp, $mail_from, $mail_begin, $mail_end);
# Things you can change
my $debug=1; # level of verbosity 0..3
my $desc_ok="DescOk.txt"; # filename for ok description list
my $comment=">> "; # comment string
my $linenumber="ligne %d :"; # new comment line, must contain %d
my $sendnew="no"; # if set to "yes", send the new description
my $selfsend="yes"; # if set to "yes", you will be sent a copy of outgoing mails
my $mail_title="[relecture] %s"; # must contain %s
my $mail_enc="8bits";
my $mail_charset="iso-8859-1";
my $todo="todo"; # extention of files waiting for a review (*)
my $rev="relu"; # extention of files you already reviewed
my $new="newmail"; # extention of newly created mail files (*)
my $mail="mail"; # extention of ready to be sent mail files
my $sent="sent"; # extention of mails sent (*)
chomp (my $path=`pwd`);
my $conffile = $ENV{HOME}."/.deb-rev";
die 'You must define $home, $tmp, $mail_from, $mail_begin and $mail_end Perl variables in $HOME/.ded-rev' unless -r $conffile;
scalar eval `cat $conffile`;
my $var;
foreach (qw(home tmp mail_from mail_begin mail_end)) {
eval "\$var = \$$_";
die "\$$_ not defined in \$HOME/.deb-rev" unless $var ne '';
}
# files in category marked with (*) are automatically generated.
# Don't edit them, change their name before it.
### End of the config part
=head1 NAME
deb-rev - a tool to ease the work of reviewer of debian l10n lists
=head1 SYNOPSIS
ddeb-rev [parse|mail|clean|stats]
=head1 DESCRIPTION
This program helps the reviewer of document translation with the debian l10n lists.
Here is the basical review process if you use this tool:
=over 4
=item o You get documents from the debian l10n list, containing translations.
Pass this mail to the standard input of this script, providing the I<parse> option.
It will create two files called I<doc-name> and I<doc-name.todo> for each translation
in the mail. The first one is the unchanged translation, for internal use.
The second is a template to ease your review.
=item o You do your review
For that, rename I<doc-name.todo> to I<pkg-doc.relu>. Then, change the translation
found there, and add any comments you want in line starting with:
'>> '
=item o You're done with the review and want to send your work to translators back.
Call the script with the I<mail> option. It will make a diff of your version and
the translators one. If the two versions are equal, nothing will be done. Else,
the script will send a mail in mime format with three parts:
=over 4
=item - the comments you've put in the comment lines
=item - the version resulting of your review
If the variable $sendnew is set to "yes"
=item - the diff between your version and the translator one.
=back
Then, the script will show you the resulting mail, and prompt you if you want to
send it or not. Be carfull with sending mails. Please make sure you are really
done with the review before.
If you choose 'no', the mail will be saved as <doc-name.newmail> so you can
edit it. To send it, rename <doc-name.newmail> in <doc-name.mail> and re-run
the script with the 'mail' option.
Lastly, the script will save the sent mail to I<doc-name.sent> to make sure
the mail won't be sent several times if you run the script several times.
=item o clean your workspace
Calling the script with the I<clean> option removes all temp files like *~ ones,
or the ones created internally. If I<doc-name.todo> and I<doc-name.relu> both
exists, the script will remove the first. So, be carfull when using this option...
=item o stats gives statistics
Print some statistics about the descriptions review process
=back
=cut
my $version="0.2";
# Test if configuration as been made
if (! -d $home) {
mkdir $home || die "Can't create $home. Is the script configured?";
}
# Remove $path/$file
# Print the corresponding message
sub remove {
my($path, $file)=@_;
if (-e "$path/$file") {
print "Removing $file\n";
unlink "$path/$file" || die "Can't remove $file: $!";
}
}
# Extract translator address
# ddts report id
# original translation
# from $path/$file
sub pkg2tmptransid {
my $tmp="";
my ($path, $file)=@_;
open PKG, "$path/$file" || die "Can't read $file: $!";
chomp(my $translator=<PKG>);
$translator =~ s/Translator: //;
$debug && print "Translator: $translator\n";
chomp(my $reportid=<PKG>);
$reportid =~ s/debian Id: //;
$debug && print "debian Id: $reportid\n";
$tmp .= $_ while <PKG>;
close PKG || die "Can't close $file: $!";
return ($tmp, $translator, $reportid);
}
# Extract comments
# new version
# from $path/$file
sub rev2newcomment {
my $com="";
my $new="";
my $linecount=0;
my $lastline=0;
my ($path, $file)=@_;
open REV, "$path/$file" || die "Can't read $file: $!";
# discard translator adress and ddts report id
<REV>; <REV>;
while (<REV>) {
if (/^$comment/) {
if ($linecount!=$lastline) {
$lastline=$linecount;
$com.= "\n".sprintf($linenumber, $linecount)."\n";
}
$com.= $';
} else {
$new .= $_;
$linecount++;
}
}
close REV || die "Can't close $file: $!";
return ($new, $com);
}
sub parse_report {
my $path; # cvs path
my $translator; # translator address
my $debId; # Message-Id field
my $boundary; # mime boundary
# Read the mail header
# Get the translator name
# Get the 'Message-Id:' field so we can use 'In-Reply-To:' when sending email
while (<>) {
last if (/^$/);
if (/^from: /i) {
chomp($translator = $');
$debug && print "Translator: $translator\n";
}
if (/^subject: /i) {
chomp($path = $');
$path .= $1 while (($_=<>)=~/^\s+(.*)$/);
$path .= "\n";
$path =~ /\s\/?(\S*)$/;
$path = $1;
$debug && print "Home: $home\n";
$debug && print "Path: $path\n";
system ("mkdir -p $home/$path") unless (-e "$home/$path");
# mkdir "$home/$path" || die "Can't create directory $home/$path: $!";
}
if (/^message-id: /i) {
chomp($debId = $');
$debug && print "Message-Id: $debId\n";
}
if (/boundary=\"(.*)\"/i) {
chomp($boundary = $1);
$debug && print "boundary: $boundary\n";
}
}
0, until (<> =~ /^--$boundary/); # find beginning of message
while (1) {
# get file name
my $file; # file name
until (defined $file) {
last unless defined($_=<>);
$file=$1 if /filename=\"(.*)\"/;
};
last unless defined $file;
$debug && print "filename: $file\n";
# go to beginning of part
0, until (<> =~ /^$/);
# get part
my $text = "Translator: $translator\n"
."debian Id: $debId\n";
$text .= $_ until (($_=<>) =~ /^--$boundary/);
open FILE, ">$home/$path/$file" || die "Can't create $path/$file: $!";
open TODO, ">$home/$path/$file.$todo" || die "Can't create $path/$file.$todo: $!";
print FILE $text;
print TODO $text;
close TODO || die "Can't write $path/$file.$todo: $!";
close FILE || die "Can't write $path/$file: $!";
# Move rev to rev.old
if (-e "$home/$path/$file.$rev") {
print "Moving $path/$file.$rev -> $path/$file.$rev.old\n";
rename "$home/$path/$file.$rev", "$home/$path/$file.$rev.old";
# If description eq last review rename $file.$todo in $file.$rev
# so the reviewer won't spend time with it
my($temp) = &pkg2tmptransid("$home/$path", "$file");
my($correct) = &rev2newcomment("$home/$path", "$file.$rev.old");
if ($temp eq $correct) {
print "$path/$file is ok\n";
&remove ("$home/$path", "$file.$rev.old");
print "Moving $path/$file.$todo -> $path/$file.$rev\n";
rename "$home/$path/$file.$todo", "$home/$path/$file.$rev";
}
}
&remove("$home/$path", "$file.$sent");
}
}
# Get all subdirs from $path
sub get_dir {
my ($path) = @_;
my @list = ();
opendir (REP, "$path");
foreach (sort readdir (REP)) {
chomp $_;
next unless (-d "$path/$_");
next if ("$path/$_" =~ /\/\./) ;
push (@list, &get_dir ("$path/$_"));
}
closedir REP;
push (@list, "$path");
return @list;
}
# Diff two strings
# $name is only provided for debugging purposes
sub diff {
my $diff="";
my ($name, $orig, $dest)=@_;
open ORIG, ">$tmp/$name" || die "Can't create temp file $name: $!";
print ORIG $orig;
close ORIG || die "Can't write temp file $name: $!";
open DEST,">$tmp/$name.new" || die "Can't create temp file $name.new: $!";
print DEST $dest;
close DEST || die "Can't write temp file $name.new: $!";
system "diff -u $tmp/$name $tmp/$name.new > $tmp/$name.diff" || die "Can't run diff: $!";
open DIFF, "$tmp/$name.diff" || die "Can't open temp file $name.diff: $!";
$diff .= $_ while <DIFF>;
close DIFF || die "Can't close temp file $name.diff: $!";
unlink "$tmp/$name" || die "Can't remove temp file $name:$!";
unlink "$tmp/$name.new" || die "Can't remove temp file $name.new:$!";
unlink "$tmp/$name.diff" || die "Can't remove temp file $name.diff:$!";
return $diff;
}
sub make_mails {
my $boundary;
my $BCount=0;
open OK, ">$home/$desc_ok" || die "Can't create $desc_ok: $!";
foreach $path (&get_dir($home)) {
opendir (PKGLIST,$path) || die "Cannot read the content of $path: $!";
foreach (readdir(PKGLIST)) {
next if /\.$todo$/;
next if /\.$rev$/;
next if /\.$new$/;
next if /\.$mail$/;
next if /\.$sent$/;
next if /^\./;
my $pkg = $_;
if (-e "$path/$pkg.$mail") {
my $text = "";
open MAIL, "$path/$pkg.$mail" || die "Can't open $pkg.$mail: $!";
$text .= $_ while <MAIL>;
close MAIL || die "Can't close $pkg.$mail: $!";
print "Here is the mail:\n$text\nDo you want to send it [Y/n] ?\n";
if (!(<> =~ /^[nN]/)) {
rename "$path/$pkg.$mail", "$path/$pkg.$sent";
open SENDMAIL,"| /usr/lib/sendmail -t -oi -oem" || die "Can't run sendmail: $!";
print SENDMAIL $text;
close SENDMAIL || die "Can't run sendmail: $!";
print "Mail sent\n";
} else {
print "Mail not sent\n";
}
next;
}
if (-e "$path/$pkg.$rev" && -e "$path/$pkg") {
if (-e "$path/$pkg.$sent") {
print "$pkg.$sent exists. I won't send the same mail twice\n";
next;
}
if (-e "$path/$pkg.$new") {
print "$pkg.$new exists. rename it to $pkg.$mail to send it\n";
next;
}
$boundary="----------=_".scalar(time)."-$$-".$BCount++;
my($temp, $translator, $reportid) = &pkg2tmptransid("$path", "$pkg");
my($correct, $comment) = &rev2newcomment("$path", "$pkg.$rev");
# build the mail
my $text = "From: $mail_from\n"
."To: ".($debug>1?$mail_from:$translator)."\n";
$text .= "Cc: $mail_from\n" if ($selfsend eq "yes");
$text .= "Subject: ".sprintf ($mail_title, substr($path, length($home)+1)."/$pkg")."\n"
."In-Reply-To: $reportid\n"
."Mime-Version: 1.0\n"
."Content-Type: multipart/mixed; boundary=\"$boundary\"\n"
."Content-Disposition: inline\n"
."Content-Transfer-Encoding: $mail_enc\n"
."User-Agent: ddts review helper\n\n\n"
."--$boundary\n"
."Content-Type: text/plain; charset=$mail_charset\n"
."Content-Disposition: inline\n"
."Content-Transfer-Encoding: $mail_enc\n\n"
.$mail_begin;
$text .= $comment;
$text .= $mail_end;
if ($sendnew eq "yes") {
$text .= "\n\n"
."--$boundary\n"
."Content-Type: text/plain; charset=$mail_charset\n"
."Content-Disposition: attachment; filename=\"$pkg.new\"\n\n"
.$correct;
}
$text .= "\n\n"
."--$boundary\n"
."Content-Type: text/plain; charset=$mail_charset\n"
."Content-Disposition: attachment; filename=\"$pkg.diff\"\n\n";
if ($temp eq $correct) {
# empty diff
print OK "$path/$pkg\n";
} else {
# puts the diff
$text .= &diff($pkg, $temp, $correct);
# Ends the mime stuff
$text .= "--$boundary--\n\n";
print "Here is the mail:\n$text\nDo you want to send it [Y/n] ?\n";
if (!(<> =~ /^[nN]/)) {
open SENT, ">$path/$pkg.$sent" || die "Can't create $pkg.$sent: $!";
print SENT $text;
close SENT || die "Can't write $pkg.$sent: $!";
open SENDMAIL,"| /usr/lib/sendmail -t -oi -oem" || die "Can't run sendmail: $!";
print SENDMAIL $text;
close SENDMAIL || die "Can't run sendmail: $!";
print "Mail sent\n";
} else {
open MAIL, ">$path/$pkg.$new" || die "Can't create $pkg.$new: $!";
print MAIL $text;
close MAIL || die "Can't write $pkg.$new: $!";
print "Mail saved as $pkg.$new\n";
}
}
}
}
closedir PKGLIST || die "Cannot read the content of $path: $!";
}
close OK || die "Can't write $desc_ok: $!";
}
# remove $pkg.$rm if $pkg.$e also exists in $path
# print corresponding message
sub test_remove {
my($path, $pkg, $e, $rm)=@_;
if (-e "$path/$pkg.$e" && -e "$path/$pkg.$rm") {
print "Removing $pkg.$rm\n";
unlink "$path/$pkg.$rm" || die "Can't remove $pkg.$rm: $!";
}
}
sub clean {
foreach $path (&get_dir($home)) {
opendir (PKGLIST,$path) || die "Can't read the content of $path: $!";
foreach (readdir(PKGLIST)) {
&remove_tmp ("$path", "$_", "") if /~$/;
next if /\.$todo$/;
next if /\.$rev$/;
next if /\.$new$/;
next if /\.$mail$/;
next if /\.$sent$/;
next if /^\./;
my $pkg = $_;
&test_remove ("$path", "$pkg", "$rev", "$todo");
&test_remove ("$path", "$pkg", "$rev", "$rev.old");
&test_remove ("$path", "$pkg", "$mail", "$new");
&test_remove ("$path", "$pkg", "$sent", "$mail");
}
closedir PKGLIST || die "Can't close $path: $!";
}
}
sub statistics {
my $count_pkg=0;
my $count_todo=0;
my $count_relu=0;
my $count_new=0;
my $count_mail=0;
my $count_sent=0;
my $count_ok=0;
my $l=0; # length of longest figure for nice formatting
foreach $path (&get_dir($home)) {
opendir (PKGLIST,$path) || die "Can't read the content of $path: $!";
foreach (readdir(PKGLIST)) {
next if /\.$todo$/;
next if /\.$rev$/;
next if /\.$new$/;
next if /\.$mail$/;
next if /\.$sent$/;
next if /^\./;
my $pkg = $_;
if ((-e "$path/$pkg.$rev" || -e "$path/$pkg.$todo") && -e "$path/$pkg") {
$count_pkg++;
$count_todo++ if (-e "$path/$pkg.$todo");
$count_new++ if (-e "$path/$pkg.$new");
$count_mail++ if (-e "$path/$pkg.$mail");
$count_relu++ if (-e "$path/$pkg.$rev");
$count_sent++ if (-e "$path/$pkg.$sent");
}
}
closedir PKGLIST || die "Can't close $path: $!";
}
if (-e "$home/$desc_ok") {
open OK, "$home/$desc_ok" || die "Can't open $desc_ok: $!";
$count_ok++ while (<OK>);
close OK || die "Can't close $desc_ok: $!";
}
$l = $_>$l?$_:$l foreach ($count_pkg, $count_todo, $count_relu, $count_new, $count_mail, $count_sent, $count_ok);
$l = length $l;
printf ("new mail: %${l}d\n", $count_new);
printf (" to send: %${l}d\n", $count_mail);
printf (" sent: %${l}d\n", $count_sent);
printf (" ok: %${l}d\n", $count_ok);
print (" ------"."-"x$l."\n");
printf ("reviewed: %${l}d\n", $count_relu);
printf (" todo: %${l}d\n", $count_todo);
print ("=========="."="x$l."\n");
printf (" total: %${l}d\n", $count_pkg);
}
my $cmd=shift || '';
if ($cmd eq "parse") {
&parse_report();
} elsif ($cmd eq "mail") {
&make_mails();
} elsif ($cmd eq "clean") {
&clean();
} elsif ($cmd eq "stats") {
&statistics();
} else {
my $me=$0;
$me=~s,^.*?/([^/]*)$,$1,;
die "Usage $me [parse|mail|clean]\n"
." parse: read a ddts from the standard input and change the files in $home\n"
." mail: create the pkg.newmail files which you should edit and send\n"
." clean: remove : \n"
." - *~\n"
." - the $todo when a $rev exists\n"
." - all tmp files (.diff, .new, .tmp)\n"
."\n$me version $version\n";
}
=head1 AUTHORS
Nicolas Bertolissio <nico.bertol@wanadoo.fr>
=cut
Reply to: